2024-01-10T03:26:18,161 Created temporary directory: /tmp/pip-build-tracker-ugn_ur2i
2024-01-10T03:26:18,162 Initialized build tracking at /tmp/pip-build-tracker-ugn_ur2i
2024-01-10T03:26:18,162 Created build tracker: /tmp/pip-build-tracker-ugn_ur2i
2024-01-10T03:26:18,163 Entered build tracker: /tmp/pip-build-tracker-ugn_ur2i
2024-01-10T03:26:18,163 Created temporary directory: /tmp/pip-wheel-ua9zoiqy
2024-01-10T03:26:18,167 Created temporary directory: /tmp/pip-ephem-wheel-cache-gbogi9n6
2024-01-10T03:26:18,190 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-01-10T03:26:18,194 2 location(s) to search for versions of alpaca-eval:
2024-01-10T03:26:18,194 * https://pypi.org/simple/alpaca-eval/
2024-01-10T03:26:18,194 * https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T03:26:18,195 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-01-10T03:26:18,195 Getting page https://pypi.org/simple/alpaca-eval/
2024-01-10T03:26:18,197 Found index url https://pypi.org/simple/
2024-01-10T03:26:18,413 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-01-10T03:26:18,423   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,424   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-01-10T03:26:18,424   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,425   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-01-10T03:26:18,426   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,427   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-01-10T03:26:18,428   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,429   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-01-10T03:26:18,430   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,431   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-01-10T03:26:18,432   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,433   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-01-10T03:26:18,434   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,434   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-01-10T03:26:18,435   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,436   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-01-10T03:26:18,437   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,437   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-01-10T03:26:18,438   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,439   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-01-10T03:26:18,440   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,441   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-01-10T03:26:18,441   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,442   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-01-10T03:26:18,443   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,444   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-01-10T03:26:18,445   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,446   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-01-10T03:26:18,446   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,447   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-01-10T03:26:18,448   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,448   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-01-10T03:26:18,449   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,450   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-01-10T03:26:18,450   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,451   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-01-10T03:26:18,452   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,453   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-01-10T03:26:18,454   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,455   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-01-10T03:26:18,456   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,457   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-01-10T03:26:18,458   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,458   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-01-10T03:26:18,459   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,460   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-01-10T03:26:18,460   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,461   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-01-10T03:26:18,462   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,462   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-01-10T03:26:18,463   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,464   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-01-10T03:26:18,465 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T03:26:18,465 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T03:26:18,467 Found index url https://www.piwheels.org/simple/
2024-01-10T03:26:18,648 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-01-10T03:26:18,655   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,655   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,656   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,657   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,658   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,658   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,658   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,659   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,659   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,660   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,660   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,661   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,661   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,662   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,662   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,663   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,663   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,664   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T03:26:18,665   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,665   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,666   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T03:26:18,666 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T03:26:18,667 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-01-10T03:26:18,688 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-01-10T03:26:18,706 Collecting alpaca-eval==0.5.0
2024-01-10T03:26:18,708   Created temporary directory: /tmp/pip-unpack-npys4lwz
2024-01-10T03:26:18,926   Downloading alpaca_eval-0.5.0.tar.gz (331 kB)
2024-01-10T03:26:19,545   Added alpaca-eval==0.5.0 from https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz to build tracker '/tmp/pip-build-tracker-ugn_ur2i'
2024-01-10T03:26:19,547   Running setup.py (path:/tmp/pip-wheel-ua9zoiqy/alpaca-eval_7b94101f34fc410bbee9bbd3e97d2bb8/setup.py) egg_info for package alpaca-eval
2024-01-10T03:26:19,548   Created temporary directory: /tmp/pip-pip-egg-info-zjblyyie
2024-01-10T03:26:19,549   Preparing metadata (setup.py): started
2024-01-10T03:26:19,550   Running command python setup.py egg_info
2024-01-10T03:26:20,529   running egg_info
2024-01-10T03:26:20,531   creating /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info
2024-01-10T03:26:20,554   writing /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/PKG-INFO
2024-01-10T03:26:20,573   writing dependency_links to /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/dependency_links.txt
2024-01-10T03:26:20,574   writing entry points to /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/entry_points.txt
2024-01-10T03:26:20,583   writing requirements to /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/requires.txt
2024-01-10T03:26:20,584   writing top-level names to /tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/top_level.txt
2024-01-10T03:26:20,586   writing manifest file '/tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T03:26:20,662   reading manifest file '/tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T03:26:20,664   reading manifest template 'MANIFEST.in'
2024-01-10T03:26:20,809   adding license file 'LICENSE'
2024-01-10T03:26:20,818   writing manifest file '/tmp/pip-pip-egg-info-zjblyyie/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T03:26:20,927   Preparing metadata (setup.py): finished with status 'done'
2024-01-10T03:26:20,934   Source in /tmp/pip-wheel-ua9zoiqy/alpaca-eval_7b94101f34fc410bbee9bbd3e97d2bb8 has version 0.5.0, which satisfies requirement alpaca-eval==0.5.0 from https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz
2024-01-10T03:26:20,935   Removed alpaca-eval==0.5.0 from https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz from build tracker '/tmp/pip-build-tracker-ugn_ur2i'
2024-01-10T03:26:20,948 Created temporary directory: /tmp/pip-unpack-8abbuwsj
2024-01-10T03:26:20,949 Created temporary directory: /tmp/pip-unpack-5a64usy4
2024-01-10T03:26:21,089 Building wheels for collected packages: alpaca-eval
2024-01-10T03:26:21,093   Created temporary directory: /tmp/pip-wheel-37qyxf11
2024-01-10T03:26:21,093   Building wheel for alpaca-eval (setup.py): started
2024-01-10T03:26:21,094   Destination directory: /tmp/pip-wheel-37qyxf11
2024-01-10T03:26:21,095   Running command python setup.py bdist_wheel
2024-01-10T03:26:22,064   running bdist_wheel
2024-01-10T03:26:22,155   running build
2024-01-10T03:26:22,156   running build_py
2024-01-10T03:26:22,182   creating build
2024-01-10T03:26:22,183   creating build/lib
2024-01-10T03:26:22,184   creating build/lib/alpaca_eval
2024-01-10T03:26:22,185   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,187   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,189   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,192   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,193   copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,195   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,197   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,199   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,201   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,204   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-01-10T03:26:22,207   creating build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,208   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,210   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,212   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,214   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,216   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,217   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,219   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,221   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,223   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,224   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,227   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-01-10T03:26:22,229   creating build/lib/alpaca_eval/annotators
2024-01-10T03:26:22,230   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-01-10T03:26:22,232   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-01-10T03:26:22,234   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-01-10T03:26:22,236   running egg_info
2024-01-10T03:26:22,290   writing src/alpaca_eval.egg-info/PKG-INFO
2024-01-10T03:26:22,309   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-01-10T03:26:22,310   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-01-10T03:26:22,319   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-01-10T03:26:22,321   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-01-10T03:26:22,349   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T03:26:22,357   reading manifest template 'MANIFEST.in'
2024-01-10T03:26:22,478   adding license file 'LICENSE'
2024-01-10T03:26:22,491   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T03:26:22,494   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-01-10T03:26:22,494   !!

2024-01-10T03:26:22,495           ********************************************************************************
2024-01-10T03:26:22,496           ############################
2024-01-10T03:26:22,496           # Package would be ignored #
2024-01-10T03:26:22,497           ############################
2024-01-10T03:26:22,497           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-01-10T03:26:22,497           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,498           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,499           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-01-10T03:26:22,499           to the `packages` configuration field.

2024-01-10T03:26:22,500           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,501           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,501           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,502           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,503           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,505           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-01-10T03:26:22,505           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-01-10T03:26:22,506           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,506           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,507           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,508           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,509           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,511           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,511                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,512                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,512                 directory, all directories are treated like packages.
2024-01-10T03:26:22,512           ********************************************************************************

2024-01-10T03:26:22,513   !!
2024-01-10T03:26:22,514     check.warn(importable)
2024-01-10T03:26:22,514   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:22,515   !!

2024-01-10T03:26:22,516           ********************************************************************************
2024-01-10T03:26:22,517           ############################
2024-01-10T03:26:22,517           # Package would be ignored #
2024-01-10T03:26:22,518           ############################
2024-01-10T03:26:22,518           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:22,519           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,520           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,520           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-01-10T03:26:22,520           to the `packages` configuration field.

2024-01-10T03:26:22,521           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,521           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,522           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,522           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,523           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,524           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-01-10T03:26:22,524           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-01-10T03:26:22,524           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,525           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,525           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,526           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,527           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,528           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,529                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,529                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,530                 directory, all directories are treated like packages.
2024-01-10T03:26:22,530           ********************************************************************************

2024-01-10T03:26:22,531   !!
2024-01-10T03:26:22,531     check.warn(importable)
2024-01-10T03:26:22,532   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:22,533   !!

2024-01-10T03:26:22,534           ********************************************************************************
2024-01-10T03:26:22,534           ############################
2024-01-10T03:26:22,535           # Package would be ignored #
2024-01-10T03:26:22,535           ############################
2024-01-10T03:26:22,536           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:22,536           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,537           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,538           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-01-10T03:26:22,538           to the `packages` configuration field.

2024-01-10T03:26:22,539           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,539           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,540           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,541           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,542           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,543           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-01-10T03:26:22,544           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-01-10T03:26:22,544           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,545           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,545           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,546           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,546           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,547           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,548                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,548                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,548                 directory, all directories are treated like packages.
2024-01-10T03:26:22,549           ********************************************************************************

2024-01-10T03:26:22,550   !!
2024-01-10T03:26:22,550     check.warn(importable)
2024-01-10T03:26:22,550   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-10T03:26:22,551   !!

2024-01-10T03:26:22,551           ********************************************************************************
2024-01-10T03:26:22,552           ############################
2024-01-10T03:26:22,552           # Package would be ignored #
2024-01-10T03:26:22,553           ############################
2024-01-10T03:26:22,553           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-01-10T03:26:22,554           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,555           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,555           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-01-10T03:26:22,555           to the `packages` configuration field.

2024-01-10T03:26:22,556           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,557           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,557           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,558           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,559           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,560           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-01-10T03:26:22,560           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-01-10T03:26:22,561           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,561           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,562           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,563           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,564           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,565           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,566                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,566                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,567                 directory, all directories are treated like packages.
2024-01-10T03:26:22,568           ********************************************************************************

2024-01-10T03:26:22,569   !!
2024-01-10T03:26:22,569     check.warn(importable)
2024-01-10T03:26:22,570   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:22,570   !!

2024-01-10T03:26:22,571           ********************************************************************************
2024-01-10T03:26:22,571           ############################
2024-01-10T03:26:22,571           # Package would be ignored #
2024-01-10T03:26:22,572           ############################
2024-01-10T03:26:22,572           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-01-10T03:26:22,572           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,573           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,573           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-01-10T03:26:22,574           to the `packages` configuration field.

2024-01-10T03:26:22,574           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,575           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,575           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,576           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,577           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,578           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-01-10T03:26:22,578           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-01-10T03:26:22,579           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,579           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,580           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,581           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,582           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,584           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,584                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,585                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,585                 directory, all directories are treated like packages.
2024-01-10T03:26:22,585           ********************************************************************************

2024-01-10T03:26:22,586   !!
2024-01-10T03:26:22,587     check.warn(importable)
2024-01-10T03:26:22,587   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-01-10T03:26:22,588   !!

2024-01-10T03:26:22,589           ********************************************************************************
2024-01-10T03:26:22,589           ############################
2024-01-10T03:26:22,589           # Package would be ignored #
2024-01-10T03:26:22,590           ############################
2024-01-10T03:26:22,591           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-01-10T03:26:22,591           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,592           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,593           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-01-10T03:26:22,594           to the `packages` configuration field.

2024-01-10T03:26:22,596           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,597           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,597           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,598           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,598           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,599           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-01-10T03:26:22,599           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-01-10T03:26:22,600           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,600           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,600           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,601           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,602           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,603           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,603                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,604                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,604                 directory, all directories are treated like packages.
2024-01-10T03:26:22,605           ********************************************************************************

2024-01-10T03:26:22,606   !!
2024-01-10T03:26:22,606     check.warn(importable)
2024-01-10T03:26:22,607   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-01-10T03:26:22,607   !!

2024-01-10T03:26:22,608           ********************************************************************************
2024-01-10T03:26:22,608           ############################
2024-01-10T03:26:22,609           # Package would be ignored #
2024-01-10T03:26:22,609           ############################
2024-01-10T03:26:22,610           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-01-10T03:26:22,610           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,611           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,612           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-01-10T03:26:22,612           to the `packages` configuration field.

2024-01-10T03:26:22,613           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,613           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,614           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,615           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,616           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,617           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-01-10T03:26:22,617           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-01-10T03:26:22,618           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,618           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,619           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,620           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,620           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,621           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,622                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,622                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,622                 directory, all directories are treated like packages.
2024-01-10T03:26:22,623           ********************************************************************************

2024-01-10T03:26:22,623   !!
2024-01-10T03:26:22,624     check.warn(importable)
2024-01-10T03:26:22,624   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-01-10T03:26:22,624   !!

2024-01-10T03:26:22,625           ********************************************************************************
2024-01-10T03:26:22,625           ############################
2024-01-10T03:26:22,626           # Package would be ignored #
2024-01-10T03:26:22,626           ############################
2024-01-10T03:26:22,627           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-01-10T03:26:22,627           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,628           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,628           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-01-10T03:26:22,629           to the `packages` configuration field.

2024-01-10T03:26:22,630           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,630           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,631           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,632           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,633           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,634           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-01-10T03:26:22,634           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-01-10T03:26:22,635           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,635           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,636           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,637           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,638           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,639           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,639                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,640                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,640                 directory, all directories are treated like packages.
2024-01-10T03:26:22,641           ********************************************************************************

2024-01-10T03:26:22,642   !!
2024-01-10T03:26:22,643     check.warn(importable)
2024-01-10T03:26:22,643   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-10T03:26:22,644   !!

2024-01-10T03:26:22,645           ********************************************************************************
2024-01-10T03:26:22,645           ############################
2024-01-10T03:26:22,645           # Package would be ignored #
2024-01-10T03:26:22,646           ############################
2024-01-10T03:26:22,646           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-01-10T03:26:22,646           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,647           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,648           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-01-10T03:26:22,648           to the `packages` configuration field.

2024-01-10T03:26:22,649           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,649           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,650           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,651           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,651           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,652           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-01-10T03:26:22,653           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-01-10T03:26:22,653           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,653           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,654           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,655           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,656           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,657           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,658                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,658                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,659                 directory, all directories are treated like packages.
2024-01-10T03:26:22,659           ********************************************************************************

2024-01-10T03:26:22,660   !!
2024-01-10T03:26:22,661     check.warn(importable)
2024-01-10T03:26:22,661   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-01-10T03:26:22,662   !!

2024-01-10T03:26:22,662           ********************************************************************************
2024-01-10T03:26:22,663           ############################
2024-01-10T03:26:22,663           # Package would be ignored #
2024-01-10T03:26:22,664           ############################
2024-01-10T03:26:22,664           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-01-10T03:26:22,665           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,666           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,666           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-01-10T03:26:22,667           to the `packages` configuration field.

2024-01-10T03:26:22,668           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,668           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,669           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,670           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,671           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,671           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-01-10T03:26:22,672           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-01-10T03:26:22,672           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,672           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,673           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,673           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,674           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,675           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,676                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,676                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,676                 directory, all directories are treated like packages.
2024-01-10T03:26:22,677           ********************************************************************************

2024-01-10T03:26:22,678   !!
2024-01-10T03:26:22,678     check.warn(importable)
2024-01-10T03:26:22,678   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:22,679   !!

2024-01-10T03:26:22,680           ********************************************************************************
2024-01-10T03:26:22,680           ############################
2024-01-10T03:26:22,681           # Package would be ignored #
2024-01-10T03:26:22,681           ############################
2024-01-10T03:26:22,682           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-01-10T03:26:22,682           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,683           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,684           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-01-10T03:26:22,684           to the `packages` configuration field.

2024-01-10T03:26:22,685           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,686           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,686           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,687           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,688           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,689           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-01-10T03:26:22,689           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-01-10T03:26:22,689           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,690           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,690           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,691           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,692           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,694           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,695                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,695                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,695                 directory, all directories are treated like packages.
2024-01-10T03:26:22,695           ********************************************************************************

2024-01-10T03:26:22,696   !!
2024-01-10T03:26:22,696     check.warn(importable)
2024-01-10T03:26:22,697   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:22,697   !!

2024-01-10T03:26:22,698           ********************************************************************************
2024-01-10T03:26:22,698           ############################
2024-01-10T03:26:22,698           # Package would be ignored #
2024-01-10T03:26:22,699           ############################
2024-01-10T03:26:22,699           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-01-10T03:26:22,700           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,700           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,701           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-01-10T03:26:22,701           to the `packages` configuration field.

2024-01-10T03:26:22,702           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,702           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,703           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,704           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,705           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,705           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-01-10T03:26:22,706           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-01-10T03:26:22,706           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,707           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,707           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,708           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,709           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,710           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,711                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,711                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,712                 directory, all directories are treated like packages.
2024-01-10T03:26:22,712           ********************************************************************************

2024-01-10T03:26:22,713   !!
2024-01-10T03:26:22,714     check.warn(importable)
2024-01-10T03:26:22,714   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-10T03:26:22,715   !!

2024-01-10T03:26:22,716           ********************************************************************************
2024-01-10T03:26:22,716           ############################
2024-01-10T03:26:22,717           # Package would be ignored #
2024-01-10T03:26:22,718           ############################
2024-01-10T03:26:22,718           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-01-10T03:26:22,719           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,720           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,720           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-01-10T03:26:22,720           to the `packages` configuration field.

2024-01-10T03:26:22,721           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,721           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,722           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,722           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,723           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,724           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-01-10T03:26:22,724           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-01-10T03:26:22,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,725           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,725           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,726           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,727           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,729           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,729                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,729                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,730                 directory, all directories are treated like packages.
2024-01-10T03:26:22,730           ********************************************************************************

2024-01-10T03:26:22,731   !!
2024-01-10T03:26:22,732     check.warn(importable)
2024-01-10T03:26:22,732   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-10T03:26:22,733   !!

2024-01-10T03:26:22,734           ********************************************************************************
2024-01-10T03:26:22,734           ############################
2024-01-10T03:26:22,735           # Package would be ignored #
2024-01-10T03:26:22,735           ############################
2024-01-10T03:26:22,736           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-01-10T03:26:22,736           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,737           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,738           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-01-10T03:26:22,738           to the `packages` configuration field.

2024-01-10T03:26:22,739           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,739           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,740           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,741           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,742           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,743           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-01-10T03:26:22,743           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-01-10T03:26:22,744           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,745           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,745           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,746           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,746           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,747           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,748                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,748                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,748                 directory, all directories are treated like packages.
2024-01-10T03:26:22,749           ********************************************************************************

2024-01-10T03:26:22,749   !!
2024-01-10T03:26:22,750     check.warn(importable)
2024-01-10T03:26:22,750   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-01-10T03:26:22,750   !!

2024-01-10T03:26:22,751           ********************************************************************************
2024-01-10T03:26:22,752           ############################
2024-01-10T03:26:22,752           # Package would be ignored #
2024-01-10T03:26:22,752           ############################
2024-01-10T03:26:22,753           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-01-10T03:26:22,753           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,754           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,755           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-01-10T03:26:22,755           to the `packages` configuration field.

2024-01-10T03:26:22,756           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,757           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,757           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,758           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,759           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,760           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-01-10T03:26:22,760           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-01-10T03:26:22,760           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,761           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,761           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,762           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,763           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,764           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,765                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,765                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,766                 directory, all directories are treated like packages.
2024-01-10T03:26:22,766           ********************************************************************************

2024-01-10T03:26:22,767   !!
2024-01-10T03:26:22,768     check.warn(importable)
2024-01-10T03:26:22,768   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-01-10T03:26:22,768   !!

2024-01-10T03:26:22,769           ********************************************************************************
2024-01-10T03:26:22,769           ############################
2024-01-10T03:26:22,770           # Package would be ignored #
2024-01-10T03:26:22,770           ############################
2024-01-10T03:26:22,770           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-01-10T03:26:22,771           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,771           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,772           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-01-10T03:26:22,772           to the `packages` configuration field.

2024-01-10T03:26:22,773           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,773           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,774           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,774           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,775           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,776           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-01-10T03:26:22,777           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-01-10T03:26:22,777           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,778           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,778           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,779           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,780           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,781           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,782                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,782                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,783                 directory, all directories are treated like packages.
2024-01-10T03:26:22,783           ********************************************************************************

2024-01-10T03:26:22,784   !!
2024-01-10T03:26:22,785     check.warn(importable)
2024-01-10T03:26:22,785   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-01-10T03:26:22,786   !!

2024-01-10T03:26:22,787           ********************************************************************************
2024-01-10T03:26:22,787           ############################
2024-01-10T03:26:22,787           # Package would be ignored #
2024-01-10T03:26:22,788           ############################
2024-01-10T03:26:22,788           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-01-10T03:26:22,789           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,790           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,790           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-01-10T03:26:22,791           to the `packages` configuration field.

2024-01-10T03:26:22,792           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,793           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,793           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,794           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,794           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,795           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-01-10T03:26:22,795           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-01-10T03:26:22,796           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,796           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,796           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,797           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,798           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,799                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,799                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,800                 directory, all directories are treated like packages.
2024-01-10T03:26:22,800           ********************************************************************************

2024-01-10T03:26:22,801   !!
2024-01-10T03:26:22,802     check.warn(importable)
2024-01-10T03:26:22,802   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-01-10T03:26:22,803   !!

2024-01-10T03:26:22,804           ********************************************************************************
2024-01-10T03:26:22,804           ############################
2024-01-10T03:26:22,805           # Package would be ignored #
2024-01-10T03:26:22,805           ############################
2024-01-10T03:26:22,806           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-01-10T03:26:22,806           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,807           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,808           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-01-10T03:26:22,808           to the `packages` configuration field.

2024-01-10T03:26:22,809           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,810           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,810           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,811           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,812           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,813           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-01-10T03:26:22,813           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-01-10T03:26:22,814           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,814           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,815           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,816           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,817           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,818           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,818                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,819                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,819                 directory, all directories are treated like packages.
2024-01-10T03:26:22,819           ********************************************************************************

2024-01-10T03:26:22,820   !!
2024-01-10T03:26:22,820     check.warn(importable)
2024-01-10T03:26:22,821   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-01-10T03:26:22,821   !!

2024-01-10T03:26:22,822           ********************************************************************************
2024-01-10T03:26:22,822           ############################
2024-01-10T03:26:22,822           # Package would be ignored #
2024-01-10T03:26:22,823           ############################
2024-01-10T03:26:22,823           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-01-10T03:26:22,823           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,824           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,824           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-01-10T03:26:22,825           to the `packages` configuration field.

2024-01-10T03:26:22,826           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,826           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,827           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,828           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,829           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,830           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-01-10T03:26:22,831           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-01-10T03:26:22,831           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,832           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,832           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,833           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,834           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,835           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,836                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,836                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,837                 directory, all directories are treated like packages.
2024-01-10T03:26:22,837           ********************************************************************************

2024-01-10T03:26:22,838   !!
2024-01-10T03:26:22,839     check.warn(importable)
2024-01-10T03:26:22,839   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-01-10T03:26:22,840   !!

2024-01-10T03:26:22,841           ********************************************************************************
2024-01-10T03:26:22,841           ############################
2024-01-10T03:26:22,842           # Package would be ignored #
2024-01-10T03:26:22,842           ############################
2024-01-10T03:26:22,843           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-01-10T03:26:22,843           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,844           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,844           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-01-10T03:26:22,844           to the `packages` configuration field.

2024-01-10T03:26:22,845           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,845           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,846           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,846           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,847           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,848           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-01-10T03:26:22,848           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-01-10T03:26:22,848           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,849           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,849           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,850           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,852           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,853           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,854                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,854                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,855                 directory, all directories are treated like packages.
2024-01-10T03:26:22,855           ********************************************************************************

2024-01-10T03:26:22,856   !!
2024-01-10T03:26:22,857     check.warn(importable)
2024-01-10T03:26:22,857   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-10T03:26:22,857   !!

2024-01-10T03:26:22,858           ********************************************************************************
2024-01-10T03:26:22,859           ############################
2024-01-10T03:26:22,859           # Package would be ignored #
2024-01-10T03:26:22,860           ############################
2024-01-10T03:26:22,860           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-10T03:26:22,860           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,861           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,862           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-01-10T03:26:22,862           to the `packages` configuration field.

2024-01-10T03:26:22,863           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,864           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,864           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,865           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,866           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,868           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-10T03:26:22,868           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-01-10T03:26:22,868           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,869           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,869           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,870           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,870           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,871           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,872                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,872                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,872                 directory, all directories are treated like packages.
2024-01-10T03:26:22,873           ********************************************************************************

2024-01-10T03:26:22,874   !!
2024-01-10T03:26:22,874     check.warn(importable)
2024-01-10T03:26:22,874   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:22,875   !!

2024-01-10T03:26:22,876           ********************************************************************************
2024-01-10T03:26:22,876           ############################
2024-01-10T03:26:22,876           # Package would be ignored #
2024-01-10T03:26:22,877           ############################
2024-01-10T03:26:22,877           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-01-10T03:26:22,878           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,879           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,879           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-01-10T03:26:22,880           to the `packages` configuration field.

2024-01-10T03:26:22,880           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,881           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,881           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,882           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,883           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,884           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-01-10T03:26:22,884           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-01-10T03:26:22,885           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,885           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,886           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,887           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,888           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,889           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,890                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,890                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,891                 directory, all directories are treated like packages.
2024-01-10T03:26:22,891           ********************************************************************************

2024-01-10T03:26:22,892   !!
2024-01-10T03:26:22,893     check.warn(importable)
2024-01-10T03:26:22,893   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:22,893   !!

2024-01-10T03:26:22,894           ********************************************************************************
2024-01-10T03:26:22,894           ############################
2024-01-10T03:26:22,895           # Package would be ignored #
2024-01-10T03:26:22,895           ############################
2024-01-10T03:26:22,895           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:22,896           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,896           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,897           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-01-10T03:26:22,897           to the `packages` configuration field.

2024-01-10T03:26:22,898           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,898           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,899           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,900           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,900           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,901           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-01-10T03:26:22,902           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-01-10T03:26:22,902           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,902           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,903           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,904           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,904           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,906           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,906                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,907                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,907                 directory, all directories are treated like packages.
2024-01-10T03:26:22,908           ********************************************************************************

2024-01-10T03:26:22,908   !!
2024-01-10T03:26:22,909     check.warn(importable)
2024-01-10T03:26:22,909   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-01-10T03:26:22,910   !!

2024-01-10T03:26:22,911           ********************************************************************************
2024-01-10T03:26:22,911           ############################
2024-01-10T03:26:22,912           # Package would be ignored #
2024-01-10T03:26:22,912           ############################
2024-01-10T03:26:22,912           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-01-10T03:26:22,913           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,914           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,915           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-01-10T03:26:22,915           to the `packages` configuration field.

2024-01-10T03:26:22,917           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,917           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,917           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,918           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,919           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,920           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-01-10T03:26:22,920           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-01-10T03:26:22,921           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,921           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,921           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,922           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,923           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,924           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,924                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,925                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,925                 directory, all directories are treated like packages.
2024-01-10T03:26:22,925           ********************************************************************************

2024-01-10T03:26:22,926   !!
2024-01-10T03:26:22,927     check.warn(importable)
2024-01-10T03:26:22,927   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-01-10T03:26:22,927   !!

2024-01-10T03:26:22,928           ********************************************************************************
2024-01-10T03:26:22,929           ############################
2024-01-10T03:26:22,929           # Package would be ignored #
2024-01-10T03:26:22,930           ############################
2024-01-10T03:26:22,930           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-01-10T03:26:22,931           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,932           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,932           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-01-10T03:26:22,933           to the `packages` configuration field.

2024-01-10T03:26:22,934           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,934           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,935           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,936           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,936           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,938           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-01-10T03:26:22,938           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-01-10T03:26:22,939           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,939           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,940           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,941           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,941           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,942           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,943                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,943                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,943                 directory, all directories are treated like packages.
2024-01-10T03:26:22,944           ********************************************************************************

2024-01-10T03:26:22,944   !!
2024-01-10T03:26:22,945     check.warn(importable)
2024-01-10T03:26:22,945   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-01-10T03:26:22,945   !!

2024-01-10T03:26:22,946           ********************************************************************************
2024-01-10T03:26:22,947           ############################
2024-01-10T03:26:22,947           # Package would be ignored #
2024-01-10T03:26:22,947           ############################
2024-01-10T03:26:22,948           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-01-10T03:26:22,948           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,949           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,949           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-01-10T03:26:22,949           to the `packages` configuration field.

2024-01-10T03:26:22,950           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,951           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,951           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,952           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,953           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,954           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-01-10T03:26:22,954           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-01-10T03:26:22,955           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,955           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,955           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,956           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,957           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,959           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,960                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,960                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,960                 directory, all directories are treated like packages.
2024-01-10T03:26:22,961           ********************************************************************************

2024-01-10T03:26:22,962   !!
2024-01-10T03:26:22,962     check.warn(importable)
2024-01-10T03:26:22,963   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-01-10T03:26:22,963   !!

2024-01-10T03:26:22,964           ********************************************************************************
2024-01-10T03:26:22,964           ############################
2024-01-10T03:26:22,965           # Package would be ignored #
2024-01-10T03:26:22,965           ############################
2024-01-10T03:26:22,965           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-01-10T03:26:22,966           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,966           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,967           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-01-10T03:26:22,967           to the `packages` configuration field.

2024-01-10T03:26:22,968           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,968           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,968           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,969           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,970           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,970           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-01-10T03:26:22,971           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-01-10T03:26:22,971           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,972           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,972           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,973           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,974           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,975           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,975                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,976                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,977                 directory, all directories are treated like packages.
2024-01-10T03:26:22,977           ********************************************************************************

2024-01-10T03:26:22,978   !!
2024-01-10T03:26:22,979     check.warn(importable)
2024-01-10T03:26:22,979   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-01-10T03:26:22,980   !!

2024-01-10T03:26:22,980           ********************************************************************************
2024-01-10T03:26:22,981           ############################
2024-01-10T03:26:22,981           # Package would be ignored #
2024-01-10T03:26:22,982           ############################
2024-01-10T03:26:22,982           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-01-10T03:26:22,983           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:22,984           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:22,985           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-01-10T03:26:22,985           to the `packages` configuration field.

2024-01-10T03:26:22,986           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:22,987           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:22,987           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:22,988           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:22,989           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:22,990           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-01-10T03:26:22,990           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-01-10T03:26:22,990           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:22,991           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:22,991           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:22,992           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:22,992           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:22,993           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:22,994                 even if it does not contain any `.py` files.
2024-01-10T03:26:22,994                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:22,994                 directory, all directories are treated like packages.
2024-01-10T03:26:22,995           ********************************************************************************

2024-01-10T03:26:22,995   !!
2024-01-10T03:26:22,996     check.warn(importable)
2024-01-10T03:26:22,996   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:22,997   !!

2024-01-10T03:26:22,997           ********************************************************************************
2024-01-10T03:26:22,998           ############################
2024-01-10T03:26:22,998           # Package would be ignored #
2024-01-10T03:26:22,999           ############################
2024-01-10T03:26:22,999           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-01-10T03:26:23,000           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,000           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,001           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-01-10T03:26:23,001           to the `packages` configuration field.

2024-01-10T03:26:23,003           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,003           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,004           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,005           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,005           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,006           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-01-10T03:26:23,007           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-01-10T03:26:23,007           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,008           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,008           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,009           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,010           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,011           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,012                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,013                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,013                 directory, all directories are treated like packages.
2024-01-10T03:26:23,014           ********************************************************************************

2024-01-10T03:26:23,014   !!
2024-01-10T03:26:23,015     check.warn(importable)
2024-01-10T03:26:23,015   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:23,015   !!

2024-01-10T03:26:23,016           ********************************************************************************
2024-01-10T03:26:23,016           ############################
2024-01-10T03:26:23,017           # Package would be ignored #
2024-01-10T03:26:23,017           ############################
2024-01-10T03:26:23,017           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-01-10T03:26:23,018           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,018           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,019           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-01-10T03:26:23,019           to the `packages` configuration field.

2024-01-10T03:26:23,020           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,020           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,021           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,022           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,023           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,024           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-01-10T03:26:23,024           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-01-10T03:26:23,025           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,025           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,026           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,027           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,027           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,029           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,029                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,030                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,030                 directory, all directories are treated like packages.
2024-01-10T03:26:23,031           ********************************************************************************

2024-01-10T03:26:23,032   !!
2024-01-10T03:26:23,032     check.warn(importable)
2024-01-10T03:26:23,033   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:23,033   !!

2024-01-10T03:26:23,034           ********************************************************************************
2024-01-10T03:26:23,035           ############################
2024-01-10T03:26:23,035           # Package would be ignored #
2024-01-10T03:26:23,036           ############################
2024-01-10T03:26:23,036           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-01-10T03:26:23,037           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,038           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,038           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-01-10T03:26:23,039           to the `packages` configuration field.

2024-01-10T03:26:23,039           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,040           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,040           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,041           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,041           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,042           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-01-10T03:26:23,042           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-01-10T03:26:23,043           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,043           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,043           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,044           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,045           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,046           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,047                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,047                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,048                 directory, all directories are treated like packages.
2024-01-10T03:26:23,049           ********************************************************************************

2024-01-10T03:26:23,050   !!
2024-01-10T03:26:23,050     check.warn(importable)
2024-01-10T03:26:23,051   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-01-10T03:26:23,051   !!

2024-01-10T03:26:23,052           ********************************************************************************
2024-01-10T03:26:23,053           ############################
2024-01-10T03:26:23,053           # Package would be ignored #
2024-01-10T03:26:23,054           ############################
2024-01-10T03:26:23,054           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-01-10T03:26:23,055           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,056           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,056           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-01-10T03:26:23,057           to the `packages` configuration field.

2024-01-10T03:26:23,057           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,058           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,058           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,059           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,060           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,061           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-01-10T03:26:23,062           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-01-10T03:26:23,063           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,063           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,063           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,064           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,065           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,066           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,066                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,066                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,067                 directory, all directories are treated like packages.
2024-01-10T03:26:23,067           ********************************************************************************

2024-01-10T03:26:23,068   !!
2024-01-10T03:26:23,068     check.warn(importable)
2024-01-10T03:26:23,069   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-01-10T03:26:23,069   !!

2024-01-10T03:26:23,070           ********************************************************************************
2024-01-10T03:26:23,070           ############################
2024-01-10T03:26:23,071           # Package would be ignored #
2024-01-10T03:26:23,071           ############################
2024-01-10T03:26:23,072           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-01-10T03:26:23,072           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,073           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,074           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-01-10T03:26:23,074           to the `packages` configuration field.

2024-01-10T03:26:23,076           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,076           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,076           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,078           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,079           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,080           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-01-10T03:26:23,080           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-01-10T03:26:23,081           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,081           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,082           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,083           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,083           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,085           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,085                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,086                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,086                 directory, all directories are treated like packages.
2024-01-10T03:26:23,087           ********************************************************************************

2024-01-10T03:26:23,088   !!
2024-01-10T03:26:23,089     check.warn(importable)
2024-01-10T03:26:23,089   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-10T03:26:23,089   !!

2024-01-10T03:26:23,090           ********************************************************************************
2024-01-10T03:26:23,091           ############################
2024-01-10T03:26:23,091           # Package would be ignored #
2024-01-10T03:26:23,091           ############################
2024-01-10T03:26:23,092           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-01-10T03:26:23,092           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,093           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,093           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-01-10T03:26:23,093           to the `packages` configuration field.

2024-01-10T03:26:23,094           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,094           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,095           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,095           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,096           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,097           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-01-10T03:26:23,098           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-01-10T03:26:23,098           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,099           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,099           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,100           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,101           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,103           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,104                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,104                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,105                 directory, all directories are treated like packages.
2024-01-10T03:26:23,105           ********************************************************************************

2024-01-10T03:26:23,106   !!
2024-01-10T03:26:23,107     check.warn(importable)
2024-01-10T03:26:23,107   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:23,108   !!

2024-01-10T03:26:23,109           ********************************************************************************
2024-01-10T03:26:23,109           ############################
2024-01-10T03:26:23,109           # Package would be ignored #
2024-01-10T03:26:23,110           ############################
2024-01-10T03:26:23,110           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:23,111           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,112           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,113           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-01-10T03:26:23,113           to the `packages` configuration field.

2024-01-10T03:26:23,114           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,115           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,115           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,116           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,116           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,117           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-01-10T03:26:23,117           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-01-10T03:26:23,118           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,118           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,119           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,120           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,121           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,122           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,122                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,123                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,124                 directory, all directories are treated like packages.
2024-01-10T03:26:23,124           ********************************************************************************

2024-01-10T03:26:23,125   !!
2024-01-10T03:26:23,126     check.warn(importable)
2024-01-10T03:26:23,126   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:23,127   !!

2024-01-10T03:26:23,128           ********************************************************************************
2024-01-10T03:26:23,129           ############################
2024-01-10T03:26:23,129           # Package would be ignored #
2024-01-10T03:26:23,130           ############################
2024-01-10T03:26:23,130           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:23,131           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,132           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,133           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-01-10T03:26:23,133           to the `packages` configuration field.

2024-01-10T03:26:23,134           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,135           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,135           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,136           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,137           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,138           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-01-10T03:26:23,139           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-01-10T03:26:23,139           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,140           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,140           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,142           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,142           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,144           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,144                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,145                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,145                 directory, all directories are treated like packages.
2024-01-10T03:26:23,145           ********************************************************************************

2024-01-10T03:26:23,146   !!
2024-01-10T03:26:23,147     check.warn(importable)
2024-01-10T03:26:23,147   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-01-10T03:26:23,148   !!

2024-01-10T03:26:23,148           ********************************************************************************
2024-01-10T03:26:23,149           ############################
2024-01-10T03:26:23,149           # Package would be ignored #
2024-01-10T03:26:23,150           ############################
2024-01-10T03:26:23,150           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-01-10T03:26:23,151           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,152           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,152           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-01-10T03:26:23,153           to the `packages` configuration field.

2024-01-10T03:26:23,154           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,154           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,155           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,156           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,157           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,158           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-01-10T03:26:23,159           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-01-10T03:26:23,160           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,160           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,160           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,161           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,163           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,164           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,165                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,165                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,166                 directory, all directories are treated like packages.
2024-01-10T03:26:23,167           ********************************************************************************

2024-01-10T03:26:23,168   !!
2024-01-10T03:26:23,168     check.warn(importable)
2024-01-10T03:26:23,169   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-01-10T03:26:23,170   !!

2024-01-10T03:26:23,171           ********************************************************************************
2024-01-10T03:26:23,171           ############################
2024-01-10T03:26:23,172           # Package would be ignored #
2024-01-10T03:26:23,172           ############################
2024-01-10T03:26:23,172           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-01-10T03:26:23,173           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,174           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,174           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-01-10T03:26:23,175           to the `packages` configuration field.

2024-01-10T03:26:23,175           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,176           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,176           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,177           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,178           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,179           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-01-10T03:26:23,179           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-01-10T03:26:23,180           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,180           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,181           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,182           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,183           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,184           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,185                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,185                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,186                 directory, all directories are treated like packages.
2024-01-10T03:26:23,186           ********************************************************************************

2024-01-10T03:26:23,187   !!
2024-01-10T03:26:23,188     check.warn(importable)
2024-01-10T03:26:23,188   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-01-10T03:26:23,189   !!

2024-01-10T03:26:23,190           ********************************************************************************
2024-01-10T03:26:23,190           ############################
2024-01-10T03:26:23,191           # Package would be ignored #
2024-01-10T03:26:23,191           ############################
2024-01-10T03:26:23,192           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-01-10T03:26:23,193           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,194           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,195           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-01-10T03:26:23,195           to the `packages` configuration field.

2024-01-10T03:26:23,197           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,197           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,198           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,201           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,202           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,203           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-01-10T03:26:23,204           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-01-10T03:26:23,204           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,205           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,206           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,209           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,210           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,212           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,212                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,213                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,214                 directory, all directories are treated like packages.
2024-01-10T03:26:23,214           ********************************************************************************

2024-01-10T03:26:23,215   !!
2024-01-10T03:26:23,216     check.warn(importable)
2024-01-10T03:26:23,217   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-01-10T03:26:23,218   !!

2024-01-10T03:26:23,219           ********************************************************************************
2024-01-10T03:26:23,220           ############################
2024-01-10T03:26:23,220           # Package would be ignored #
2024-01-10T03:26:23,221           ############################
2024-01-10T03:26:23,222           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-01-10T03:26:23,222           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,224           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,225           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-01-10T03:26:23,225           to the `packages` configuration field.

2024-01-10T03:26:23,227           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,228           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,229           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,230           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,232           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,233           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-01-10T03:26:23,234           already explicitly excluding 'alpaca_eval.models_configs' via
2024-01-10T03:26:23,235           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,235           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,236           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,237           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,239           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,241           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,242                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,243                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,244                 directory, all directories are treated like packages.
2024-01-10T03:26:23,245           ********************************************************************************

2024-01-10T03:26:23,246   !!
2024-01-10T03:26:23,247     check.warn(importable)
2024-01-10T03:26:23,248   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-10T03:26:23,249   !!

2024-01-10T03:26:23,250           ********************************************************************************
2024-01-10T03:26:23,251           ############################
2024-01-10T03:26:23,252           # Package would be ignored #
2024-01-10T03:26:23,253           ############################
2024-01-10T03:26:23,253           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-01-10T03:26:23,254           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,256           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,256           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-01-10T03:26:23,257           to the `packages` configuration field.

2024-01-10T03:26:23,258           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,259           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,259           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,261           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,263           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-01-10T03:26:23,264           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-01-10T03:26:23,265           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,265           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,266           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,267           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,268           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,270           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,271                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,271                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,272                 directory, all directories are treated like packages.
2024-01-10T03:26:23,273           ********************************************************************************

2024-01-10T03:26:23,274   !!
2024-01-10T03:26:23,275     check.warn(importable)
2024-01-10T03:26:23,276   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-10T03:26:23,277   !!

2024-01-10T03:26:23,278           ********************************************************************************
2024-01-10T03:26:23,279           ############################
2024-01-10T03:26:23,279           # Package would be ignored #
2024-01-10T03:26:23,280           ############################
2024-01-10T03:26:23,281           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-01-10T03:26:23,281           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,283           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,284           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-01-10T03:26:23,284           to the `packages` configuration field.

2024-01-10T03:26:23,285           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,286           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,287           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,288           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,289           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,290           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-01-10T03:26:23,291           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-01-10T03:26:23,291           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,292           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,292           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,293           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,294           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,295           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,296                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,296                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,297                 directory, all directories are treated like packages.
2024-01-10T03:26:23,297           ********************************************************************************

2024-01-10T03:26:23,298   !!
2024-01-10T03:26:23,299     check.warn(importable)
2024-01-10T03:26:23,299   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration.
2024-01-10T03:26:23,300   !!

2024-01-10T03:26:23,301           ********************************************************************************
2024-01-10T03:26:23,301           ############################
2024-01-10T03:26:23,302           # Package would be ignored #
2024-01-10T03:26:23,302           ############################
2024-01-10T03:26:23,303           Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1],
2024-01-10T03:26:23,304           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,305           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,305           package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added
2024-01-10T03:26:23,306           to the `packages` configuration field.

2024-01-10T03:26:23,307           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,307           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,308           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,309           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,310           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,311           If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are
2024-01-10T03:26:23,312           already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via
2024-01-10T03:26:23,312           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,313           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,314           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,315           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,316           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,317           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,318                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,318                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,318                 directory, all directories are treated like packages.
2024-01-10T03:26:23,319           ********************************************************************************

2024-01-10T03:26:23,320   !!
2024-01-10T03:26:23,320     check.warn(importable)
2024-01-10T03:26:23,321   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-01-10T03:26:23,321   !!

2024-01-10T03:26:23,322           ********************************************************************************
2024-01-10T03:26:23,322           ############################
2024-01-10T03:26:23,323           # Package would be ignored #
2024-01-10T03:26:23,323           ############################
2024-01-10T03:26:23,324           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-01-10T03:26:23,324           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,325           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,326           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-01-10T03:26:23,326           to the `packages` configuration field.

2024-01-10T03:26:23,327           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,328           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,328           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,329           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,330           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,331           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-01-10T03:26:23,332           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-01-10T03:26:23,332           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,333           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,333           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,334           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,335           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,337           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,337                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,338                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,338                 directory, all directories are treated like packages.
2024-01-10T03:26:23,339           ********************************************************************************

2024-01-10T03:26:23,340   !!
2024-01-10T03:26:23,340     check.warn(importable)
2024-01-10T03:26:23,341   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-01-10T03:26:23,342   !!

2024-01-10T03:26:23,343           ********************************************************************************
2024-01-10T03:26:23,343           ############################
2024-01-10T03:26:23,344           # Package would be ignored #
2024-01-10T03:26:23,345           ############################
2024-01-10T03:26:23,345           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-01-10T03:26:23,346           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,347           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,347           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-01-10T03:26:23,348           to the `packages` configuration field.

2024-01-10T03:26:23,349           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,349           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,350           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,351           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,352           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,352           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-01-10T03:26:23,353           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-01-10T03:26:23,353           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,354           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,354           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,356           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,357           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,358           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,359                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,359                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,360                 directory, all directories are treated like packages.
2024-01-10T03:26:23,360           ********************************************************************************

2024-01-10T03:26:23,361   !!
2024-01-10T03:26:23,362     check.warn(importable)
2024-01-10T03:26:23,362   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-10T03:26:23,363   !!

2024-01-10T03:26:23,364           ********************************************************************************
2024-01-10T03:26:23,364           ############################
2024-01-10T03:26:23,365           # Package would be ignored #
2024-01-10T03:26:23,365           ############################
2024-01-10T03:26:23,366           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-10T03:26:23,366           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,367           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,368           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-01-10T03:26:23,368           to the `packages` configuration field.

2024-01-10T03:26:23,369           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,370           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,370           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,371           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,373           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,374           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-10T03:26:23,374           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-01-10T03:26:23,375           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,375           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,376           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,377           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,377           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,379           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,379                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,380                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,380                 directory, all directories are treated like packages.
2024-01-10T03:26:23,381           ********************************************************************************

2024-01-10T03:26:23,382   !!
2024-01-10T03:26:23,382     check.warn(importable)
2024-01-10T03:26:23,383   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-01-10T03:26:23,383   !!

2024-01-10T03:26:23,384           ********************************************************************************
2024-01-10T03:26:23,385           ############################
2024-01-10T03:26:23,385           # Package would be ignored #
2024-01-10T03:26:23,386           ############################
2024-01-10T03:26:23,386           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-01-10T03:26:23,387           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,388           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,388           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-01-10T03:26:23,389           to the `packages` configuration field.

2024-01-10T03:26:23,390           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,390           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,391           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,392           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,393           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,394           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-01-10T03:26:23,395           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-01-10T03:26:23,395           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,396           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,397           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,398           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,399           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,400           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,401                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,401                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,402                 directory, all directories are treated like packages.
2024-01-10T03:26:23,403           ********************************************************************************

2024-01-10T03:26:23,403   !!
2024-01-10T03:26:23,404     check.warn(importable)
2024-01-10T03:26:23,404   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-01-10T03:26:23,405   !!

2024-01-10T03:26:23,406           ********************************************************************************
2024-01-10T03:26:23,406           ############################
2024-01-10T03:26:23,407           # Package would be ignored #
2024-01-10T03:26:23,407           ############################
2024-01-10T03:26:23,407           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-01-10T03:26:23,408           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,409           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,409           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-01-10T03:26:23,410           to the `packages` configuration field.

2024-01-10T03:26:23,411           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,411           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,411           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,413           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,413           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,415           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-01-10T03:26:23,415           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-01-10T03:26:23,416           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,416           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,417           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,418           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,419           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,420           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,421                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,421                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,422                 directory, all directories are treated like packages.
2024-01-10T03:26:23,422           ********************************************************************************

2024-01-10T03:26:23,423   !!
2024-01-10T03:26:23,424     check.warn(importable)
2024-01-10T03:26:23,425   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-01-10T03:26:23,425   !!

2024-01-10T03:26:23,426           ********************************************************************************
2024-01-10T03:26:23,427           ############################
2024-01-10T03:26:23,427           # Package would be ignored #
2024-01-10T03:26:23,428           ############################
2024-01-10T03:26:23,429           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-01-10T03:26:23,429           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,430           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,431           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-01-10T03:26:23,432           to the `packages` configuration field.

2024-01-10T03:26:23,433           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,433           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,433           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,434           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,436           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-01-10T03:26:23,437           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-01-10T03:26:23,437           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,438           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,438           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,439           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,440           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,441           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,442                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,442                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,443                 directory, all directories are treated like packages.
2024-01-10T03:26:23,443           ********************************************************************************

2024-01-10T03:26:23,444   !!
2024-01-10T03:26:23,445     check.warn(importable)
2024-01-10T03:26:23,445   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T03:26:23,446   !!

2024-01-10T03:26:23,447           ********************************************************************************
2024-01-10T03:26:23,447           ############################
2024-01-10T03:26:23,448           # Package would be ignored #
2024-01-10T03:26:23,448           ############################
2024-01-10T03:26:23,449           Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1],
2024-01-10T03:26:23,449           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,450           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,451           package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added
2024-01-10T03:26:23,452           to the `packages` configuration field.

2024-01-10T03:26:23,453           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,454           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,455           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,456           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,457           If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are
2024-01-10T03:26:23,458           already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via
2024-01-10T03:26:23,458           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,459           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,459           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,460           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,461           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,463           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,463                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,464                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,464                 directory, all directories are treated like packages.
2024-01-10T03:26:23,464           ********************************************************************************

2024-01-10T03:26:23,465   !!
2024-01-10T03:26:23,466     check.warn(importable)
2024-01-10T03:26:23,466   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-01-10T03:26:23,467   !!

2024-01-10T03:26:23,468           ********************************************************************************
2024-01-10T03:26:23,468           ############################
2024-01-10T03:26:23,469           # Package would be ignored #
2024-01-10T03:26:23,469           ############################
2024-01-10T03:26:23,470           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-01-10T03:26:23,470           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,471           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,472           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-01-10T03:26:23,472           to the `packages` configuration field.

2024-01-10T03:26:23,473           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,474           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,474           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,475           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,476           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,477           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-01-10T03:26:23,478           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-01-10T03:26:23,478           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,479           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,479           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,480           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,481           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,483           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,484                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,484                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,485                 directory, all directories are treated like packages.
2024-01-10T03:26:23,485           ********************************************************************************

2024-01-10T03:26:23,486   !!
2024-01-10T03:26:23,487     check.warn(importable)
2024-01-10T03:26:23,487   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-10T03:26:23,488   !!

2024-01-10T03:26:23,489           ********************************************************************************
2024-01-10T03:26:23,490           ############################
2024-01-10T03:26:23,490           # Package would be ignored #
2024-01-10T03:26:23,491           ############################
2024-01-10T03:26:23,491           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-01-10T03:26:23,491           but it is absent from setuptools' `packages` configuration.

2024-01-10T03:26:23,492           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T03:26:23,493           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-01-10T03:26:23,493           to the `packages` configuration field.

2024-01-10T03:26:23,494           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T03:26:23,495           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T03:26:23,495           instead of `find_packages(...)`/`find:`).

2024-01-10T03:26:23,496           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T03:26:23,497           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T03:26:23,498           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-01-10T03:26:23,498           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-01-10T03:26:23,499           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T03:26:23,499           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T03:26:23,500           combination with a more fine grained `package-data` configuration.

2024-01-10T03:26:23,501           You can read more about "package data files" on setuptools documentation page:

2024-01-10T03:26:23,502           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T03:26:23,503           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T03:26:23,504                 even if it does not contain any `.py` files.
2024-01-10T03:26:23,504                 On the other hand, currently there is no concept of package data
2024-01-10T03:26:23,505                 directory, all directories are treated like packages.
2024-01-10T03:26:23,505           ********************************************************************************

2024-01-10T03:26:23,506   !!
2024-01-10T03:26:23,507     check.warn(importable)
2024-01-10T03:26:23,507   creating build/lib/alpaca_eval/evaluators_configs
2024-01-10T03:26:23,508   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-01-10T03:26:23,508   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:23,509   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:23,509   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:23,510   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:23,510   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:23,511   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:23,511   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:23,512   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:23,512   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:23,513   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:23,514   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:23,514   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:23,515   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T03:26:23,515   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T03:26:23,516   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T03:26:23,516   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T03:26:23,516   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:23,517   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:23,517   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:23,518   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:23,518   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:23,519   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:23,519   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,520   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,520   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,521   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,521   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,522   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,522   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,523   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,523   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,524   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,524   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,525   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,525   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,526   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:23,527   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:23,527   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:23,528   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:23,528   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:23,528   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:23,529   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:23,529   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T03:26:23,530   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T03:26:23,530   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T03:26:23,531   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T03:26:23,531   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:23,532   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:23,532   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:23,533   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:23,533   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:23,534   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:23,534   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:23,535   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:23,535   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:23,536   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-10T03:26:23,536   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-10T03:26:23,537   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:23,537   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:23,538   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:23,538   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-10T03:26:23,539   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-10T03:26:23,539   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T03:26:23,540   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T03:26:23,541   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-10T03:26:23,541   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-10T03:26:23,542   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T03:26:23,543   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T03:26:23,543   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:23,543   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:23,544   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:23,544   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:23,545   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:23,545   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:23,546   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T03:26:23,546   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T03:26:23,547   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T03:26:23,547   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T03:26:23,548   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:23,548   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:23,549   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:23,549   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T03:26:23,550   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T03:26:23,550   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T03:26:23,551   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T03:26:23,551   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:23,552   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:23,552   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:23,553   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:23,553   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:23,554   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:23,554   creating build/lib/alpaca_eval/evaluators_configs/test
2024-01-10T03:26:23,555   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-01-10T03:26:23,555   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:23,556   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:23,557   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:23,557   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T03:26:23,558   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T03:26:23,558   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T03:26:23,559   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T03:26:23,559   creating build/lib/alpaca_eval/leaderboards
2024-01-10T03:26:23,560   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,560   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,561   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,561   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,562   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,562   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,563   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,563   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,564   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,564   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-01-10T03:26:23,565   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-01-10T03:26:23,565   creating build/lib/alpaca_eval/models_configs
2024-01-10T03:26:23,566   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:23,566   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:23,567   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:23,567   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T03:26:23,568   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T03:26:23,568   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:23,569   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:23,569   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:23,570   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:23,571   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:23,571   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:23,572   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:23,572   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:23,573   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:23,573   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:23,574   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:23,574   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:23,575   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-10T03:26:23,575   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-10T03:26:23,576   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:23,576   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:23,577   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:23,577   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:23,578   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:23,578   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:23,579   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T03:26:23,579   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T03:26:23,580   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T03:26:23,580   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T03:26:23,581   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:23,581   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:23,582   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:23,582   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:23,583   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:23,583   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:23,584   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T03:26:23,584   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T03:26:23,585   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-10T03:26:23,585   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-10T03:26:23,586   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T03:26:23,586   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T03:26:23,587   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:23,588   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:23,588   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:23,589   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:23,589   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:23,590   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:23,590   creating build/lib/alpaca_eval/models_configs/chatgpt
2024-01-10T03:26:23,591   copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt
2024-01-10T03:26:23,592   creating build/lib/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,592   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,593   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,593   creating build/lib/alpaca_eval/models_configs/claude-2
2024-01-10T03:26:23,593   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-01-10T03:26:23,594   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-10T03:26:23,594   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-10T03:26:23,595   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T03:26:23,595   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T03:26:23,596   creating build/lib/alpaca_eval/models_configs/cohere
2024-01-10T03:26:23,596   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-01-10T03:26:23,597   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-01-10T03:26:23,597   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:23,598   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:23,598   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:23,599   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T03:26:23,599   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T03:26:23,600   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-01-10T03:26:23,600   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-01-10T03:26:23,601   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T03:26:23,601   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T03:26:23,602   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T03:26:23,602   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T03:26:23,603   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T03:26:23,603   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T03:26:23,604   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:23,604   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:23,605   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:23,606   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T03:26:23,606   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T03:26:23,607   creating build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:23,607   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:23,608   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:23,608   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-10T03:26:23,609   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-10T03:26:23,610   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T03:26:23,610   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T03:26:23,611   creating build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:23,611   copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:23,612   copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:23,612   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-10T03:26:23,612   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-10T03:26:23,613   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-10T03:26:23,613   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-10T03:26:23,614   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T03:26:23,614   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T03:26:23,615   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-10T03:26:23,615   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-10T03:26:23,616   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:23,616   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:23,617   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:23,617   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:23,618   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:23,618   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:23,619   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T03:26:23,619   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T03:26:23,620   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:23,620   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:23,621   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:23,621   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T03:26:23,622   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T03:26:23,622   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:23,623   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:23,623   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:23,624   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:23,624   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:23,625   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:23,626   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:23,626   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:23,627   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:23,627   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T03:26:23,628   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T03:26:23,628   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:23,629   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:23,629   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:23,630   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,630   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,630   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,631   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:23,631   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:23,632   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:23,632   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T03:26:23,633   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T03:26:23,633   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:23,634   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:23,634   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:23,635   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:23,636   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:23,637   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:23,639   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:23,639   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:23,642   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:23,644   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:23,645   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:23,647   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:23,649   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:23,650   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:23,653   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:23,655   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:23,656   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:23,658   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:23,660   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:23,660   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:23,662   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:23,664   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:23,665   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:23,667   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:23,669   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:23,670   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:23,672   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:23,674   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T03:26:23,674   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T03:26:23,677   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T03:26:23,677   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T03:26:23,680   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T03:26:23,680   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T03:26:23,683   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T03:26:23,683   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T03:26:23,686   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T03:26:23,687   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T03:26:23,689   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T03:26:23,690   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T03:26:23,692   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:23,693   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:23,695   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:23,697   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T03:26:23,698   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T03:26:23,700   creating build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:23,701   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:23,703   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:23,705   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:23,706   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:23,708   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:23,709   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:23,710   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:23,712   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:23,714   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:23,715   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:23,717   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:23,718   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T03:26:23,719   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T03:26:23,721   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T03:26:23,722   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T03:26:23,724   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T03:26:23,725   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T03:26:23,727   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-10T03:26:23,728   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-10T03:26:23,730   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:23,731   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:23,733   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:23,735   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T03:26:23,736   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T03:26:23,738   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:23,739   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:23,741   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:23,743   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T03:26:23,744   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T03:26:23,746   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:23,747   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:23,749   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:23,751   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:23,752   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:23,754   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:23,756   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:23,757   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:23,759   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:23,761   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:23,762   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:23,764   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:23,766   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-10T03:26:23,766   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-10T03:26:23,768   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T03:26:23,769   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T03:26:23,771   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T03:26:23,772   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T03:26:23,774   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:23,775   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:23,777   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:23,779   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T03:26:23,779   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T03:26:23,781   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:23,782   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:23,785   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:23,787   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T03:26:23,787   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T03:26:23,789   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T03:26:23,790   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T03:26:23,793   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T03:26:23,794   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T03:26:23,796   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T03:26:23,796   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T03:26:23,799   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:23,799   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:23,801   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:23,804   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:23,805   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:23,807   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:23,808   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T03:26:23,809   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T03:26:23,836   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-01-10T03:26:23,837   !!

2024-01-10T03:26:23,838           ********************************************************************************
2024-01-10T03:26:23,838           Please avoid running ``setup.py`` directly.
2024-01-10T03:26:23,839           Instead, use pypa/build, pypa/installer or other
2024-01-10T03:26:23,839           standards-based tools.

2024-01-10T03:26:23,840           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-01-10T03:26:23,841           ********************************************************************************

2024-01-10T03:26:23,842   !!
2024-01-10T03:26:23,842     self.initialize_options()
2024-01-10T03:26:23,860   installing to build/bdist.linux-armv7l/wheel
2024-01-10T03:26:23,861   running install
2024-01-10T03:26:23,884   running install_lib
2024-01-10T03:26:23,908   creating build/bdist.linux-armv7l
2024-01-10T03:26:23,908   creating build/bdist.linux-armv7l/wheel
2024-01-10T03:26:23,910   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,912   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-01-10T03:26:23,913   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,914   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,916   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,918   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T03:26:23,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-10T03:26:23,921   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-10T03:26:23,924   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,925   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,927   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,929   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,931   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T03:26:23,933   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,935   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,938   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,939   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,941   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,943   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,945   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,947   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,949   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,950   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,952   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,954   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,956   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,959   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T03:26:23,961   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,964   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T03:26:23,965   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T03:26:23,968   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T03:26:23,969   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T03:26:23,972   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,973   copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:23,977   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-01-10T03:26:23,979   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,980   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,982   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T03:26:23,984   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-10T03:26:23,985   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-10T03:26:23,987   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T03:26:23,988   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T03:26:23,990   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,991   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,993   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T03:26:23,996   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:23,997   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:23,999   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T03:26:24,001   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:24,002   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:24,004   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T03:26:24,006   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T03:26:24,007   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T03:26:24,009   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T03:26:24,009   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T03:26:24,012   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:24,012   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:24,014   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T03:26:24,017   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T03:26:24,017   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T03:26:24,020   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T03:26:24,020   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T03:26:24,023   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T03:26:24,024   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T03:26:24,026   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T03:26:24,027   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T03:26:24,029   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:24,030   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:24,032   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T03:26:24,034   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2024-01-10T03:26:24,035   copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2024-01-10T03:26:24,037   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T03:26:24,038   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T03:26:24,040   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:24,041   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:24,043   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T03:26:24,045   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:24,046   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:24,048   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T03:26:24,050   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:24,051   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:24,053   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T03:26:24,055   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:24,056   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:24,057   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T03:26:24,059   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T03:26:24,060   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T03:26:24,062   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T03:26:24,063   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T03:26:24,066   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:24,068   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:24,070   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T03:26:24,072   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:24,073   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:24,075   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T03:26:24,077   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T03:26:24,078   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T03:26:24,080   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T03:26:24,081   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T03:26:24,083   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T03:26:24,084   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T03:26:24,086   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:24,087   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:24,089   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T03:26:24,092   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T03:26:24,093   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T03:26:24,095   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:24,096   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:24,098   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T03:26:24,100   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:24,101   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:24,103   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T03:26:24,104   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T03:26:24,105   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T03:26:24,108   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:24,108   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:24,110   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T03:26:24,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T03:26:24,113   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T03:26:24,115   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T03:26:24,116   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T03:26:24,119   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:24,120   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:24,122   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T03:26:24,124   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T03:26:24,125   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T03:26:24,127   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:24,128   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:24,130   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T03:26:24,132   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-10T03:26:24,133   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-10T03:26:24,135   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-10T03:26:24,136   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-10T03:26:24,138   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:24,139   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:24,141   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T03:26:24,143   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T03:26:24,144   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T03:26:24,146   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T03:26:24,147   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T03:26:24,149   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T03:26:24,149   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T03:26:24,152   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:24,152   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:24,154   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T03:26:24,156   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T03:26:24,157   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T03:26:24,159   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:24,160   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:24,162   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T03:26:24,164   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T03:26:24,165   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T03:26:24,167   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T03:26:24,169   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T03:26:24,170   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T03:26:24,172   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T03:26:24,173   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T03:26:24,176   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T03:26:24,177   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T03:26:24,179   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-10T03:26:24,180   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-10T03:26:24,182   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T03:26:24,182   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T03:26:24,184   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:24,185   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:24,187   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T03:26:24,189   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:24,190   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:24,192   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T03:26:24,195   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:24,196   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:24,198   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T03:26:24,200   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T03:26:24,201   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T03:26:24,203   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T03:26:24,204   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T03:26:24,206   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:24,207   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:24,209   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T03:26:24,211   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-10T03:26:24,212   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-10T03:26:24,214   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-10T03:26:24,215   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-10T03:26:24,218   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T03:26:24,218   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T03:26:24,221   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T03:26:24,221   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T03:26:24,224   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:24,224   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:24,226   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T03:26:24,228   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:24,229   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:24,230   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T03:26:24,232   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:24,233   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:24,235   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T03:26:24,237   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-10T03:26:24,238   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-10T03:26:24,240   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:24,241   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:24,243   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T03:26:24,245   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-10T03:26:24,246   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-10T03:26:24,248   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T03:26:24,249   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T03:26:24,251   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:24,252   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:24,254   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T03:26:24,256   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:24,257   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:24,259   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T03:26:24,261   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:24,262   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:24,264   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T03:26:24,266   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-10T03:26:24,266   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-10T03:26:24,268   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T03:26:24,269   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T03:26:24,271   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:24,272   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:24,274   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T03:26:24,276   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:24,277   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:24,279   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T03:26:24,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:24,281   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:24,283   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T03:26:24,285   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:24,286   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:24,288   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T03:26:24,291   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T03:26:24,292   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T03:26:24,295   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:24,296   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:24,298   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T03:26:24,300   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T03:26:24,301   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T03:26:24,303   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T03:26:24,304   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T03:26:24,307   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:24,308   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:24,309   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T03:26:24,311   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:24,312   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:24,314   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T03:26:24,316   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:24,317   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:24,319   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T03:26:24,321   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T03:26:24,321   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T03:26:24,324   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:24,325   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:24,327   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T03:26:24,328   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:24,329   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:24,331   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T03:26:24,333   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:24,334   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:24,336   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T03:26:24,339   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:24,340   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:24,342   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T03:26:24,344   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T03:26:24,345   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T03:26:24,347   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-10T03:26:24,348   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-10T03:26:24,351   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:24,352   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:24,353   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T03:26:24,356   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:24,356   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:24,358   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T03:26:24,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:24,361   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:24,363   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T03:26:24,365   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-10T03:26:24,366   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-10T03:26:24,368   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:24,368   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:24,370   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T03:26:24,372   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:24,373   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:24,375   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T03:26:24,377   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:24,379   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:24,382   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:24,387   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-10T03:26:24,388   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:24,389   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:24,391   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T03:26:24,393   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-10T03:26:24,394   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-10T03:26:24,396   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,397   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,400   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,403   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,405   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,407   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,409   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,411   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,413   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,415   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,417   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,419   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,420   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,422   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T03:26:24,424   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T03:26:24,425   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T03:26:24,427   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:24,428   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:24,430   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T03:26:24,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:24,433   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:24,435   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T03:26:24,437   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T03:26:24,438   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T03:26:24,441   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T03:26:24,442   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T03:26:24,444   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:24,445   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:24,447   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T03:26:24,448   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:24,449   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:24,451   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T03:26:24,453   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:24,454   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:24,456   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T03:26:24,458   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T03:26:24,459   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T03:26:24,461   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:24,462   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:24,464   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T03:26:24,466   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-10T03:26:24,467   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-10T03:26:24,469   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:24,470   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:24,472   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T03:26:24,474   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-10T03:26:24,475   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-10T03:26:24,477   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-10T03:26:24,481   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-10T03:26:24,482   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-10T03:26:24,484   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:24,485   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:24,487   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T03:26:24,489   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T03:26:24,489   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T03:26:24,492   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T03:26:24,492   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T03:26:24,495   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:24,496   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:24,498   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T03:26:24,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T03:26:24,500   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T03:26:24,503   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T03:26:24,504   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T03:26:24,506   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:24,507   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:24,509   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T03:26:24,511   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:24,512   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:24,513   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T03:26:24,515   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:24,516   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:24,518   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T03:26:24,521   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:24,522   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:24,523   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T03:26:24,526   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:24,527   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:24,528   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T03:26:24,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T03:26:24,531   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T03:26:24,533   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:24,534   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:24,536   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T03:26:24,538   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T03:26:24,539   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T03:26:24,541   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:24,542   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:24,544   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T03:26:24,546   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T03:26:24,546   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T03:26:24,549   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:24,550   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:24,552   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T03:26:24,554   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T03:26:24,555   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T03:26:24,556   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:24,559   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T03:26:24,562   running install_egg_info
2024-01-10T03:26:24,591   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.0-py3.11.egg-info
2024-01-10T03:26:24,603   running install_scripts
2024-01-10T03:26:24,639   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.0.dist-info/WHEEL
2024-01-10T03:26:24,642   creating '/tmp/pip-wheel-37qyxf11/alpaca_eval-0.5.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-01-10T03:26:24,644   adding 'alpaca_eval/__init__.py'
2024-01-10T03:26:24,647   adding 'alpaca_eval/analyze.py'
2024-01-10T03:26:24,650   adding 'alpaca_eval/completion_parsers.py'
2024-01-10T03:26:24,651   adding 'alpaca_eval/constants.py'
2024-01-10T03:26:24,654   adding 'alpaca_eval/main.py'
2024-01-10T03:26:24,656   adding 'alpaca_eval/metrics.py'
2024-01-10T03:26:24,659   adding 'alpaca_eval/plotting.py'
2024-01-10T03:26:24,661   adding 'alpaca_eval/processors.py'
2024-01-10T03:26:24,662   adding 'alpaca_eval/types.py'
2024-01-10T03:26:24,665   adding 'alpaca_eval/utils.py'
2024-01-10T03:26:24,667   adding 'alpaca_eval/annotators/__init__.py'
2024-01-10T03:26:24,671   adding 'alpaca_eval/annotators/base.py'
2024-01-10T03:26:24,673   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-01-10T03:26:24,675   adding 'alpaca_eval/decoders/__init__.py'
2024-01-10T03:26:24,677   adding 'alpaca_eval/decoders/anthropic.py'
2024-01-10T03:26:24,678   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-01-10T03:26:24,679   adding 'alpaca_eval/decoders/cohere.py'
2024-01-10T03:26:24,681   adding 'alpaca_eval/decoders/google.py'
2024-01-10T03:26:24,682   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-01-10T03:26:24,684   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-01-10T03:26:24,685   adding 'alpaca_eval/decoders/jinachat.py'
2024-01-10T03:26:24,688   adding 'alpaca_eval/decoders/openai.py'
2024-01-10T03:26:24,689   adding 'alpaca_eval/decoders/replicate.py'
2024-01-10T03:26:24,690   adding 'alpaca_eval/decoders/vllm_local.py'
2024-01-10T03:26:24,693   adding 'alpaca_eval/evaluators_configs/README.md'
2024-01-10T03:26:24,695   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-01-10T03:26:24,696   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,698   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-01-10T03:26:24,699   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,701   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-10T03:26:24,703   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-01-10T03:26:24,705   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-01-10T03:26:24,707   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-01-10T03:26:24,709   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-01-10T03:26:24,711   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-01-10T03:26:24,713   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-01-10T03:26:24,714   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-01-10T03:26:24,716   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-10T03:26:24,718   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-01-10T03:26:24,720   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-01-10T03:26:24,722   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-01-10T03:26:24,724   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-01-10T03:26:24,726   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-01-10T03:26:24,728   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-01-10T03:26:24,730   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-01-10T03:26:24,732   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-01-10T03:26:24,734   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-01-10T03:26:24,736   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-01-10T03:26:24,738   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-01-10T03:26:24,739   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-01-10T03:26:24,741   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-01-10T03:26:24,743   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-01-10T03:26:24,746   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-01-10T03:26:24,747   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-01-10T03:26:24,749   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-01-10T03:26:24,751   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-01-10T03:26:24,753   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-01-10T03:26:24,755   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-01-10T03:26:24,757   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-01-10T03:26:24,758   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-01-10T03:26:24,760   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-01-10T03:26:24,762   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-01-10T03:26:24,764   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-01-10T03:26:24,765   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-01-10T03:26:24,767   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-01-10T03:26:24,769   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-01-10T03:26:24,770   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-01-10T03:26:24,772   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-01-10T03:26:24,775   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-10T03:26:24,777   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-01-10T03:26:24,779   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,781   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-01-10T03:26:24,782   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-01-10T03:26:24,784   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-01-10T03:26:24,786   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-01-10T03:26:24,788   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-01-10T03:26:24,790   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-01-10T03:26:24,792   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-01-10T03:26:24,793   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-01-10T03:26:24,795   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-01-10T03:26:24,797   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-01-10T03:26:24,800   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-01-10T03:26:24,801   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-01-10T03:26:24,803   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-01-10T03:26:24,804   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-01-10T03:26:24,806   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-01-10T03:26:24,808   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-01-10T03:26:24,809   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-01-10T03:26:24,811   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,812   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,815   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-01-10T03:26:24,816   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-01-10T03:26:24,818   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-01-10T03:26:24,819   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-01-10T03:26:24,820   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-01-10T03:26:24,821   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-01-10T03:26:24,822   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-01-10T03:26:24,824   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-01-10T03:26:24,828   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-01-10T03:26:24,829   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-01-10T03:26:24,831   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-01-10T03:26:24,833   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-01-10T03:26:24,833   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-01-10T03:26:24,835   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-01-10T03:26:24,836   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-01-10T03:26:24,838   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-01-10T03:26:24,839   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-01-10T03:26:24,840   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-01-10T03:26:24,841   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-01-10T03:26:24,843   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-01-10T03:26:24,844   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-01-10T03:26:24,846   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-01-10T03:26:24,847   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-01-10T03:26:24,848   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-01-10T03:26:24,850   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-01-10T03:26:24,852   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-01-10T03:26:24,853   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-01-10T03:26:24,855   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-01-10T03:26:24,856   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-01-10T03:26:24,857   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-01-10T03:26:24,859   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-01-10T03:26:24,861   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-01-10T03:26:24,862   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-01-10T03:26:24,864   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-01-10T03:26:24,865   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-01-10T03:26:24,867   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-01-10T03:26:24,868   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-01-10T03:26:24,870   adding 'alpaca_eval/models_configs/chatgpt/configs.yaml'
2024-01-10T03:26:24,871   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-01-10T03:26:24,872   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-01-10T03:26:24,874   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-01-10T03:26:24,876   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-01-10T03:26:24,877   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-01-10T03:26:24,879   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-01-10T03:26:24,880   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-01-10T03:26:24,882   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-01-10T03:26:24,883   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-01-10T03:26:24,884   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-01-10T03:26:24,886   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-01-10T03:26:24,887   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-01-10T03:26:24,889   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-01-10T03:26:24,890   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-01-10T03:26:24,892   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-01-10T03:26:24,893   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-01-10T03:26:24,894   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-10T03:26:24,896   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-01-10T03:26:24,897   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-01-10T03:26:24,898   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-01-10T03:26:24,900   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-01-10T03:26:24,901   adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt'
2024-01-10T03:26:24,902   adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml'
2024-01-10T03:26:24,904   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-01-10T03:26:24,905   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-01-10T03:26:24,907   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-01-10T03:26:24,908   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-01-10T03:26:24,910   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-01-10T03:26:24,911   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-01-10T03:26:24,913   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-01-10T03:26:24,914   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-01-10T03:26:24,915   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-01-10T03:26:24,917   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-01-10T03:26:24,918   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-01-10T03:26:24,920   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-01-10T03:26:24,921   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-01-10T03:26:24,922   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-01-10T03:26:24,924   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-01-10T03:26:24,925   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-01-10T03:26:24,927   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-01-10T03:26:24,928   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-01-10T03:26:24,930   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-01-10T03:26:24,931   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-01-10T03:26:24,933   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-01-10T03:26:24,934   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-01-10T03:26:24,936   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-01-10T03:26:24,937   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-01-10T03:26:24,938   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-01-10T03:26:24,940   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-01-10T03:26:24,942   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-01-10T03:26:24,943   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-01-10T03:26:24,945   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-01-10T03:26:24,946   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-01-10T03:26:24,947   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-01-10T03:26:24,949   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-01-10T03:26:24,950   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-01-10T03:26:24,951   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-01-10T03:26:24,953   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-01-10T03:26:24,954   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-01-10T03:26:24,956   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-01-10T03:26:24,957   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-01-10T03:26:24,959   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-01-10T03:26:24,960   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-01-10T03:26:24,961   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-01-10T03:26:24,962   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-01-10T03:26:24,964   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-01-10T03:26:24,965   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-01-10T03:26:24,966   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-01-10T03:26:24,968   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-01-10T03:26:24,969   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-01-10T03:26:24,971   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-01-10T03:26:24,972   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-01-10T03:26:24,974   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-01-10T03:26:24,975   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-01-10T03:26:24,976   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-01-10T03:26:24,978   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-01-10T03:26:24,980   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-01-10T03:26:24,981   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-01-10T03:26:24,982   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-01-10T03:26:24,983   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-01-10T03:26:24,985   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-01-10T03:26:24,986   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-01-10T03:26:24,988   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-01-10T03:26:24,989   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-01-10T03:26:24,991   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-01-10T03:26:24,992   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-01-10T03:26:24,994   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-01-10T03:26:24,996   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-01-10T03:26:24,997   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-01-10T03:26:24,998   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-01-10T03:26:25,000   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-01-10T03:26:25,002   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-01-10T03:26:25,003   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-01-10T03:26:25,004   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-01-10T03:26:25,006   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-01-10T03:26:25,007   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-01-10T03:26:25,009   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-01-10T03:26:25,010   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-01-10T03:26:25,012   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-01-10T03:26:25,013   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-01-10T03:26:25,014   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-01-10T03:26:25,015   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-01-10T03:26:25,017   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-01-10T03:26:25,019   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-01-10T03:26:25,020   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-01-10T03:26:25,022   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-01-10T03:26:25,023   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-01-10T03:26:25,024   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-01-10T03:26:25,026   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-01-10T03:26:25,027   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-01-10T03:26:25,028   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-01-10T03:26:25,030   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-01-10T03:26:25,031   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-01-10T03:26:25,033   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-01-10T03:26:25,034   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-01-10T03:26:25,036   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-01-10T03:26:25,037   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-01-10T03:26:25,038   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-01-10T03:26:25,040   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-01-10T03:26:25,042   adding 'alpaca_eval-0.5.0.dist-info/LICENSE'
2024-01-10T03:26:25,053   adding 'alpaca_eval-0.5.0.dist-info/METADATA'
2024-01-10T03:26:25,055   adding 'alpaca_eval-0.5.0.dist-info/WHEEL'
2024-01-10T03:26:25,056   adding 'alpaca_eval-0.5.0.dist-info/entry_points.txt'
2024-01-10T03:26:25,057   adding 'alpaca_eval-0.5.0.dist-info/top_level.txt'
2024-01-10T03:26:25,061   adding 'alpaca_eval-0.5.0.dist-info/RECORD'
2024-01-10T03:26:25,116   removing build/bdist.linux-armv7l/wheel
2024-01-10T03:26:25,323   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-01-10T03:26:25,328   Created wheel for alpaca-eval: filename=alpaca_eval-0.5.0-py3-none-any.whl size=230111 sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396
2024-01-10T03:26:25,329   Stored in directory: /tmp/pip-ephem-wheel-cache-gbogi9n6/wheels/28/bb/8c/8c1685fc6bb666f02cb25e44c4c26be36a21f34212f32af7dc
2024-01-10T03:26:25,358 Successfully built alpaca-eval
2024-01-10T03:26:25,368 Removed build tracker: '/tmp/pip-build-tracker-ugn_ur2i'