2024-04-13T06:23:59,652 Created temporary directory: /tmp/pip-build-tracker-0aus4zgi
2024-04-13T06:23:59,653 Initialized build tracking at /tmp/pip-build-tracker-0aus4zgi
2024-04-13T06:23:59,654 Created build tracker: /tmp/pip-build-tracker-0aus4zgi
2024-04-13T06:23:59,655 Entered build tracker: /tmp/pip-build-tracker-0aus4zgi
2024-04-13T06:23:59,655 Created temporary directory: /tmp/pip-wheel-g5fx_oxn
2024-04-13T06:23:59,659 Created temporary directory: /tmp/pip-ephem-wheel-cache-d3834ebw
2024-04-13T06:23:59,681 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-04-13T06:23:59,684 2 location(s) to search for versions of alpaca-eval:
2024-04-13T06:23:59,684 * https://pypi.org/simple/alpaca-eval/
2024-04-13T06:23:59,684 * https://www.piwheels.org/simple/alpaca-eval/
2024-04-13T06:23:59,685 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-04-13T06:23:59,686 Getting page https://pypi.org/simple/alpaca-eval/
2024-04-13T06:23:59,687 Found index url https://pypi.org/simple/
2024-04-13T06:23:59,904 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-04-13T06:23:59,916   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:23:59,918   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-04-13T06:23:59,918   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:23:59,919   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-04-13T06:23:59,920   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:23:59,921   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-04-13T06:23:59,922   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,923   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-04-13T06:23:59,924   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,925   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-04-13T06:23:59,925   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,926   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-04-13T06:23:59,927   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,928   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-04-13T06:23:59,929   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,930   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-04-13T06:23:59,930   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,931   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-04-13T06:23:59,932   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,933   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-04-13T06:23:59,934   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,935   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-04-13T06:23:59,936   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,937   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-04-13T06:23:59,938   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,939   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-04-13T06:23:59,939   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,941   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-04-13T06:23:59,941   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,942   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-04-13T06:23:59,943   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,944   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-04-13T06:23:59,944   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,945   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-04-13T06:23:59,946   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,947   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-04-13T06:23:59,947   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,948   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-04-13T06:23:59,949   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,950   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-04-13T06:23:59,951   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,952   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-04-13T06:23:59,953   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,954   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-04-13T06:23:59,955   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,955   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-04-13T06:23:59,956   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,957   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-04-13T06:23:59,957   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,958   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-04-13T06:23:59,959   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,960   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-04-13T06:23:59,961   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,962   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-04-13T06:23:59,962   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,963   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-04-13T06:23:59,964   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,965   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-04-13T06:23:59,966   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,967   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-04-13T06:23:59,967   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,968   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-04-13T06:23:59,969   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:23:59,970   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-04-13T06:23:59,970 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-04-13T06:23:59,971 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-04-13T06:23:59,973 Found index url https://www.piwheels.org/simple/
2024-04-13T06:24:00,299 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-04-13T06:24:00,307   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,308   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,309   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,310   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,311   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,311   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,312   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,313   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,313   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,314   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,314   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,315   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,315   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,316   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,317   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,318   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,318   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,319   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,319   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,320   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,321   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,321   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,322   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,323   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-13T06:24:00,323   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:24:00,324   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:24:00,325   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-13T06:24:00,325 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-04-13T06:24:00,326 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-04-13T06:24:00,360 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-04-13T06:24:00,386 Collecting alpaca-eval==0.6.1
2024-04-13T06:24:00,389   Created temporary directory: /tmp/pip-unpack-7zs33p53
2024-04-13T06:24:00,622   Downloading alpaca_eval-0.6.1.tar.gz (367 kB)
2024-04-13T06:24:01,458   Added alpaca-eval==0.6.1 from https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz to build tracker '/tmp/pip-build-tracker-0aus4zgi'
2024-04-13T06:24:01,461   Running setup.py (path:/tmp/pip-wheel-g5fx_oxn/alpaca-eval_cde8c5671eda49cd9fa59f378c3fa335/setup.py) egg_info for package alpaca-eval
2024-04-13T06:24:01,462   Created temporary directory: /tmp/pip-pip-egg-info-pf9up9vi
2024-04-13T06:24:01,463   Preparing metadata (setup.py): started
2024-04-13T06:24:01,464   Running command python setup.py egg_info
2024-04-13T06:24:02,536   running egg_info
2024-04-13T06:24:02,537   creating /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info
2024-04-13T06:24:02,561   writing /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/PKG-INFO
2024-04-13T06:24:02,581   writing dependency_links to /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/dependency_links.txt
2024-04-13T06:24:02,583   writing entry points to /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/entry_points.txt
2024-04-13T06:24:02,592   writing requirements to /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/requires.txt
2024-04-13T06:24:02,593   writing top-level names to /tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/top_level.txt
2024-04-13T06:24:02,595   writing manifest file '/tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/SOURCES.txt'
2024-04-13T06:24:02,675   reading manifest file '/tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/SOURCES.txt'
2024-04-13T06:24:02,677   reading manifest template 'MANIFEST.in'
2024-04-13T06:24:02,890   adding license file 'LICENSE'
2024-04-13T06:24:02,903   writing manifest file '/tmp/pip-pip-egg-info-pf9up9vi/alpaca_eval.egg-info/SOURCES.txt'
2024-04-13T06:24:03,010   Preparing metadata (setup.py): finished with status 'done'
2024-04-13T06:24:03,019   Source in /tmp/pip-wheel-g5fx_oxn/alpaca-eval_cde8c5671eda49cd9fa59f378c3fa335 has version 0.6.1, which satisfies requirement alpaca-eval==0.6.1 from https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz
2024-04-13T06:24:03,020   Removed alpaca-eval==0.6.1 from https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz from build tracker '/tmp/pip-build-tracker-0aus4zgi'
2024-04-13T06:24:03,035 Created temporary directory: /tmp/pip-unpack-ypzlz_bb
2024-04-13T06:24:03,036 Created temporary directory: /tmp/pip-unpack-z84jxy5d
2024-04-13T06:24:03,186 Building wheels for collected packages: alpaca-eval
2024-04-13T06:24:03,191   Created temporary directory: /tmp/pip-wheel-ql1a60sn
2024-04-13T06:24:03,191   Building wheel for alpaca-eval (setup.py): started
2024-04-13T06:24:03,193   Destination directory: /tmp/pip-wheel-ql1a60sn
2024-04-13T06:24:03,193   Running command python setup.py bdist_wheel
2024-04-13T06:24:04,247   running bdist_wheel
2024-04-13T06:24:04,341   running build
2024-04-13T06:24:04,342   running build_py
2024-04-13T06:24:04,369   creating build
2024-04-13T06:24:04,370   creating build/lib
2024-04-13T06:24:04,370   creating build/lib/alpaca_eval
2024-04-13T06:24:04,372   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,374   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,375   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,378   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,381   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,384   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,387   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,390   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,391   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-04-13T06:24:04,395   creating build/lib/alpaca_eval/metrics
2024-04-13T06:24:04,396   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-04-13T06:24:04,399   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-04-13T06:24:04,401   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-04-13T06:24:04,403   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-04-13T06:24:04,406   creating build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,408   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,410   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,413   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,415   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,417   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,419   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,422   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,423   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,425   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,427   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,429   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-04-13T06:24:04,431   creating build/lib/alpaca_eval/annotators
2024-04-13T06:24:04,432   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-04-13T06:24:04,434   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-04-13T06:24:04,437   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-04-13T06:24:04,438   running egg_info
2024-04-13T06:24:04,492   writing src/alpaca_eval.egg-info/PKG-INFO
2024-04-13T06:24:04,512   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-04-13T06:24:04,513   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-04-13T06:24:04,523   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-04-13T06:24:04,524   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-04-13T06:24:04,554   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-04-13T06:24:04,564   reading manifest template 'MANIFEST.in'
2024-04-13T06:24:04,733   adding license file 'LICENSE'
2024-04-13T06:24:04,750   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-04-13T06:24:04,753   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-04-13T06:24:04,753   !!

2024-04-13T06:24:04,755           ********************************************************************************
2024-04-13T06:24:04,755           ############################
2024-04-13T06:24:04,756           # Package would be ignored #
2024-04-13T06:24:04,756           ############################
2024-04-13T06:24:04,757           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-04-13T06:24:04,758           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,759           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,760           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-04-13T06:24:04,761           to the `packages` configuration field.

2024-04-13T06:24:04,762           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,762           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,763           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,764           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,765           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,766           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-04-13T06:24:04,767           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-04-13T06:24:04,767           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,768           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,769           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,770           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,771           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,772                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,772                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,772                 directory, all directories are treated like packages.
2024-04-13T06:24:04,773           ********************************************************************************

2024-04-13T06:24:04,773   !!
2024-04-13T06:24:04,774     check.warn(importable)
2024-04-13T06:24:04,774   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-04-13T06:24:04,774   !!

2024-04-13T06:24:04,775           ********************************************************************************
2024-04-13T06:24:04,776           ############################
2024-04-13T06:24:04,776           # Package would be ignored #
2024-04-13T06:24:04,777           ############################
2024-04-13T06:24:04,777           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-04-13T06:24:04,777           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,778           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,778           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-04-13T06:24:04,779           to the `packages` configuration field.

2024-04-13T06:24:04,780           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,781           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,781           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,782           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,783           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,784           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-04-13T06:24:04,785           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-04-13T06:24:04,785           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,786           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,787           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,788           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,789           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,790           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,791                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,791                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,791                 directory, all directories are treated like packages.
2024-04-13T06:24:04,792           ********************************************************************************

2024-04-13T06:24:04,793   !!
2024-04-13T06:24:04,794     check.warn(importable)
2024-04-13T06:24:04,794   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-04-13T06:24:04,795   !!

2024-04-13T06:24:04,796           ********************************************************************************
2024-04-13T06:24:04,796           ############################
2024-04-13T06:24:04,801           # Package would be ignored #
2024-04-13T06:24:04,802           ############################
2024-04-13T06:24:04,802           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-04-13T06:24:04,802           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,803           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,803           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-04-13T06:24:04,804           to the `packages` configuration field.

2024-04-13T06:24:04,804           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,805           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,805           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,806           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,807           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,807           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-04-13T06:24:04,808           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-04-13T06:24:04,808           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,809           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,810           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,812           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,813                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,813                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,814                 directory, all directories are treated like packages.
2024-04-13T06:24:04,814           ********************************************************************************

2024-04-13T06:24:04,815   !!
2024-04-13T06:24:04,816     check.warn(importable)
2024-04-13T06:24:04,816   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-04-13T06:24:04,817   !!

2024-04-13T06:24:04,818           ********************************************************************************
2024-04-13T06:24:04,818           ############################
2024-04-13T06:24:04,819           # Package would be ignored #
2024-04-13T06:24:04,819           ############################
2024-04-13T06:24:04,820           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-04-13T06:24:04,820           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,821           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,822           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-04-13T06:24:04,822           to the `packages` configuration field.

2024-04-13T06:24:04,823           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,824           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,824           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,825           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,826           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,827           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-04-13T06:24:04,828           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-04-13T06:24:04,828           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,828           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,829           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,829           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,830           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,831           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,832                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,832                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,833                 directory, all directories are treated like packages.
2024-04-13T06:24:04,833           ********************************************************************************

2024-04-13T06:24:04,834   !!
2024-04-13T06:24:04,834     check.warn(importable)
2024-04-13T06:24:04,834   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:04,835   !!

2024-04-13T06:24:04,836           ********************************************************************************
2024-04-13T06:24:04,836           ############################
2024-04-13T06:24:04,837           # Package would be ignored #
2024-04-13T06:24:04,837           ############################
2024-04-13T06:24:04,838           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-04-13T06:24:04,838           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,839           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,840           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-04-13T06:24:04,840           to the `packages` configuration field.

2024-04-13T06:24:04,841           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,842           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,842           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,843           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,844           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,845           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-04-13T06:24:04,846           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-04-13T06:24:04,846           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,847           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,849           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,850           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,851           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,852                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,852                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,853                 directory, all directories are treated like packages.
2024-04-13T06:24:04,853           ********************************************************************************

2024-04-13T06:24:04,854   !!
2024-04-13T06:24:04,854     check.warn(importable)
2024-04-13T06:24:04,855   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-04-13T06:24:04,855   !!

2024-04-13T06:24:04,856           ********************************************************************************
2024-04-13T06:24:04,856           ############################
2024-04-13T06:24:04,857           # Package would be ignored #
2024-04-13T06:24:04,857           ############################
2024-04-13T06:24:04,857           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-04-13T06:24:04,858           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,859           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,859           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-04-13T06:24:04,859           to the `packages` configuration field.

2024-04-13T06:24:04,860           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,861           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,862           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,863           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,864           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-04-13T06:24:04,865           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-04-13T06:24:04,865           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,867           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,868           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,869           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,871           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,872                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,872                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,873                 directory, all directories are treated like packages.
2024-04-13T06:24:04,874           ********************************************************************************

2024-04-13T06:24:04,875   !!
2024-04-13T06:24:04,875     check.warn(importable)
2024-04-13T06:24:04,876   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-04-13T06:24:04,877   !!

2024-04-13T06:24:04,878           ********************************************************************************
2024-04-13T06:24:04,879           ############################
2024-04-13T06:24:04,879           # Package would be ignored #
2024-04-13T06:24:04,880           ############################
2024-04-13T06:24:04,880           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-04-13T06:24:04,881           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,883           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,883           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-04-13T06:24:04,884           to the `packages` configuration field.

2024-04-13T06:24:04,885           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,885           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,886           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,887           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,888           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,889           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-04-13T06:24:04,889           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-04-13T06:24:04,890           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,890           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,891           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,892           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,893           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,895           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,895                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,896                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,897                 directory, all directories are treated like packages.
2024-04-13T06:24:04,897           ********************************************************************************

2024-04-13T06:24:04,899   !!
2024-04-13T06:24:04,899     check.warn(importable)
2024-04-13T06:24:04,900   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-04-13T06:24:04,900   !!

2024-04-13T06:24:04,902           ********************************************************************************
2024-04-13T06:24:04,902           ############################
2024-04-13T06:24:04,903           # Package would be ignored #
2024-04-13T06:24:04,904           ############################
2024-04-13T06:24:04,904           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-04-13T06:24:04,905           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,906           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,907           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-04-13T06:24:04,907           to the `packages` configuration field.

2024-04-13T06:24:04,908           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,909           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,910           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,911           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,913           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,914           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-04-13T06:24:04,915           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-04-13T06:24:04,916           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,916           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,917           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,918           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,919           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,920           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,921                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,921                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,922                 directory, all directories are treated like packages.
2024-04-13T06:24:04,922           ********************************************************************************

2024-04-13T06:24:04,923   !!
2024-04-13T06:24:04,924     check.warn(importable)
2024-04-13T06:24:04,924   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-04-13T06:24:04,925   !!

2024-04-13T06:24:04,926           ********************************************************************************
2024-04-13T06:24:04,927           ############################
2024-04-13T06:24:04,927           # Package would be ignored #
2024-04-13T06:24:04,928           ############################
2024-04-13T06:24:04,929           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-04-13T06:24:04,930           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,931           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,932           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-04-13T06:24:04,932           to the `packages` configuration field.

2024-04-13T06:24:04,934           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,935           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,936           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,937           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,939           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,940           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-04-13T06:24:04,940           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-04-13T06:24:04,941           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,941           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,942           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,943           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,945           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,947           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,947                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,948                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,949                 directory, all directories are treated like packages.
2024-04-13T06:24:04,949           ********************************************************************************

2024-04-13T06:24:04,951   !!
2024-04-13T06:24:04,952     check.warn(importable)
2024-04-13T06:24:04,952   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-04-13T06:24:04,953   !!

2024-04-13T06:24:04,954           ********************************************************************************
2024-04-13T06:24:04,954           ############################
2024-04-13T06:24:04,955           # Package would be ignored #
2024-04-13T06:24:04,955           ############################
2024-04-13T06:24:04,956           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-04-13T06:24:04,956           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,957           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,958           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-04-13T06:24:04,958           to the `packages` configuration field.

2024-04-13T06:24:04,959           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,960           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,960           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,961           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,962           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,963           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-04-13T06:24:04,964           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-04-13T06:24:04,965           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,965           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,966           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,967           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,968           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,969           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,970                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,970                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,971                 directory, all directories are treated like packages.
2024-04-13T06:24:04,972           ********************************************************************************

2024-04-13T06:24:04,973   !!
2024-04-13T06:24:04,973     check.warn(importable)
2024-04-13T06:24:04,973   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:04,974   !!

2024-04-13T06:24:04,975           ********************************************************************************
2024-04-13T06:24:04,975           ############################
2024-04-13T06:24:04,976           # Package would be ignored #
2024-04-13T06:24:04,976           ############################
2024-04-13T06:24:04,977           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-04-13T06:24:04,977           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,978           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,979           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-04-13T06:24:04,980           to the `packages` configuration field.

2024-04-13T06:24:04,981           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,981           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,981           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:04,982           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:04,983           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:04,983           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-04-13T06:24:04,984           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-04-13T06:24:04,984           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:04,984           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:04,985           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:04,986           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:04,986           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:04,987           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:04,988                 even if it does not contain any `.py` files.
2024-04-13T06:24:04,988                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:04,989                 directory, all directories are treated like packages.
2024-04-13T06:24:04,989           ********************************************************************************

2024-04-13T06:24:04,990   !!
2024-04-13T06:24:04,991     check.warn(importable)
2024-04-13T06:24:04,991   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:04,992   !!

2024-04-13T06:24:04,993           ********************************************************************************
2024-04-13T06:24:04,993           ############################
2024-04-13T06:24:04,994           # Package would be ignored #
2024-04-13T06:24:04,994           ############################
2024-04-13T06:24:04,995           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-04-13T06:24:04,995           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:04,996           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:04,997           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-04-13T06:24:04,997           to the `packages` configuration field.

2024-04-13T06:24:04,998           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:04,999           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:04,999           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,000           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,001           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,002           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-04-13T06:24:05,002           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-04-13T06:24:05,003           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,003           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,004           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,005           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,006           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,007           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,007                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,008                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,008                 directory, all directories are treated like packages.
2024-04-13T06:24:05,008           ********************************************************************************

2024-04-13T06:24:05,009   !!
2024-04-13T06:24:05,009     check.warn(importable)
2024-04-13T06:24:05,010   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-04-13T06:24:05,010   !!

2024-04-13T06:24:05,011           ********************************************************************************
2024-04-13T06:24:05,011           ############################
2024-04-13T06:24:05,012           # Package would be ignored #
2024-04-13T06:24:05,012           ############################
2024-04-13T06:24:05,013           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-04-13T06:24:05,013           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,014           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,014           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-04-13T06:24:05,015           to the `packages` configuration field.

2024-04-13T06:24:05,016           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,016           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,016           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,018           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,019           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,020           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-04-13T06:24:05,020           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-04-13T06:24:05,021           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,022           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,022           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,023           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,026           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,026                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,027                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,027                 directory, all directories are treated like packages.
2024-04-13T06:24:05,028           ********************************************************************************

2024-04-13T06:24:05,029   !!
2024-04-13T06:24:05,030     check.warn(importable)
2024-04-13T06:24:05,030   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-04-13T06:24:05,031   !!

2024-04-13T06:24:05,032           ********************************************************************************
2024-04-13T06:24:05,032           ############################
2024-04-13T06:24:05,032           # Package would be ignored #
2024-04-13T06:24:05,033           ############################
2024-04-13T06:24:05,033           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-04-13T06:24:05,033           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,034           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,034           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-04-13T06:24:05,035           to the `packages` configuration field.

2024-04-13T06:24:05,036           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,036           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,036           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,037           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,038           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,039           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-04-13T06:24:05,039           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-04-13T06:24:05,039           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,040           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,040           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,041           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,042           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,044           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,044                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,045                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,045                 directory, all directories are treated like packages.
2024-04-13T06:24:05,046           ********************************************************************************

2024-04-13T06:24:05,047   !!
2024-04-13T06:24:05,047     check.warn(importable)
2024-04-13T06:24:05,048   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-04-13T06:24:05,048   !!

2024-04-13T06:24:05,049           ********************************************************************************
2024-04-13T06:24:05,050           ############################
2024-04-13T06:24:05,050           # Package would be ignored #
2024-04-13T06:24:05,051           ############################
2024-04-13T06:24:05,051           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-04-13T06:24:05,052           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,052           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,053           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-04-13T06:24:05,054           to the `packages` configuration field.

2024-04-13T06:24:05,055           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,055           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,056           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,057           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,058           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,059           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-04-13T06:24:05,059           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-04-13T06:24:05,060           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,060           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,061           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,061           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,062           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,063           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,064                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,064                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,064                 directory, all directories are treated like packages.
2024-04-13T06:24:05,065           ********************************************************************************

2024-04-13T06:24:05,066   !!
2024-04-13T06:24:05,066     check.warn(importable)
2024-04-13T06:24:05,067   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-04-13T06:24:05,067   !!

2024-04-13T06:24:05,068           ********************************************************************************
2024-04-13T06:24:05,069           ############################
2024-04-13T06:24:05,069           # Package would be ignored #
2024-04-13T06:24:05,070           ############################
2024-04-13T06:24:05,070           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-04-13T06:24:05,070           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,071           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,072           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-04-13T06:24:05,072           to the `packages` configuration field.

2024-04-13T06:24:05,073           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,074           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,074           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,075           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,076           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,077           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-04-13T06:24:05,078           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-04-13T06:24:05,078           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,079           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,079           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,080           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,081           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,082           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,083                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,084                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,084                 directory, all directories are treated like packages.
2024-04-13T06:24:05,085           ********************************************************************************

2024-04-13T06:24:05,086   !!
2024-04-13T06:24:05,086     check.warn(importable)
2024-04-13T06:24:05,086   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-04-13T06:24:05,087   !!

2024-04-13T06:24:05,088           ********************************************************************************
2024-04-13T06:24:05,088           ############################
2024-04-13T06:24:05,088           # Package would be ignored #
2024-04-13T06:24:05,089           ############################
2024-04-13T06:24:05,089           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-04-13T06:24:05,089           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,090           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,090           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-04-13T06:24:05,091           to the `packages` configuration field.

2024-04-13T06:24:05,091           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,092           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,092           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,093           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,094           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,095           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-04-13T06:24:05,095           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-04-13T06:24:05,096           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,096           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,097           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,098           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,099           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,100           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,101                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,101                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,102                 directory, all directories are treated like packages.
2024-04-13T06:24:05,102           ********************************************************************************

2024-04-13T06:24:05,103   !!
2024-04-13T06:24:05,103     check.warn(importable)
2024-04-13T06:24:05,104   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-04-13T06:24:05,104   !!

2024-04-13T06:24:05,105           ********************************************************************************
2024-04-13T06:24:05,106           ############################
2024-04-13T06:24:05,107           # Package would be ignored #
2024-04-13T06:24:05,107           ############################
2024-04-13T06:24:05,108           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-04-13T06:24:05,108           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,109           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,110           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-04-13T06:24:05,111           to the `packages` configuration field.

2024-04-13T06:24:05,111           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,112           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,112           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,113           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,113           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,114           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-04-13T06:24:05,114           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-04-13T06:24:05,115           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,115           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,116           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,116           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,117           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,118           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,118                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,119                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,119                 directory, all directories are treated like packages.
2024-04-13T06:24:05,120           ********************************************************************************

2024-04-13T06:24:05,121   !!
2024-04-13T06:24:05,122     check.warn(importable)
2024-04-13T06:24:05,122   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-04-13T06:24:05,123   !!

2024-04-13T06:24:05,124           ********************************************************************************
2024-04-13T06:24:05,124           ############################
2024-04-13T06:24:05,125           # Package would be ignored #
2024-04-13T06:24:05,125           ############################
2024-04-13T06:24:05,126           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-04-13T06:24:05,126           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,127           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,128           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-04-13T06:24:05,128           to the `packages` configuration field.

2024-04-13T06:24:05,129           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,130           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,130           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,131           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,132           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,133           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-04-13T06:24:05,134           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-04-13T06:24:05,134           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,135           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,135           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,136           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,137           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,138           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,138                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,139                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,139                 directory, all directories are treated like packages.
2024-04-13T06:24:05,139           ********************************************************************************

2024-04-13T06:24:05,140   !!
2024-04-13T06:24:05,140     check.warn(importable)
2024-04-13T06:24:05,141   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-04-13T06:24:05,141   !!

2024-04-13T06:24:05,142           ********************************************************************************
2024-04-13T06:24:05,143           ############################
2024-04-13T06:24:05,143           # Package would be ignored #
2024-04-13T06:24:05,143           ############################
2024-04-13T06:24:05,144           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-04-13T06:24:05,144           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,146           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,146           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-04-13T06:24:05,147           to the `packages` configuration field.

2024-04-13T06:24:05,148           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,148           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,149           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,150           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,153           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-04-13T06:24:05,154           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-04-13T06:24:05,155           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,155           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,156           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,157           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,158           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,159           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,160                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,160                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,161                 directory, all directories are treated like packages.
2024-04-13T06:24:05,161           ********************************************************************************

2024-04-13T06:24:05,162   !!
2024-04-13T06:24:05,163     check.warn(importable)
2024-04-13T06:24:05,163   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-04-13T06:24:05,164   !!

2024-04-13T06:24:05,165           ********************************************************************************
2024-04-13T06:24:05,165           ############################
2024-04-13T06:24:05,165           # Package would be ignored #
2024-04-13T06:24:05,166           ############################
2024-04-13T06:24:05,166           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-04-13T06:24:05,167           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,167           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,168           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-04-13T06:24:05,168           to the `packages` configuration field.

2024-04-13T06:24:05,169           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,169           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,170           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,170           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,171           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,172           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-04-13T06:24:05,172           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-04-13T06:24:05,173           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,173           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,174           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,174           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,176           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,178                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,178                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,179                 directory, all directories are treated like packages.
2024-04-13T06:24:05,179           ********************************************************************************

2024-04-13T06:24:05,180   !!
2024-04-13T06:24:05,181     check.warn(importable)
2024-04-13T06:24:05,181   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-04-13T06:24:05,182   !!

2024-04-13T06:24:05,183           ********************************************************************************
2024-04-13T06:24:05,183           ############################
2024-04-13T06:24:05,184           # Package would be ignored #
2024-04-13T06:24:05,184           ############################
2024-04-13T06:24:05,185           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-04-13T06:24:05,185           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,186           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,187           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-04-13T06:24:05,187           to the `packages` configuration field.

2024-04-13T06:24:05,188           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,189           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,189           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,190           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,191           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,192           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-04-13T06:24:05,192           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-04-13T06:24:05,192           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,193           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,193           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,194           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,195           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,196           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,196                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,196                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,197                 directory, all directories are treated like packages.
2024-04-13T06:24:05,197           ********************************************************************************

2024-04-13T06:24:05,198   !!
2024-04-13T06:24:05,198     check.warn(importable)
2024-04-13T06:24:05,199   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:05,199   !!

2024-04-13T06:24:05,200           ********************************************************************************
2024-04-13T06:24:05,201           ############################
2024-04-13T06:24:05,201           # Package would be ignored #
2024-04-13T06:24:05,202           ############################
2024-04-13T06:24:05,202           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-04-13T06:24:05,203           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,204           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,204           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-04-13T06:24:05,205           to the `packages` configuration field.

2024-04-13T06:24:05,206           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,206           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,207           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,208           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,208           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,210           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-04-13T06:24:05,210           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-04-13T06:24:05,210           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,211           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,211           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,213           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,214           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,215           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,216                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,217                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,217                 directory, all directories are treated like packages.
2024-04-13T06:24:05,217           ********************************************************************************

2024-04-13T06:24:05,218   !!
2024-04-13T06:24:05,218     check.warn(importable)
2024-04-13T06:24:05,219   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-04-13T06:24:05,219   !!

2024-04-13T06:24:05,220           ********************************************************************************
2024-04-13T06:24:05,220           ############################
2024-04-13T06:24:05,220           # Package would be ignored #
2024-04-13T06:24:05,221           ############################
2024-04-13T06:24:05,221           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-04-13T06:24:05,221           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,222           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,223           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-04-13T06:24:05,223           to the `packages` configuration field.

2024-04-13T06:24:05,224           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,224           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,225           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,226           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,227           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,228           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-04-13T06:24:05,229           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-04-13T06:24:05,229           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,230           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,231           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,232           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,233           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,234           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,235                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,235                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,236                 directory, all directories are treated like packages.
2024-04-13T06:24:05,236           ********************************************************************************

2024-04-13T06:24:05,237   !!
2024-04-13T06:24:05,238     check.warn(importable)
2024-04-13T06:24:05,238   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-04-13T06:24:05,239   !!

2024-04-13T06:24:05,240           ********************************************************************************
2024-04-13T06:24:05,240           ############################
2024-04-13T06:24:05,240           # Package would be ignored #
2024-04-13T06:24:05,241           ############################
2024-04-13T06:24:05,242           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-04-13T06:24:05,242           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,243           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,243           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-04-13T06:24:05,244           to the `packages` configuration field.

2024-04-13T06:24:05,245           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,245           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,245           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,246           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,247           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,247           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-04-13T06:24:05,248           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-04-13T06:24:05,248           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,249           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,249           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,250           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,251           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,252           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,252                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,253                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,253                 directory, all directories are treated like packages.
2024-04-13T06:24:05,254           ********************************************************************************

2024-04-13T06:24:05,254   !!
2024-04-13T06:24:05,255     check.warn(importable)
2024-04-13T06:24:05,255   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-04-13T06:24:05,256   !!

2024-04-13T06:24:05,257           ********************************************************************************
2024-04-13T06:24:05,258           ############################
2024-04-13T06:24:05,258           # Package would be ignored #
2024-04-13T06:24:05,259           ############################
2024-04-13T06:24:05,259           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-04-13T06:24:05,260           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,260           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,261           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-04-13T06:24:05,261           to the `packages` configuration field.

2024-04-13T06:24:05,262           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,263           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,263           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,264           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,265           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,266           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-04-13T06:24:05,267           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-04-13T06:24:05,268           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,268           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,268           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,269           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,270           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,271           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,271                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,272                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,272                 directory, all directories are treated like packages.
2024-04-13T06:24:05,272           ********************************************************************************

2024-04-13T06:24:05,273   !!
2024-04-13T06:24:05,273     check.warn(importable)
2024-04-13T06:24:05,274   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-04-13T06:24:05,274   !!

2024-04-13T06:24:05,275           ********************************************************************************
2024-04-13T06:24:05,275           ############################
2024-04-13T06:24:05,276           # Package would be ignored #
2024-04-13T06:24:05,276           ############################
2024-04-13T06:24:05,277           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-04-13T06:24:05,277           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,278           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,279           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-04-13T06:24:05,279           to the `packages` configuration field.

2024-04-13T06:24:05,280           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,281           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,281           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,282           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,283           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,285           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-04-13T06:24:05,285           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-04-13T06:24:05,286           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,286           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,287           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,287           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,289           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,290           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,291                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,291                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,292                 directory, all directories are treated like packages.
2024-04-13T06:24:05,292           ********************************************************************************

2024-04-13T06:24:05,293   !!
2024-04-13T06:24:05,294     check.warn(importable)
2024-04-13T06:24:05,294   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-04-13T06:24:05,294   !!

2024-04-13T06:24:05,295           ********************************************************************************
2024-04-13T06:24:05,295           ############################
2024-04-13T06:24:05,296           # Package would be ignored #
2024-04-13T06:24:05,296           ############################
2024-04-13T06:24:05,297           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-04-13T06:24:05,297           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,298           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,298           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-04-13T06:24:05,299           to the `packages` configuration field.

2024-04-13T06:24:05,300           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,300           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,300           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,301           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,302           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,303           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-04-13T06:24:05,304           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-04-13T06:24:05,304           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,305           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,305           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,307           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,308           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,309           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,310                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,310                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,311                 directory, all directories are treated like packages.
2024-04-13T06:24:05,311           ********************************************************************************

2024-04-13T06:24:05,312   !!
2024-04-13T06:24:05,313     check.warn(importable)
2024-04-13T06:24:05,313   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-04-13T06:24:05,314   !!

2024-04-13T06:24:05,315           ********************************************************************************
2024-04-13T06:24:05,315           ############################
2024-04-13T06:24:05,315           # Package would be ignored #
2024-04-13T06:24:05,316           ############################
2024-04-13T06:24:05,316           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-04-13T06:24:05,317           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,318           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,319           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-04-13T06:24:05,319           to the `packages` configuration field.

2024-04-13T06:24:05,320           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,321           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,321           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,322           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,322           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,323           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-04-13T06:24:05,323           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-04-13T06:24:05,324           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,324           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,325           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,325           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,326           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,327           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,328                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,328                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,329                 directory, all directories are treated like packages.
2024-04-13T06:24:05,329           ********************************************************************************

2024-04-13T06:24:05,330   !!
2024-04-13T06:24:05,330     check.warn(importable)
2024-04-13T06:24:05,331   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:05,331   !!

2024-04-13T06:24:05,332           ********************************************************************************
2024-04-13T06:24:05,332           ############################
2024-04-13T06:24:05,333           # Package would be ignored #
2024-04-13T06:24:05,333           ############################
2024-04-13T06:24:05,334           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-04-13T06:24:05,334           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,335           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,336           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-04-13T06:24:05,336           to the `packages` configuration field.

2024-04-13T06:24:05,337           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,338           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,338           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,339           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,340           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,341           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-04-13T06:24:05,341           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-04-13T06:24:05,342           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,343           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,343           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,344           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,345           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,346           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,346                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,347                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,347                 directory, all directories are treated like packages.
2024-04-13T06:24:05,347           ********************************************************************************

2024-04-13T06:24:05,348   !!
2024-04-13T06:24:05,348     check.warn(importable)
2024-04-13T06:24:05,349   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:05,349   !!

2024-04-13T06:24:05,350           ********************************************************************************
2024-04-13T06:24:05,350           ############################
2024-04-13T06:24:05,351           # Package would be ignored #
2024-04-13T06:24:05,351           ############################
2024-04-13T06:24:05,351           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-04-13T06:24:05,352           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,352           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,353           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-04-13T06:24:05,353           to the `packages` configuration field.

2024-04-13T06:24:05,354           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,354           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,355           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,356           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,356           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,357           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-04-13T06:24:05,358           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-04-13T06:24:05,358           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,359           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,359           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,360           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,361           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,363           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,363                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,364                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,365                 directory, all directories are treated like packages.
2024-04-13T06:24:05,365           ********************************************************************************

2024-04-13T06:24:05,366   !!
2024-04-13T06:24:05,367     check.warn(importable)
2024-04-13T06:24:05,367   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:05,368   !!

2024-04-13T06:24:05,369           ********************************************************************************
2024-04-13T06:24:05,369           ############################
2024-04-13T06:24:05,370           # Package would be ignored #
2024-04-13T06:24:05,370           ############################
2024-04-13T06:24:05,370           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-04-13T06:24:05,371           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,371           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,372           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-04-13T06:24:05,372           to the `packages` configuration field.

2024-04-13T06:24:05,373           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,373           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,374           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,375           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,375           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,376           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-04-13T06:24:05,377           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-04-13T06:24:05,377           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,377           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,378           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,379           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,381           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,381                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,382                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,382                 directory, all directories are treated like packages.
2024-04-13T06:24:05,382           ********************************************************************************

2024-04-13T06:24:05,383   !!
2024-04-13T06:24:05,384     check.warn(importable)
2024-04-13T06:24:05,384   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-04-13T06:24:05,385   !!

2024-04-13T06:24:05,386           ********************************************************************************
2024-04-13T06:24:05,386           ############################
2024-04-13T06:24:05,386           # Package would be ignored #
2024-04-13T06:24:05,387           ############################
2024-04-13T06:24:05,387           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-04-13T06:24:05,388           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,389           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,389           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-04-13T06:24:05,390           to the `packages` configuration field.

2024-04-13T06:24:05,391           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,391           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,392           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,393           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,394           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,395           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-04-13T06:24:05,395           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-04-13T06:24:05,395           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,396           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,396           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,397           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,397           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,399           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,399                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,399                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,400                 directory, all directories are treated like packages.
2024-04-13T06:24:05,400           ********************************************************************************

2024-04-13T06:24:05,401   !!
2024-04-13T06:24:05,401     check.warn(importable)
2024-04-13T06:24:05,402   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-04-13T06:24:05,402   !!

2024-04-13T06:24:05,403           ********************************************************************************
2024-04-13T06:24:05,403           ############################
2024-04-13T06:24:05,404           # Package would be ignored #
2024-04-13T06:24:05,404           ############################
2024-04-13T06:24:05,405           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-04-13T06:24:05,405           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,406           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,406           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-04-13T06:24:05,407           to the `packages` configuration field.

2024-04-13T06:24:05,408           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,408           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,409           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,410           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,410           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,411           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-04-13T06:24:05,412           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-04-13T06:24:05,412           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,413           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,413           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,414           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,415           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,417           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,417                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,418                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,418                 directory, all directories are treated like packages.
2024-04-13T06:24:05,418           ********************************************************************************

2024-04-13T06:24:05,419   !!
2024-04-13T06:24:05,419     check.warn(importable)
2024-04-13T06:24:05,420   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-04-13T06:24:05,420   !!

2024-04-13T06:24:05,421           ********************************************************************************
2024-04-13T06:24:05,421           ############################
2024-04-13T06:24:05,422           # Package would be ignored #
2024-04-13T06:24:05,422           ############################
2024-04-13T06:24:05,422           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-04-13T06:24:05,423           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,423           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,424           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-04-13T06:24:05,424           to the `packages` configuration field.

2024-04-13T06:24:05,425           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,425           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,426           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,426           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,427           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,428           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-04-13T06:24:05,429           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-04-13T06:24:05,429           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,430           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,430           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,431           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,432           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,434           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,434                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,435                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,435                 directory, all directories are treated like packages.
2024-04-13T06:24:05,435           ********************************************************************************

2024-04-13T06:24:05,436   !!
2024-04-13T06:24:05,437     check.warn(importable)
2024-04-13T06:24:05,437   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-04-13T06:24:05,438   !!

2024-04-13T06:24:05,439           ********************************************************************************
2024-04-13T06:24:05,439           ############################
2024-04-13T06:24:05,440           # Package would be ignored #
2024-04-13T06:24:05,440           ############################
2024-04-13T06:24:05,441           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-04-13T06:24:05,441           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,442           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,443           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-04-13T06:24:05,443           to the `packages` configuration field.

2024-04-13T06:24:05,444           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,444           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,444           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,445           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,446           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,447           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-04-13T06:24:05,447           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-04-13T06:24:05,447           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,448           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,448           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,449           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,450           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,451           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,452                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,452                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,452                 directory, all directories are treated like packages.
2024-04-13T06:24:05,453           ********************************************************************************

2024-04-13T06:24:05,454   !!
2024-04-13T06:24:05,454     check.warn(importable)
2024-04-13T06:24:05,455   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-04-13T06:24:05,455   !!

2024-04-13T06:24:05,456           ********************************************************************************
2024-04-13T06:24:05,457           ############################
2024-04-13T06:24:05,457           # Package would be ignored #
2024-04-13T06:24:05,458           ############################
2024-04-13T06:24:05,458           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-04-13T06:24:05,459           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,459           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,460           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-04-13T06:24:05,460           to the `packages` configuration field.

2024-04-13T06:24:05,461           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,462           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,462           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,463           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,464           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,465           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-04-13T06:24:05,465           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-04-13T06:24:05,466           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,466           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,467           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,467           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,468           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,469           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,470                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,470                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,470                 directory, all directories are treated like packages.
2024-04-13T06:24:05,471           ********************************************************************************

2024-04-13T06:24:05,472   !!
2024-04-13T06:24:05,472     check.warn(importable)
2024-04-13T06:24:05,473   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-04-13T06:24:05,473   !!

2024-04-13T06:24:05,474           ********************************************************************************
2024-04-13T06:24:05,474           ############################
2024-04-13T06:24:05,475           # Package would be ignored #
2024-04-13T06:24:05,475           ############################
2024-04-13T06:24:05,476           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-04-13T06:24:05,476           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,477           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,477           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-04-13T06:24:05,478           to the `packages` configuration field.

2024-04-13T06:24:05,479           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,479           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,479           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,480           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,481           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,482           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-04-13T06:24:05,483           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-04-13T06:24:05,483           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,483           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,484           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,485           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,486           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,487           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,487                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,488                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,488                 directory, all directories are treated like packages.
2024-04-13T06:24:05,489           ********************************************************************************

2024-04-13T06:24:05,490   !!
2024-04-13T06:24:05,491     check.warn(importable)
2024-04-13T06:24:05,491   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-04-13T06:24:05,491   !!

2024-04-13T06:24:05,492           ********************************************************************************
2024-04-13T06:24:05,492           ############################
2024-04-13T06:24:05,493           # Package would be ignored #
2024-04-13T06:24:05,493           ############################
2024-04-13T06:24:05,493           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-04-13T06:24:05,494           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,494           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,495           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-04-13T06:24:05,495           to the `packages` configuration field.

2024-04-13T06:24:05,496           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,497           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,497           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,498           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,499           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,500           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-04-13T06:24:05,500           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-04-13T06:24:05,501           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,501           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,502           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,503           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,506           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,507           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,508                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,508                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,509                 directory, all directories are treated like packages.
2024-04-13T06:24:05,509           ********************************************************************************

2024-04-13T06:24:05,510   !!
2024-04-13T06:24:05,511     check.warn(importable)
2024-04-13T06:24:05,511   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-04-13T06:24:05,512   !!

2024-04-13T06:24:05,513           ********************************************************************************
2024-04-13T06:24:05,513           ############################
2024-04-13T06:24:05,514           # Package would be ignored #
2024-04-13T06:24:05,514           ############################
2024-04-13T06:24:05,515           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-04-13T06:24:05,515           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,516           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,517           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-04-13T06:24:05,517           to the `packages` configuration field.

2024-04-13T06:24:05,519           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,519           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,519           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,520           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,521           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,522           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-04-13T06:24:05,523           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-04-13T06:24:05,523           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,524           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,524           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,525           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,526           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,527           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,528                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,528                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,529                 directory, all directories are treated like packages.
2024-04-13T06:24:05,529           ********************************************************************************

2024-04-13T06:24:05,530   !!
2024-04-13T06:24:05,531     check.warn(importable)
2024-04-13T06:24:05,531   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-04-13T06:24:05,532   !!

2024-04-13T06:24:05,533           ********************************************************************************
2024-04-13T06:24:05,533           ############################
2024-04-13T06:24:05,534           # Package would be ignored #
2024-04-13T06:24:05,534           ############################
2024-04-13T06:24:05,535           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-04-13T06:24:05,535           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,536           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,537           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-04-13T06:24:05,537           to the `packages` configuration field.

2024-04-13T06:24:05,539           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,539           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,540           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,541           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,542           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,543           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-04-13T06:24:05,543           already explicitly excluding 'alpaca_eval.models_configs' via
2024-04-13T06:24:05,544           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,544           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,545           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,546           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,547           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,549                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,549                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,550                 directory, all directories are treated like packages.
2024-04-13T06:24:05,550           ********************************************************************************

2024-04-13T06:24:05,551   !!
2024-04-13T06:24:05,552     check.warn(importable)
2024-04-13T06:24:05,552   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-04-13T06:24:05,553   !!

2024-04-13T06:24:05,554           ********************************************************************************
2024-04-13T06:24:05,554           ############################
2024-04-13T06:24:05,555           # Package would be ignored #
2024-04-13T06:24:05,555           ############################
2024-04-13T06:24:05,555           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-04-13T06:24:05,556           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,557           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,557           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-04-13T06:24:05,558           to the `packages` configuration field.

2024-04-13T06:24:05,559           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,559           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,560           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,561           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,562           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,563           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-04-13T06:24:05,563           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-04-13T06:24:05,564           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,564           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,565           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,566           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,567           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,568           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,569                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,570                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,570                 directory, all directories are treated like packages.
2024-04-13T06:24:05,571           ********************************************************************************

2024-04-13T06:24:05,572   !!
2024-04-13T06:24:05,572     check.warn(importable)
2024-04-13T06:24:05,573   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-04-13T06:24:05,573   !!

2024-04-13T06:24:05,574           ********************************************************************************
2024-04-13T06:24:05,575           ############################
2024-04-13T06:24:05,575           # Package would be ignored #
2024-04-13T06:24:05,576           ############################
2024-04-13T06:24:05,577           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-04-13T06:24:05,577           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,578           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,579           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-04-13T06:24:05,579           to the `packages` configuration field.

2024-04-13T06:24:05,580           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,581           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,581           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,582           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,583           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,584           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-04-13T06:24:05,585           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-04-13T06:24:05,585           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,586           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,586           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,587           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,588           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,590           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,590                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,591                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,591                 directory, all directories are treated like packages.
2024-04-13T06:24:05,592           ********************************************************************************

2024-04-13T06:24:05,593   !!
2024-04-13T06:24:05,593     check.warn(importable)
2024-04-13T06:24:05,594   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-04-13T06:24:05,594   !!

2024-04-13T06:24:05,595           ********************************************************************************
2024-04-13T06:24:05,596           ############################
2024-04-13T06:24:05,596           # Package would be ignored #
2024-04-13T06:24:05,597           ############################
2024-04-13T06:24:05,598           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-04-13T06:24:05,598           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,599           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,600           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-04-13T06:24:05,600           to the `packages` configuration field.

2024-04-13T06:24:05,601           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,602           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,602           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,604           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,606           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-04-13T06:24:05,606           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-04-13T06:24:05,607           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,607           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,608           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,609           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,610           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,611           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,611                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,612                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,612                 directory, all directories are treated like packages.
2024-04-13T06:24:05,613           ********************************************************************************

2024-04-13T06:24:05,614   !!
2024-04-13T06:24:05,614     check.warn(importable)
2024-04-13T06:24:05,615   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-04-13T06:24:05,615   !!

2024-04-13T06:24:05,616           ********************************************************************************
2024-04-13T06:24:05,617           ############################
2024-04-13T06:24:05,617           # Package would be ignored #
2024-04-13T06:24:05,618           ############################
2024-04-13T06:24:05,618           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-04-13T06:24:05,619           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,620           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,620           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-04-13T06:24:05,621           to the `packages` configuration field.

2024-04-13T06:24:05,622           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,622           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,623           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,624           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,625           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,626           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-04-13T06:24:05,626           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-04-13T06:24:05,627           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,627           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,628           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,629           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,630           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,632           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,632                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,633                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,634                 directory, all directories are treated like packages.
2024-04-13T06:24:05,634           ********************************************************************************

2024-04-13T06:24:05,635   !!
2024-04-13T06:24:05,636     check.warn(importable)
2024-04-13T06:24:05,637   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-04-13T06:24:05,637   !!

2024-04-13T06:24:05,638           ********************************************************************************
2024-04-13T06:24:05,639           ############################
2024-04-13T06:24:05,639           # Package would be ignored #
2024-04-13T06:24:05,639           ############################
2024-04-13T06:24:05,640           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-04-13T06:24:05,640           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,641           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,642           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-04-13T06:24:05,642           to the `packages` configuration field.

2024-04-13T06:24:05,643           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,643           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,644           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,645           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,646           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,647           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-04-13T06:24:05,647           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-04-13T06:24:05,648           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,648           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,649           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,650           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,651           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,652           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,653                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,653                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,654                 directory, all directories are treated like packages.
2024-04-13T06:24:05,654           ********************************************************************************

2024-04-13T06:24:05,656   !!
2024-04-13T06:24:05,656     check.warn(importable)
2024-04-13T06:24:05,657   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-04-13T06:24:05,657   !!

2024-04-13T06:24:05,658           ********************************************************************************
2024-04-13T06:24:05,659           ############################
2024-04-13T06:24:05,659           # Package would be ignored #
2024-04-13T06:24:05,660           ############################
2024-04-13T06:24:05,660           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-04-13T06:24:05,661           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,662           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,662           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-04-13T06:24:05,663           to the `packages` configuration field.

2024-04-13T06:24:05,664           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,665           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,665           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,666           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,667           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,668           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-04-13T06:24:05,669           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-04-13T06:24:05,669           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,669           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,670           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,671           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,672           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,673           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,673                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,674                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,674                 directory, all directories are treated like packages.
2024-04-13T06:24:05,675           ********************************************************************************

2024-04-13T06:24:05,676   !!
2024-04-13T06:24:05,676     check.warn(importable)
2024-04-13T06:24:05,677   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-04-13T06:24:05,677   !!

2024-04-13T06:24:05,678           ********************************************************************************
2024-04-13T06:24:05,679           ############################
2024-04-13T06:24:05,679           # Package would be ignored #
2024-04-13T06:24:05,680           ############################
2024-04-13T06:24:05,680           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-04-13T06:24:05,681           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,682           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,682           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-04-13T06:24:05,683           to the `packages` configuration field.

2024-04-13T06:24:05,684           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,685           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,685           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,686           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,687           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,688           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-04-13T06:24:05,689           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-04-13T06:24:05,690           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,690           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,691           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,692           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,693           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,695           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,695                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,695                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,696                 directory, all directories are treated like packages.
2024-04-13T06:24:05,696           ********************************************************************************

2024-04-13T06:24:05,697   !!
2024-04-13T06:24:05,698     check.warn(importable)
2024-04-13T06:24:05,698   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-04-13T06:24:05,699   !!

2024-04-13T06:24:05,700           ********************************************************************************
2024-04-13T06:24:05,700           ############################
2024-04-13T06:24:05,701           # Package would be ignored #
2024-04-13T06:24:05,701           ############################
2024-04-13T06:24:05,702           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-04-13T06:24:05,702           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,703           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,703           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-04-13T06:24:05,704           to the `packages` configuration field.

2024-04-13T06:24:05,705           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,705           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,706           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,707           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,709           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-04-13T06:24:05,710           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-04-13T06:24:05,710           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,711           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,711           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,712           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,713           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,715           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,716                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,716                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,717                 directory, all directories are treated like packages.
2024-04-13T06:24:05,717           ********************************************************************************

2024-04-13T06:24:05,718   !!
2024-04-13T06:24:05,719     check.warn(importable)
2024-04-13T06:24:05,719   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-04-13T06:24:05,720   !!

2024-04-13T06:24:05,721           ********************************************************************************
2024-04-13T06:24:05,722           ############################
2024-04-13T06:24:05,722           # Package would be ignored #
2024-04-13T06:24:05,723           ############################
2024-04-13T06:24:05,723           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-04-13T06:24:05,724           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,725           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,725           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-04-13T06:24:05,726           to the `packages` configuration field.

2024-04-13T06:24:05,727           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,727           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,728           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,728           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,729           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,730           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-04-13T06:24:05,731           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-04-13T06:24:05,731           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,732           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,732           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,733           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,734           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,736           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,736                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,737                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,737                 directory, all directories are treated like packages.
2024-04-13T06:24:05,738           ********************************************************************************

2024-04-13T06:24:05,739   !!
2024-04-13T06:24:05,740     check.warn(importable)
2024-04-13T06:24:05,740   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-04-13T06:24:05,741   !!

2024-04-13T06:24:05,742           ********************************************************************************
2024-04-13T06:24:05,742           ############################
2024-04-13T06:24:05,743           # Package would be ignored #
2024-04-13T06:24:05,743           ############################
2024-04-13T06:24:05,744           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-04-13T06:24:05,744           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,745           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,746           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-04-13T06:24:05,746           to the `packages` configuration field.

2024-04-13T06:24:05,747           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,748           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,749           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,750           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,751           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,752           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-04-13T06:24:05,752           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-04-13T06:24:05,753           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,754           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,754           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,755           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,756           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,757           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,758                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,758                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,759                 directory, all directories are treated like packages.
2024-04-13T06:24:05,759           ********************************************************************************

2024-04-13T06:24:05,760   !!
2024-04-13T06:24:05,761     check.warn(importable)
2024-04-13T06:24:05,762   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-04-13T06:24:05,762   !!

2024-04-13T06:24:05,763           ********************************************************************************
2024-04-13T06:24:05,764           ############################
2024-04-13T06:24:05,764           # Package would be ignored #
2024-04-13T06:24:05,765           ############################
2024-04-13T06:24:05,765           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-04-13T06:24:05,766           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,767           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,767           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-04-13T06:24:05,768           to the `packages` configuration field.

2024-04-13T06:24:05,769           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,769           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,770           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,771           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,772           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,773           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-04-13T06:24:05,774           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-04-13T06:24:05,774           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,775           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,775           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,776           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,778           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,779           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,780                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,780                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,781                 directory, all directories are treated like packages.
2024-04-13T06:24:05,781           ********************************************************************************

2024-04-13T06:24:05,782   !!
2024-04-13T06:24:05,783     check.warn(importable)
2024-04-13T06:24:05,783   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-04-13T06:24:05,784   !!

2024-04-13T06:24:05,784           ********************************************************************************
2024-04-13T06:24:05,785           ############################
2024-04-13T06:24:05,785           # Package would be ignored #
2024-04-13T06:24:05,786           ############################
2024-04-13T06:24:05,786           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-04-13T06:24:05,787           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,788           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,788           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-04-13T06:24:05,789           to the `packages` configuration field.

2024-04-13T06:24:05,790           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,790           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,791           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,791           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,792           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,793           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-04-13T06:24:05,794           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-04-13T06:24:05,794           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,795           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,795           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,796           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,797           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,799                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,800                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,800                 directory, all directories are treated like packages.
2024-04-13T06:24:05,801           ********************************************************************************

2024-04-13T06:24:05,802   !!
2024-04-13T06:24:05,802     check.warn(importable)
2024-04-13T06:24:05,803   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-04-13T06:24:05,803   !!

2024-04-13T06:24:05,804           ********************************************************************************
2024-04-13T06:24:05,805           ############################
2024-04-13T06:24:05,805           # Package would be ignored #
2024-04-13T06:24:05,806           ############################
2024-04-13T06:24:05,806           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-04-13T06:24:05,807           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,808           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,809           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-04-13T06:24:05,809           to the `packages` configuration field.

2024-04-13T06:24:05,811           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,811           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,811           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,812           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,813           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,814           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-04-13T06:24:05,815           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-04-13T06:24:05,815           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,816           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,816           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,817           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,818           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,819           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,820                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,820                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,821                 directory, all directories are treated like packages.
2024-04-13T06:24:05,821           ********************************************************************************

2024-04-13T06:24:05,822   !!
2024-04-13T06:24:05,823     check.warn(importable)
2024-04-13T06:24:05,823   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-04-13T06:24:05,824   !!

2024-04-13T06:24:05,825           ********************************************************************************
2024-04-13T06:24:05,825           ############################
2024-04-13T06:24:05,826           # Package would be ignored #
2024-04-13T06:24:05,826           ############################
2024-04-13T06:24:05,827           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-04-13T06:24:05,827           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,828           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,829           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-04-13T06:24:05,829           to the `packages` configuration field.

2024-04-13T06:24:05,830           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,831           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,831           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,832           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,833           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,834           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-04-13T06:24:05,835           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-04-13T06:24:05,835           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,836           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,837           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,838           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,839           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,841           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,841                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,842                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,842                 directory, all directories are treated like packages.
2024-04-13T06:24:05,843           ********************************************************************************

2024-04-13T06:24:05,844   !!
2024-04-13T06:24:05,844     check.warn(importable)
2024-04-13T06:24:05,845   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-04-13T06:24:05,845   !!

2024-04-13T06:24:05,846           ********************************************************************************
2024-04-13T06:24:05,847           ############################
2024-04-13T06:24:05,847           # Package would be ignored #
2024-04-13T06:24:05,848           ############################
2024-04-13T06:24:05,848           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-04-13T06:24:05,849           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,850           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,850           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-04-13T06:24:05,851           to the `packages` configuration field.

2024-04-13T06:24:05,852           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,852           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,853           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,854           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,855           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,856           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-04-13T06:24:05,856           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-04-13T06:24:05,857           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,869           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,869           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,870           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,872           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,873           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,874                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,874                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,875                 directory, all directories are treated like packages.
2024-04-13T06:24:05,875           ********************************************************************************

2024-04-13T06:24:05,877   !!
2024-04-13T06:24:05,877     check.warn(importable)
2024-04-13T06:24:05,878   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-04-13T06:24:05,878   !!

2024-04-13T06:24:05,880           ********************************************************************************
2024-04-13T06:24:05,880           ############################
2024-04-13T06:24:05,881           # Package would be ignored #
2024-04-13T06:24:05,881           ############################
2024-04-13T06:24:05,882           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-04-13T06:24:05,882           but it is absent from setuptools' `packages` configuration.

2024-04-13T06:24:05,883           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-13T06:24:05,884           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-04-13T06:24:05,884           to the `packages` configuration field.

2024-04-13T06:24:05,885           Alternatively, you can also rely on setuptools' discovery methods
2024-04-13T06:24:05,886           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-13T06:24:05,886           instead of `find_packages(...)`/`find:`).

2024-04-13T06:24:05,887           You can read more about "package discovery" on setuptools documentation page:

2024-04-13T06:24:05,888           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-13T06:24:05,889           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-04-13T06:24:05,890           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-04-13T06:24:05,890           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-13T06:24:05,891           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-13T06:24:05,891           combination with a more fine grained `package-data` configuration.

2024-04-13T06:24:05,892           You can read more about "package data files" on setuptools documentation page:

2024-04-13T06:24:05,893           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-13T06:24:05,895           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-13T06:24:05,895                 even if it does not contain any `.py` files.
2024-04-13T06:24:05,896                 On the other hand, currently there is no concept of package data
2024-04-13T06:24:05,896                 directory, all directories are treated like packages.
2024-04-13T06:24:05,897           ********************************************************************************

2024-04-13T06:24:05,898   !!
2024-04-13T06:24:05,899     check.warn(importable)
2024-04-13T06:24:05,899   creating build/lib/alpaca_eval/evaluators_configs
2024-04-13T06:24:05,900   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-04-13T06:24:05,900   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:05,901   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:05,901   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:05,902   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:05,902   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:05,903   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:05,904   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:05,904   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:05,905   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:05,906   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:05,906   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:05,907   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:05,907   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-13T06:24:05,908   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-13T06:24:05,908   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-13T06:24:05,909   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-13T06:24:05,909   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:05,910   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:05,910   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:05,911   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:05,911   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:05,912   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:05,912   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,913   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,913   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,914   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,914   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,915   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,915   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,916   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,917   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,917   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,918   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,918   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,919   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,919   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:05,920   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:05,920   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:05,921   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:05,921   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:05,922   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:05,922   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:05,923   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-13T06:24:05,923   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-13T06:24:05,924   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-13T06:24:05,924   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-13T06:24:05,925   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:05,925   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:05,926   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:05,926   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:05,927   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:05,927   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:05,928   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:05,928   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:05,929   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:05,930   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-04-13T06:24:05,930   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-04-13T06:24:05,931   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:05,931   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:05,932   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:05,933   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:05,933   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:05,934   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:05,934   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-04-13T06:24:05,935   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-04-13T06:24:05,935   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:05,936   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:05,937   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:05,937   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-13T06:24:05,938   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-13T06:24:05,938   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-04-13T06:24:05,939   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-04-13T06:24:05,939   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-13T06:24:05,940   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-13T06:24:05,940   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:05,941   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:05,941   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:05,942   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:05,942   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:05,943   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:05,944   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-13T06:24:05,944   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-13T06:24:05,945   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-13T06:24:05,945   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-13T06:24:05,946   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:05,946   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:05,947   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:05,947   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-13T06:24:05,948   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-13T06:24:05,948   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-13T06:24:05,949   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-13T06:24:05,950   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:05,950   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:05,951   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:05,951   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-13T06:24:05,952   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-13T06:24:05,953   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:05,953   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:05,954   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:05,954   creating build/lib/alpaca_eval/evaluators_configs/test
2024-04-13T06:24:05,955   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-04-13T06:24:05,955   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:05,956   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:05,956   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:05,957   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-13T06:24:05,957   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-13T06:24:05,958   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-13T06:24:05,959   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-13T06:24:05,959   creating build/lib/alpaca_eval/leaderboards
2024-04-13T06:24:05,959   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:05,960   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:05,961   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:05,961   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:05,962   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:05,962   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,963   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,963   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,964   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,964   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,965   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:05,966   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-04-13T06:24:05,966   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-04-13T06:24:05,967   creating build/lib/alpaca_eval/models_configs
2024-04-13T06:24:05,967   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:05,968   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:05,968   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:05,969   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:05,969   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:05,970   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:05,970   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:05,971   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:05,971   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:05,972   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:05,973   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:05,973   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:05,974   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:05,974   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:05,975   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:05,975   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-13T06:24:05,976   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-13T06:24:05,976   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:05,977   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:05,977   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:05,978   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:05,979   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:05,979   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:05,980   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:05,980   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:05,981   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:05,981   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:05,982   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:05,983   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:05,983   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:05,984   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:05,985   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:05,985   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:05,986   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:05,986   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:05,987   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:05,987   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:05,988   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:05,988   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:05,989   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:05,989   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:05,990   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:05,990   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:05,991   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:05,991   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-13T06:24:05,992   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-13T06:24:05,992   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-13T06:24:05,993   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-13T06:24:05,993   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:05,994   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:05,994   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:05,995   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:05,995   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:05,996   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:05,996   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:05,997   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:05,998   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:05,998   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-13T06:24:05,999   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-13T06:24:05,999   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:06,000   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:06,000   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:06,001   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,002   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,002   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,003   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:06,003   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:06,004   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:06,004   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,005   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,005   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,006   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,007   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,007   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,008   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-04-13T06:24:06,008   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-04-13T06:24:06,009   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:06,009   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:06,010   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:06,010   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:06,011   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:06,011   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:06,012   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:06,013   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:06,013   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:06,014   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:06,014   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:06,015   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:06,015   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:06,016   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:06,016   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-13T06:24:06,017   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-13T06:24:06,018   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-13T06:24:06,018   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-13T06:24:06,019   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-13T06:24:06,019   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-13T06:24:06,020   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-13T06:24:06,020   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-13T06:24:06,021   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:06,021   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:06,022   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:06,022   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:06,023   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:06,023   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:06,024   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-04-13T06:24:06,024   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-04-13T06:24:06,025   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-04-13T06:24:06,025   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-04-13T06:24:06,026   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-04-13T06:24:06,026   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-04-13T06:24:06,027   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,028   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,028   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,029   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,029   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,030   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,030   creating build/lib/alpaca_eval/models_configs/claude
2024-04-13T06:24:06,031   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-04-13T06:24:06,031   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-04-13T06:24:06,032   creating build/lib/alpaca_eval/models_configs/claude-2
2024-04-13T06:24:06,032   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-04-13T06:24:06,033   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-04-13T06:24:06,033   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-04-13T06:24:06,034   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:06,034   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:06,035   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:06,036   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:06,036   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:06,036   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:06,037   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-13T06:24:06,037   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-13T06:24:06,038   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:06,038   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:06,038   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:06,039   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-04-13T06:24:06,039   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-04-13T06:24:06,040   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-13T06:24:06,040   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-13T06:24:06,042   creating build/lib/alpaca_eval/models_configs/cohere
2024-04-13T06:24:06,043   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-04-13T06:24:06,044   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-04-13T06:24:06,046   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,047   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,049   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,051   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-04-13T06:24:06,052   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-04-13T06:24:06,054   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:06,055   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:06,057   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:06,059   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-13T06:24:06,060   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-13T06:24:06,062   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-13T06:24:06,063   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-13T06:24:06,065   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-04-13T06:24:06,066   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-04-13T06:24:06,068   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-04-13T06:24:06,069   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-04-13T06:24:06,071   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-13T06:24:06,072   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-13T06:24:06,074   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-13T06:24:06,075   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-13T06:24:06,077   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:06,078   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:06,080   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:06,081   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-04-13T06:24:06,082   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-04-13T06:24:06,084   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-04-13T06:24:06,085   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-04-13T06:24:06,087   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-13T06:24:06,087   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-13T06:24:06,089   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-13T06:24:06,090   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-13T06:24:06,092   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-13T06:24:06,093   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-13T06:24:06,095   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-13T06:24:06,096   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-13T06:24:06,098   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-13T06:24:06,099   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-13T06:24:06,100   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-13T06:24:06,101   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-13T06:24:06,103   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-13T06:24:06,104   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-13T06:24:06,106   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-13T06:24:06,107   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-13T06:24:06,109   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-13T06:24:06,110   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-13T06:24:06,112   creating build/lib/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,113   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,115   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,117   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-04-13T06:24:06,118   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-04-13T06:24:06,120   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-04-13T06:24:06,121   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-04-13T06:24:06,123   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-13T06:24:06,123   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-13T06:24:06,125   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-13T06:24:06,126   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-13T06:24:06,128   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:06,129   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:06,131   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:06,133   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:06,134   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:06,136   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:06,137   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:06,138   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:06,140   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:06,142   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-04-13T06:24:06,143   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-04-13T06:24:06,145   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-04-13T06:24:06,146   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-04-13T06:24:06,148   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-04-13T06:24:06,149   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-04-13T06:24:06,151   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-04-13T06:24:06,152   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-04-13T06:24:06,154   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-04-13T06:24:06,155   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-04-13T06:24:06,157   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,158   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,160   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,162   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,163   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,165   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,167   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-13T06:24:06,168   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-13T06:24:06,170   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:06,170   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:06,172   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:06,174   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,175   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,176   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,179   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-13T06:24:06,179   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-13T06:24:06,181   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:06,182   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:06,184   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:06,186   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,187   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,189   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,191   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:06,191   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:06,193   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:06,195   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-13T06:24:06,196   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-13T06:24:06,198   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,199   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,201   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,203   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,204   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,206   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,208   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-04-13T06:24:06,209   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-04-13T06:24:06,211   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:06,212   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:06,214   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:06,216   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:06,217   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:06,219   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:06,221   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:06,222   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:06,224   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:06,225   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-13T06:24:06,226   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-13T06:24:06,228   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,229   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,231   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,233   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:06,233   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:06,235   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:06,237   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:06,238   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:06,240   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:06,242   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,243   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,245   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,247   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:06,248   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:06,250   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:06,252   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:06,253   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:06,255   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:06,257   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:06,258   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:06,260   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:06,262   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:06,263   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:06,265   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:06,267   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,268   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,270   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,272   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-04-13T06:24:06,272   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-04-13T06:24:06,274   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-13T06:24:06,275   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-13T06:24:06,277   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-13T06:24:06,278   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-13T06:24:06,280   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-04-13T06:24:06,281   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-04-13T06:24:06,283   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-04-13T06:24:06,284   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-04-13T06:24:06,286   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-13T06:24:06,286   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-13T06:24:06,288   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-13T06:24:06,289   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-13T06:24:06,291   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:06,292   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:06,295   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:06,296   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-13T06:24:06,297   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-13T06:24:06,300   creating build/lib/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:06,301   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:06,303   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:06,305   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:06,306   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:06,308   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:06,310   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:06,311   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:06,313   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:06,315   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:06,316   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:06,318   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:06,319   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-13T06:24:06,320   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-13T06:24:06,322   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-13T06:24:06,323   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-13T06:24:06,325   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-13T06:24:06,326   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-13T06:24:06,328   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-04-13T06:24:06,328   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-04-13T06:24:06,330   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:06,331   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:06,333   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:06,335   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-13T06:24:06,336   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-13T06:24:06,338   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:06,339   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:06,341   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:06,343   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-13T06:24:06,344   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-13T06:24:06,346   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:06,347   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:06,349   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:06,351   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:06,352   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:06,354   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:06,356   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:06,357   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:06,359   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:06,361   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,362   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,364   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,366   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-04-13T06:24:06,367   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-04-13T06:24:06,369   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-13T06:24:06,370   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-13T06:24:06,372   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-13T06:24:06,373   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-13T06:24:06,375   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-13T06:24:06,375   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-13T06:24:06,377   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:06,378   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:06,381   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:06,383   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-13T06:24:06,383   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-13T06:24:06,385   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-13T06:24:06,386   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-13T06:24:06,388   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:06,389   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:06,391   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:06,393   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-13T06:24:06,394   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-13T06:24:06,396   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-13T06:24:06,397   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-13T06:24:06,399   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-04-13T06:24:06,400   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-04-13T06:24:06,402   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-13T06:24:06,403   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-13T06:24:06,405   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-13T06:24:06,406   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-13T06:24:06,408   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-13T06:24:06,410   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-13T06:24:06,411   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:06,412   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:06,414   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:06,416   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:06,417   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:06,419   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:06,421   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-13T06:24:06,422   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-13T06:24:06,451   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-04-13T06:24:06,451   !!

2024-04-13T06:24:06,452           ********************************************************************************
2024-04-13T06:24:06,452           Please avoid running ``setup.py`` directly.
2024-04-13T06:24:06,453           Instead, use pypa/build, pypa/installer or other
2024-04-13T06:24:06,453           standards-based tools.

2024-04-13T06:24:06,454           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-04-13T06:24:06,455           ********************************************************************************

2024-04-13T06:24:06,456   !!
2024-04-13T06:24:06,456     self.initialize_options()
2024-04-13T06:24:06,475   installing to build/bdist.linux-armv7l/wheel
2024-04-13T06:24:06,476   running install
2024-04-13T06:24:06,500   running install_lib
2024-04-13T06:24:06,525   creating build/bdist.linux-armv7l
2024-04-13T06:24:06,525   creating build/bdist.linux-armv7l/wheel
2024-04-13T06:24:06,527   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,528   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-04-13T06:24:06,532   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-13T06:24:06,534   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-13T06:24:06,536   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:06,537   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:06,539   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-13T06:24:06,541   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:06,542   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:06,544   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-13T06:24:06,546   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-13T06:24:06,547   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-13T06:24:06,550   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:06,551   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:06,553   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-13T06:24:06,555   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-04-13T06:24:06,556   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-04-13T06:24:06,558   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-04-13T06:24:06,559   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-04-13T06:24:06,561   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:06,562   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:06,563   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-13T06:24:06,565   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:06,566   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:06,569   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-13T06:24:06,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:06,572   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:06,574   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-13T06:24:06,576   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:06,577   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:06,579   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-13T06:24:06,581   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-13T06:24:06,582   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-13T06:24:06,585   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-13T06:24:06,586   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-13T06:24:06,588   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-13T06:24:06,589   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-13T06:24:06,591   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-13T06:24:06,592   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-13T06:24:06,595   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-13T06:24:06,596   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-13T06:24:06,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:06,599   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:06,601   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-13T06:24:06,603   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-13T06:24:06,604   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-13T06:24:06,606   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:06,607   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:06,609   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-13T06:24:06,611   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-13T06:24:06,612   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-13T06:24:06,614   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:06,615   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:06,617   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-13T06:24:06,619   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,620   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,622   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,624   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,626   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,628   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,630   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,632   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,635   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,637   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,639   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,641   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,643   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,646   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-13T06:24:06,648   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-13T06:24:06,649   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-13T06:24:06,651   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-04-13T06:24:06,652   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-04-13T06:24:06,655   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-13T06:24:06,656   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-13T06:24:06,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:06,659   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:06,661   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-13T06:24:06,663   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:06,664   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:06,666   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-13T06:24:06,668   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:06,669   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:06,671   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-13T06:24:06,674   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:06,675   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:06,677   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-13T06:24:06,679   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-13T06:24:06,680   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-13T06:24:06,682   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-04-13T06:24:06,685   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:06,685   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:06,687   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-13T06:24:06,690   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-04-13T06:24:06,690   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-04-13T06:24:06,693   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:06,693   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:06,695   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-13T06:24:06,697   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:06,698   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:06,700   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-13T06:24:06,702   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:06,703   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:06,705   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-13T06:24:06,708   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-13T06:24:06,709   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-13T06:24:06,711   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:06,712   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:06,714   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-13T06:24:06,716   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:06,717   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:06,719   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-13T06:24:06,721   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,723   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-04-13T06:24:06,724   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,726   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,728   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,730   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,732   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,734   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-13T06:24:06,736   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:06,736   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:06,738   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:06,740   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:06,742   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-13T06:24:06,745   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-04-13T06:24:06,746   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-04-13T06:24:06,748   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,755   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,758   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-13T06:24:06,759   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-13T06:24:06,761   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-13T06:24:06,763   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-13T06:24:06,764   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-13T06:24:06,767   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,770   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,773   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,775   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,778   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,779   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,781   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,783   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,785   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,787   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,789   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,791   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,793   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,795   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,797   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,799   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-13T06:24:06,801   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-13T06:24:06,802   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-13T06:24:06,804   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-13T06:24:06,807   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-13T06:24:06,809   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-13T06:24:06,814   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-04-13T06:24:06,815   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-04-13T06:24:06,816   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-04-13T06:24:06,819   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-04-13T06:24:06,820   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-04-13T06:24:06,822   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-04-13T06:24:06,823   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-04-13T06:24:06,825   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,826   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,828   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-13T06:24:06,830   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-13T06:24:06,831   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-13T06:24:06,833   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-13T06:24:06,834   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-13T06:24:06,837   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:06,838   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:06,840   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-13T06:24:06,842   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,843   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,845   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-13T06:24:06,847   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,848   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,850   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-13T06:24:06,852   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,852   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,854   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-13T06:24:06,856   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-04-13T06:24:06,857   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-04-13T06:24:06,859   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,860   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,862   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-13T06:24:06,864   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-04-13T06:24:06,865   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-04-13T06:24:06,867   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-13T06:24:06,868   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-13T06:24:06,871   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-13T06:24:06,871   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-13T06:24:06,874   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,875   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,877   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-13T06:24:06,879   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-04-13T06:24:06,880   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-04-13T06:24:06,882   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-04-13T06:24:06,883   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-04-13T06:24:06,886   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-13T06:24:06,887   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-13T06:24:06,889   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:06,890   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:06,892   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-13T06:24:06,894   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,895   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,897   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-13T06:24:06,899   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,900   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,902   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-13T06:24:06,904   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-04-13T06:24:06,905   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-04-13T06:24:06,907   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,908   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,910   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-13T06:24:06,912   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,913   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,915   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-13T06:24:06,917   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,918   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,920   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-13T06:24:06,922   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-13T06:24:06,923   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-13T06:24:06,925   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-13T06:24:06,926   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-13T06:24:06,929   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-13T06:24:06,929   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-13T06:24:06,932   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:06,933   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:06,935   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-13T06:24:06,937   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,938   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,940   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-13T06:24:06,942   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,943   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,945   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-13T06:24:06,947   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-13T06:24:06,948   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-13T06:24:06,950   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,951   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,953   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-13T06:24:06,955   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-04-13T06:24:06,956   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-04-13T06:24:06,958   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-04-13T06:24:06,959   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-04-13T06:24:06,961   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-04-13T06:24:06,962   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-04-13T06:24:06,964   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,965   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,967   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-13T06:24:06,970   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,971   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,972   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-13T06:24:06,975   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:06,976   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:06,978   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-13T06:24:06,980   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-13T06:24:06,981   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-13T06:24:06,984   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-13T06:24:06,984   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-13T06:24:06,986   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:06,987   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:06,989   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-13T06:24:06,991   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-13T06:24:06,992   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-13T06:24:06,994   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,995   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,997   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-13T06:24:06,999   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:07,000   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:07,002   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-13T06:24:07,004   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-13T06:24:07,005   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-13T06:24:07,007   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:07,008   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:07,010   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-13T06:24:07,012   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:07,013   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:07,015   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-13T06:24:07,017   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-04-13T06:24:07,018   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-04-13T06:24:07,021   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-13T06:24:07,022   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-13T06:24:07,024   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-13T06:24:07,025   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-13T06:24:07,027   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-13T06:24:07,028   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-13T06:24:07,030   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-13T06:24:07,031   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-13T06:24:07,033   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:07,034   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:07,035   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-13T06:24:07,038   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:07,039   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:07,040   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-13T06:24:07,042   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-13T06:24:07,043   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-13T06:24:07,046   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:07,047   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:07,049   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-13T06:24:07,051   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:07,052   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:07,054   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-13T06:24:07,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-13T06:24:07,057   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-13T06:24:07,060   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-13T06:24:07,061   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-13T06:24:07,063   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:07,064   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:07,066   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-13T06:24:07,068   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-13T06:24:07,069   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-13T06:24:07,071   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-13T06:24:07,072   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-13T06:24:07,074   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:07,075   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:07,077   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-13T06:24:07,080   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-13T06:24:07,080   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-13T06:24:07,083   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-13T06:24:07,084   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-13T06:24:07,086   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:07,087   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:07,089   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-13T06:24:07,091   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-13T06:24:07,092   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-13T06:24:07,094   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-04-13T06:24:07,095   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-04-13T06:24:07,097   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-04-13T06:24:07,098   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-04-13T06:24:07,101   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:07,101   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:07,103   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-13T06:24:07,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-13T06:24:07,107   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-13T06:24:07,109   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-13T06:24:07,110   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-13T06:24:07,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:07,113   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:07,115   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-13T06:24:07,117   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:07,118   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:07,120   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-13T06:24:07,122   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:07,123   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:07,125   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-13T06:24:07,127   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:07,128   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:07,130   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-13T06:24:07,132   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-13T06:24:07,133   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-13T06:24:07,135   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-13T06:24:07,136   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-13T06:24:07,138   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:07,139   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:07,141   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-13T06:24:07,143   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-13T06:24:07,144   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-13T06:24:07,147   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-13T06:24:07,148   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-13T06:24:07,150   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-13T06:24:07,152   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-04-13T06:24:07,153   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-04-13T06:24:07,155   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-13T06:24:07,156   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-13T06:24:07,159   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:07,159   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:07,161   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-13T06:24:07,163   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:07,164   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:07,166   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-13T06:24:07,169   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-13T06:24:07,169   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-13T06:24:07,172   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:07,173   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:07,175   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-13T06:24:07,177   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:07,178   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:07,180   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-13T06:24:07,182   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-13T06:24:07,183   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-13T06:24:07,185   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-13T06:24:07,186   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-13T06:24:07,188   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-13T06:24:07,189   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-13T06:24:07,192   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-04-13T06:24:07,192   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-04-13T06:24:07,195   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:07,196   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:07,198   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-13T06:24:07,200   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:07,201   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:07,203   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-13T06:24:07,205   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:07,206   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:07,207   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-13T06:24:07,210   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-04-13T06:24:07,210   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-04-13T06:24:07,213   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-13T06:24:07,214   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-13T06:24:07,216   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-04-13T06:24:07,217   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-04-13T06:24:07,219   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:07,220   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:07,222   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-13T06:24:07,224   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:07,225   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:07,227   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:07,229   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-13T06:24:07,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:07,232   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:07,234   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-13T06:24:07,236   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-13T06:24:07,237   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-13T06:24:07,239   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:07,240   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:07,242   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-13T06:24:07,244   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:07,245   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:07,247   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-13T06:24:07,249   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:07,250   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:07,252   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-13T06:24:07,254   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-04-13T06:24:07,255   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-04-13T06:24:07,257   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-13T06:24:07,258   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-13T06:24:07,260   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:07,261   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:07,263   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-13T06:24:07,265   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-13T06:24:07,266   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-13T06:24:07,269   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:07,269   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:07,272   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-13T06:24:07,274   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:07,275   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:07,278   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-13T06:24:07,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:07,281   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:07,283   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-13T06:24:07,285   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-04-13T06:24:07,286   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-04-13T06:24:07,288   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:07,289   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:07,291   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-13T06:24:07,293   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:07,294   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:07,296   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-13T06:24:07,298   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-13T06:24:07,299   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-13T06:24:07,301   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-13T06:24:07,302   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-13T06:24:07,304   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-13T06:24:07,305   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-13T06:24:07,308   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-13T06:24:07,309   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-13T06:24:07,311   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-13T06:24:07,312   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-13T06:24:07,314   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:07,315   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:07,317   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-13T06:24:07,319   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:07,320   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:07,322   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-13T06:24:07,324   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:07,325   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:07,327   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-13T06:24:07,330   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:07,330   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:07,332   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-13T06:24:07,334   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-13T06:24:07,335   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-13T06:24:07,337   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-13T06:24:07,338   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-13T06:24:07,340   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:07,341   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:07,343   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:07,345   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-13T06:24:07,347   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-04-13T06:24:07,348   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-04-13T06:24:07,350   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-04-13T06:24:07,351   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-04-13T06:24:07,353   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:07,354   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:07,356   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-13T06:24:07,358   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:07,359   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:07,361   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-13T06:24:07,363   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-04-13T06:24:07,364   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-04-13T06:24:07,366   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:07,367   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:07,369   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-13T06:24:07,371   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-04-13T06:24:07,372   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-04-13T06:24:07,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-04-13T06:24:07,375   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-04-13T06:24:07,377   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:07,378   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:07,380   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-13T06:24:07,382   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:07,383   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:07,385   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-13T06:24:07,387   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:07,388   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:07,390   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-13T06:24:07,392   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:07,393   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:07,395   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-13T06:24:07,397   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:07,398   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:07,400   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-13T06:24:07,402   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:07,403   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:07,405   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-13T06:24:07,408   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:07,409   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:07,411   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-13T06:24:07,413   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:07,414   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:07,415   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-13T06:24:07,418   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-13T06:24:07,419   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-13T06:24:07,421   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-04-13T06:24:07,422   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-04-13T06:24:07,424   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:07,425   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:07,427   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-13T06:24:07,429   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-13T06:24:07,430   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-13T06:24:07,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-13T06:24:07,433   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-13T06:24:07,435   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-13T06:24:07,437   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:07,438   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:07,440   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-13T06:24:07,442   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-13T06:24:07,443   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-13T06:24:07,445   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:07,446   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:07,448   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-13T06:24:07,451   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-13T06:24:07,452   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-13T06:24:07,453   running install_egg_info
2024-04-13T06:24:07,487   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.1-py3.11.egg-info
2024-04-13T06:24:07,502   running install_scripts
2024-04-13T06:24:07,541   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.1.dist-info/WHEEL
2024-04-13T06:24:07,543   creating '/tmp/pip-wheel-ql1a60sn/alpaca_eval-0.6.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-04-13T06:24:07,545   adding 'alpaca_eval/__init__.py'
2024-04-13T06:24:07,548   adding 'alpaca_eval/analyze.py'
2024-04-13T06:24:07,550   adding 'alpaca_eval/completion_parsers.py'
2024-04-13T06:24:07,552   adding 'alpaca_eval/constants.py'
2024-04-13T06:24:07,555   adding 'alpaca_eval/main.py'
2024-04-13T06:24:07,559   adding 'alpaca_eval/plotting.py'
2024-04-13T06:24:07,561   adding 'alpaca_eval/processors.py'
2024-04-13T06:24:07,563   adding 'alpaca_eval/types.py'
2024-04-13T06:24:07,566   adding 'alpaca_eval/utils.py'
2024-04-13T06:24:07,567   adding 'alpaca_eval/annotators/__init__.py'
2024-04-13T06:24:07,572   adding 'alpaca_eval/annotators/base.py'
2024-04-13T06:24:07,574   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-04-13T06:24:07,576   adding 'alpaca_eval/decoders/__init__.py'
2024-04-13T06:24:07,578   adding 'alpaca_eval/decoders/anthropic.py'
2024-04-13T06:24:07,579   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-04-13T06:24:07,581   adding 'alpaca_eval/decoders/cohere.py'
2024-04-13T06:24:07,582   adding 'alpaca_eval/decoders/google.py'
2024-04-13T06:24:07,583   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-04-13T06:24:07,585   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-04-13T06:24:07,586   adding 'alpaca_eval/decoders/jinachat.py'
2024-04-13T06:24:07,589   adding 'alpaca_eval/decoders/openai.py'
2024-04-13T06:24:07,590   adding 'alpaca_eval/decoders/replicate.py'
2024-04-13T06:24:07,592   adding 'alpaca_eval/decoders/vllm_local.py'
2024-04-13T06:24:07,594   adding 'alpaca_eval/evaluators_configs/README.md'
2024-04-13T06:24:07,596   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-04-13T06:24:07,597   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-04-13T06:24:07,599   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-04-13T06:24:07,600   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-04-13T06:24:07,602   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-04-13T06:24:07,603   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-04-13T06:24:07,605   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-04-13T06:24:07,606   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-04-13T06:24:07,608   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-04-13T06:24:07,609   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-04-13T06:24:07,611   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-04-13T06:24:07,612   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-04-13T06:24:07,614   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-04-13T06:24:07,615   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-04-13T06:24:07,617   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-04-13T06:24:07,618   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-04-13T06:24:07,620   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-04-13T06:24:07,621   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-04-13T06:24:07,622   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-04-13T06:24:07,624   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-04-13T06:24:07,626   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-04-13T06:24:07,627   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-04-13T06:24:07,629   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-04-13T06:24:07,630   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-04-13T06:24:07,631   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-04-13T06:24:07,632   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-04-13T06:24:07,634   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-04-13T06:24:07,636   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-04-13T06:24:07,637   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-04-13T06:24:07,639   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-04-13T06:24:07,640   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-04-13T06:24:07,642   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-04-13T06:24:07,643   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-04-13T06:24:07,645   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-04-13T06:24:07,646   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-04-13T06:24:07,647   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-04-13T06:24:07,649   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-04-13T06:24:07,650   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-04-13T06:24:07,651   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-04-13T06:24:07,653   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-04-13T06:24:07,655   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-04-13T06:24:07,656   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-04-13T06:24:07,658   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-04-13T06:24:07,659   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-04-13T06:24:07,660   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-04-13T06:24:07,662   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-04-13T06:24:07,663   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-04-13T06:24:07,665   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-04-13T06:24:07,666   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-04-13T06:24:07,668   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-04-13T06:24:07,670   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-04-13T06:24:07,671   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-04-13T06:24:07,673   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-04-13T06:24:07,674   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-04-13T06:24:07,675   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-04-13T06:24:07,677   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-04-13T06:24:07,679   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-04-13T06:24:07,680   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-04-13T06:24:07,682   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-04-13T06:24:07,683   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-04-13T06:24:07,685   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-04-13T06:24:07,686   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-04-13T06:24:07,688   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-04-13T06:24:07,689   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-04-13T06:24:07,690   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-04-13T06:24:07,692   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-04-13T06:24:07,693   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-04-13T06:24:07,695   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-04-13T06:24:07,696   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-04-13T06:24:07,698   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-04-13T06:24:07,700   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-04-13T06:24:07,702   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-04-13T06:24:07,703   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-04-13T06:24:07,704   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-04-13T06:24:07,706   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-04-13T06:24:07,707   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-04-13T06:24:07,708   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-04-13T06:24:07,709   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-04-13T06:24:07,712   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-04-13T06:24:07,714   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-04-13T06:24:07,716   adding 'alpaca_eval/metrics/__init__.py'
2024-04-13T06:24:07,718   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-04-13T06:24:07,719   adding 'alpaca_eval/metrics/helpers.py'
2024-04-13T06:24:07,721   adding 'alpaca_eval/metrics/winrate.py'
2024-04-13T06:24:07,725   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-04-13T06:24:07,726   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-04-13T06:24:07,728   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-04-13T06:24:07,729   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-04-13T06:24:07,731   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-04-13T06:24:07,732   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-04-13T06:24:07,734   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-04-13T06:24:07,735   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-04-13T06:24:07,737   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-04-13T06:24:07,738   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-04-13T06:24:07,739   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-04-13T06:24:07,741   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-04-13T06:24:07,742   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-04-13T06:24:07,744   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-04-13T06:24:07,745   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-04-13T06:24:07,747   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-04-13T06:24:07,748   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-04-13T06:24:07,750   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-04-13T06:24:07,751   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-04-13T06:24:07,752   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-04-13T06:24:07,753   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-04-13T06:24:07,755   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-04-13T06:24:07,756   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-04-13T06:24:07,757   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-04-13T06:24:07,758   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-04-13T06:24:07,760   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-04-13T06:24:07,761   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-04-13T06:24:07,762   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-04-13T06:24:07,763   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-04-13T06:24:07,765   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-04-13T06:24:07,766   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-04-13T06:24:07,768   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-04-13T06:24:07,769   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-04-13T06:24:07,771   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-04-13T06:24:07,772   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-04-13T06:24:07,773   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-04-13T06:24:07,774   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-04-13T06:24:07,776   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-04-13T06:24:07,778   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-04-13T06:24:07,779   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-04-13T06:24:07,780   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-04-13T06:24:07,782   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-04-13T06:24:07,783   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-04-13T06:24:07,784   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-04-13T06:24:07,786   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-04-13T06:24:07,787   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-04-13T06:24:07,789   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-04-13T06:24:07,790   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-04-13T06:24:07,792   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-04-13T06:24:07,793   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-04-13T06:24:07,794   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-04-13T06:24:07,796   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-04-13T06:24:07,797   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-04-13T06:24:07,798   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-04-13T06:24:07,799   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-04-13T06:24:07,801   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-04-13T06:24:07,802   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-04-13T06:24:07,804   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-04-13T06:24:07,805   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-04-13T06:24:07,807   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-04-13T06:24:07,808   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-04-13T06:24:07,810   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-04-13T06:24:07,812   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-04-13T06:24:07,813   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-04-13T06:24:07,814   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-04-13T06:24:07,816   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-04-13T06:24:07,817   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-04-13T06:24:07,818   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-04-13T06:24:07,820   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-04-13T06:24:07,822   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-04-13T06:24:07,823   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-04-13T06:24:07,824   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-04-13T06:24:07,826   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-04-13T06:24:07,827   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-04-13T06:24:07,828   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-04-13T06:24:07,829   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-04-13T06:24:07,831   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-04-13T06:24:07,832   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-04-13T06:24:07,834   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-04-13T06:24:07,835   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-04-13T06:24:07,837   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-04-13T06:24:07,838   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-04-13T06:24:07,839   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-04-13T06:24:07,841   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-04-13T06:24:07,842   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-04-13T06:24:07,844   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-04-13T06:24:07,845   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-04-13T06:24:07,846   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-04-13T06:24:07,848   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-04-13T06:24:07,849   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-04-13T06:24:07,850   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-04-13T06:24:07,852   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-04-13T06:24:07,854   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-04-13T06:24:07,855   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-04-13T06:24:07,856   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-04-13T06:24:07,858   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-04-13T06:24:07,860   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-04-13T06:24:07,861   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-04-13T06:24:07,863   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-04-13T06:24:07,864   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-04-13T06:24:07,866   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-04-13T06:24:07,867   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-04-13T06:24:07,869   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-04-13T06:24:07,870   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-04-13T06:24:07,872   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-04-13T06:24:07,873   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-04-13T06:24:07,875   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-04-13T06:24:07,877   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-04-13T06:24:07,878   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-04-13T06:24:07,880   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-04-13T06:24:07,881   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-04-13T06:24:07,883   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-04-13T06:24:07,884   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-04-13T06:24:07,885   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-04-13T06:24:07,886   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-04-13T06:24:07,888   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-04-13T06:24:07,890   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-04-13T06:24:07,891   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-04-13T06:24:07,892   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-04-13T06:24:07,894   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-04-13T06:24:07,895   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-04-13T06:24:07,896   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-04-13T06:24:07,897   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-04-13T06:24:07,899   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-04-13T06:24:07,900   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-04-13T06:24:07,902   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-04-13T06:24:07,904   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-04-13T06:24:07,905   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-04-13T06:24:07,907   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-04-13T06:24:07,908   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-04-13T06:24:07,910   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-04-13T06:24:07,911   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-04-13T06:24:07,913   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-04-13T06:24:07,914   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-04-13T06:24:07,915   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-04-13T06:24:07,917   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-04-13T06:24:07,918   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-04-13T06:24:07,920   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-04-13T06:24:07,921   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-04-13T06:24:07,922   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-04-13T06:24:07,924   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-04-13T06:24:07,925   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-04-13T06:24:07,927   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-04-13T06:24:07,928   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-04-13T06:24:07,930   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-04-13T06:24:07,931   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-04-13T06:24:07,932   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-04-13T06:24:07,934   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-04-13T06:24:07,935   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-04-13T06:24:07,937   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-04-13T06:24:07,938   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-04-13T06:24:07,940   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-04-13T06:24:07,941   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-04-13T06:24:07,942   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-04-13T06:24:07,944   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-04-13T06:24:07,944   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-04-13T06:24:07,946   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-04-13T06:24:07,947   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-04-13T06:24:07,949   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-04-13T06:24:07,950   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-04-13T06:24:07,951   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-04-13T06:24:07,953   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-04-13T06:24:07,954   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-04-13T06:24:07,955   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-04-13T06:24:07,957   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-04-13T06:24:07,958   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-04-13T06:24:07,959   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-04-13T06:24:07,961   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-04-13T06:24:07,962   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-04-13T06:24:07,964   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-04-13T06:24:07,965   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-04-13T06:24:07,967   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-04-13T06:24:07,968   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-04-13T06:24:07,970   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-04-13T06:24:07,971   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-04-13T06:24:07,972   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-04-13T06:24:07,973   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-04-13T06:24:07,975   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-04-13T06:24:07,977   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-04-13T06:24:07,978   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-04-13T06:24:07,980   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-04-13T06:24:07,981   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-04-13T06:24:07,983   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-04-13T06:24:07,985   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-04-13T06:24:07,986   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-04-13T06:24:07,988   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-04-13T06:24:07,989   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-04-13T06:24:07,991   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-04-13T06:24:07,992   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-04-13T06:24:07,994   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-04-13T06:24:07,995   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-04-13T06:24:07,996   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-04-13T06:24:07,998   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-04-13T06:24:08,000   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-04-13T06:24:08,001   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-04-13T06:24:08,002   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-04-13T06:24:08,004   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-04-13T06:24:08,005   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-04-13T06:24:08,007   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-04-13T06:24:08,008   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-04-13T06:24:08,009   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-04-13T06:24:08,011   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-04-13T06:24:08,012   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-04-13T06:24:08,013   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-04-13T06:24:08,015   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-04-13T06:24:08,016   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-04-13T06:24:08,017   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-04-13T06:24:08,019   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-04-13T06:24:08,020   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-04-13T06:24:08,022   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-04-13T06:24:08,023   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-04-13T06:24:08,024   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-04-13T06:24:08,029   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-04-13T06:24:08,030   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-04-13T06:24:08,032   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-04-13T06:24:08,034   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-04-13T06:24:08,035   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-04-13T06:24:08,037   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-04-13T06:24:08,038   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-04-13T06:24:08,039   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-04-13T06:24:08,041   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-04-13T06:24:08,042   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-04-13T06:24:08,043   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-04-13T06:24:08,045   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-04-13T06:24:08,047   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-04-13T06:24:08,048   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-04-13T06:24:08,050   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-04-13T06:24:08,052   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-04-13T06:24:08,053   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-04-13T06:24:08,055   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-04-13T06:24:08,056   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-04-13T06:24:08,058   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-04-13T06:24:08,059   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-04-13T06:24:08,061   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-04-13T06:24:08,064   adding 'alpaca_eval-0.6.1.dist-info/LICENSE'
2024-04-13T06:24:08,076   adding 'alpaca_eval-0.6.1.dist-info/METADATA'
2024-04-13T06:24:08,077   adding 'alpaca_eval-0.6.1.dist-info/WHEEL'
2024-04-13T06:24:08,078   adding 'alpaca_eval-0.6.1.dist-info/entry_points.txt'
2024-04-13T06:24:08,079   adding 'alpaca_eval-0.6.1.dist-info/top_level.txt'
2024-04-13T06:24:08,085   adding 'alpaca_eval-0.6.1.dist-info/RECORD'
2024-04-13T06:24:08,093   removing build/bdist.linux-armv7l/wheel
2024-04-13T06:24:08,360   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-04-13T06:24:08,366   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.1-py3-none-any.whl size=292187 sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8
2024-04-13T06:24:08,367   Stored in directory: /tmp/pip-ephem-wheel-cache-d3834ebw/wheels/8f/b9/7a/b981924f7930e4e61c94be884564e35cac048e3c3a086237cf
2024-04-13T06:24:08,403 Successfully built alpaca-eval
2024-04-13T06:24:08,416 Removed build tracker: '/tmp/pip-build-tracker-0aus4zgi'