2024-06-24T01:19:25,660 Created temporary directory: /tmp/pip-build-tracker-b8ihxdkz
2024-06-24T01:19:25,661 Initialized build tracking at /tmp/pip-build-tracker-b8ihxdkz
2024-06-24T01:19:25,662 Created build tracker: /tmp/pip-build-tracker-b8ihxdkz
2024-06-24T01:19:25,662 Entered build tracker: /tmp/pip-build-tracker-b8ihxdkz
2024-06-24T01:19:25,663 Created temporary directory: /tmp/pip-wheel-dwr7gll8
2024-06-24T01:19:25,666 Created temporary directory: /tmp/pip-ephem-wheel-cache-zlwsasyr
2024-06-24T01:19:25,688 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-06-24T01:19:25,691 2 location(s) to search for versions of alpaca-eval:
2024-06-24T01:19:25,691 * https://pypi.org/simple/alpaca-eval/
2024-06-24T01:19:25,691 * https://www.piwheels.org/simple/alpaca-eval/
2024-06-24T01:19:25,692 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-06-24T01:19:25,693 Getting page https://pypi.org/simple/alpaca-eval/
2024-06-24T01:19:25,694 Found index url https://pypi.org/simple/
2024-06-24T01:19:25,912 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-06-24T01:19:25,925   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:25,926   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-06-24T01:19:25,927   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:25,928   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-06-24T01:19:25,928   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:25,929   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-06-24T01:19:25,930   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,931   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-06-24T01:19:25,932   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,933   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-06-24T01:19:25,934   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,935   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-06-24T01:19:25,936   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,936   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-06-24T01:19:25,937   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,938   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-06-24T01:19:25,938   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,939   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-06-24T01:19:25,940   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,941   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-06-24T01:19:25,942   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,943   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-06-24T01:19:25,944   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,944   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-06-24T01:19:25,945   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,946   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-06-24T01:19:25,947   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,948   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-06-24T01:19:25,949   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,949   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-06-24T01:19:25,950   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,951   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-06-24T01:19:25,951   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,952   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-06-24T01:19:25,953   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,954   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-06-24T01:19:25,955   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,956   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-06-24T01:19:25,956   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,957   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-06-24T01:19:25,958   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,959   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-06-24T01:19:25,960   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,961   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-06-24T01:19:25,961   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,962   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-06-24T01:19:25,963   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,963   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-06-24T01:19:25,964   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,965   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-06-24T01:19:25,966   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,967   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-06-24T01:19:25,968   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,969   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-06-24T01:19:25,969   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,970   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-06-24T01:19:25,971   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,972   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-06-24T01:19:25,973   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,974   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-06-24T01:19:25,974   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,975   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-06-24T01:19:25,975   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,976   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-06-24T01:19:25,977   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ea/4d/9b44ccd56c4f7579c9e4b6886096daa1ad6d75019e4a2b03f0b94476a623/alpaca_eval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,978   Found link https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.2
2024-06-24T01:19:25,978   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/94/e2/86131f32b7f7d5b1b400e08393d8b3c490a893e9bb8139313cb93c23369d/alpaca_eval-0.6.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:25,979   Found link https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.3
2024-06-24T01:19:25,980 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-06-24T01:19:25,981 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-06-24T01:19:25,982 Found index url https://www.piwheels.org/simple/
2024-06-24T01:19:26,176 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-06-24T01:19:26,185   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.2-py3-none-any.whl#sha256=f93aa4f39f46ac56b280e9c6249815ad57fb21f6f676abcf76640e872d4a1832 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,185   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.1-py3-none-any.whl#sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,186   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,187   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,187   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,188   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,188   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,189   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,189   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,189   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,190   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,191   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,191   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,192   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,192   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,193   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,194   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,194   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,195   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,195   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,196   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,196   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,196   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,197   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,197   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,198   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-06-24T01:19:26,199   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:26,199   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:26,200   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-06-24T01:19:26,200 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-06-24T01:19:26,201 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-06-24T01:19:26,225 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-06-24T01:19:26,245 Collecting alpaca-eval==0.6.3
2024-06-24T01:19:26,247   Created temporary directory: /tmp/pip-unpack-hkw_rsgm
2024-06-24T01:19:26,483   Downloading alpaca_eval-0.6.3.tar.gz (377 kB)
2024-06-24T01:19:27,945   Added alpaca-eval==0.6.3 from https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz to build tracker '/tmp/pip-build-tracker-b8ihxdkz'
2024-06-24T01:19:27,947   Running setup.py (path:/tmp/pip-wheel-dwr7gll8/alpaca-eval_12522c783f4d4f469dc30d32eb0f92d8/setup.py) egg_info for package alpaca-eval
2024-06-24T01:19:27,948   Created temporary directory: /tmp/pip-pip-egg-info-ipfokork
2024-06-24T01:19:27,948   Preparing metadata (setup.py): started
2024-06-24T01:19:27,949   Running command python setup.py egg_info
2024-06-24T01:19:29,065   running egg_info
2024-06-24T01:19:29,066   creating /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info
2024-06-24T01:19:29,091   writing /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/PKG-INFO
2024-06-24T01:19:29,113   writing dependency_links to /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/dependency_links.txt
2024-06-24T01:19:29,114   writing entry points to /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/entry_points.txt
2024-06-24T01:19:29,124   writing requirements to /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/requires.txt
2024-06-24T01:19:29,125   writing top-level names to /tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/top_level.txt
2024-06-24T01:19:29,127   writing manifest file '/tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/SOURCES.txt'
2024-06-24T01:19:29,212   reading manifest file '/tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/SOURCES.txt'
2024-06-24T01:19:29,213   reading manifest template 'MANIFEST.in'
2024-06-24T01:19:29,458   adding license file 'LICENSE'
2024-06-24T01:19:29,473   writing manifest file '/tmp/pip-pip-egg-info-ipfokork/alpaca_eval.egg-info/SOURCES.txt'
2024-06-24T01:19:29,593   Preparing metadata (setup.py): finished with status 'done'
2024-06-24T01:19:29,602   Source in /tmp/pip-wheel-dwr7gll8/alpaca-eval_12522c783f4d4f469dc30d32eb0f92d8 has version 0.6.3, which satisfies requirement alpaca-eval==0.6.3 from https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz
2024-06-24T01:19:29,603   Removed alpaca-eval==0.6.3 from https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz from build tracker '/tmp/pip-build-tracker-b8ihxdkz'
2024-06-24T01:19:29,618 Created temporary directory: /tmp/pip-unpack-law1idee
2024-06-24T01:19:29,619 Created temporary directory: /tmp/pip-unpack-5u12mnut
2024-06-24T01:19:29,772 Building wheels for collected packages: alpaca-eval
2024-06-24T01:19:29,776   Created temporary directory: /tmp/pip-wheel-0oghweyw
2024-06-24T01:19:29,776   Building wheel for alpaca-eval (setup.py): started
2024-06-24T01:19:29,777   Destination directory: /tmp/pip-wheel-0oghweyw
2024-06-24T01:19:29,778   Running command python setup.py bdist_wheel
2024-06-24T01:19:30,859   running bdist_wheel
2024-06-24T01:19:31,169   running build
2024-06-24T01:19:31,170   running build_py
2024-06-24T01:19:31,198   creating build
2024-06-24T01:19:31,198   creating build/lib
2024-06-24T01:19:31,199   creating build/lib/alpaca_eval
2024-06-24T01:19:31,201   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,203   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,206   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,207   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,209   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,211   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,213   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,216   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,218   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-06-24T01:19:31,221   creating build/lib/alpaca_eval/annotators
2024-06-24T01:19:31,222   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-06-24T01:19:31,224   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-06-24T01:19:31,226   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-06-24T01:19:31,230   creating build/lib/alpaca_eval/metrics
2024-06-24T01:19:31,230   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-06-24T01:19:31,232   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-06-24T01:19:31,234   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-06-24T01:19:31,236   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-06-24T01:19:31,239   creating build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,240   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,242   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,244   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,246   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,248   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,250   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,252   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,254   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,256   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,258   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,260   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-06-24T01:19:31,262   running egg_info
2024-06-24T01:19:31,321   writing src/alpaca_eval.egg-info/PKG-INFO
2024-06-24T01:19:31,342   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-06-24T01:19:31,343   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-06-24T01:19:31,353   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-06-24T01:19:31,354   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-06-24T01:19:31,386   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-06-24T01:19:31,397   reading manifest template 'MANIFEST.in'
2024-06-24T01:19:31,597   adding license file 'LICENSE'
2024-06-24T01:19:31,616   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-06-24T01:19:31,620   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-06-24T01:19:31,621   !!

2024-06-24T01:19:31,622           ********************************************************************************
2024-06-24T01:19:31,623           ############################
2024-06-24T01:19:31,623           # Package would be ignored #
2024-06-24T01:19:31,624           ############################
2024-06-24T01:19:31,625           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-06-24T01:19:31,626           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,627           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,627           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-06-24T01:19:31,628           to the `packages` configuration field.

2024-06-24T01:19:31,628           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,629           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,629           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,630           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,631           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,632           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-06-24T01:19:31,632           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-06-24T01:19:31,632           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,633           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,633           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,634           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,635           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,637           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,637                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,638                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,638                 directory, all directories are treated like packages.
2024-06-24T01:19:31,639           ********************************************************************************

2024-06-24T01:19:31,640   !!
2024-06-24T01:19:31,640     check.warn(importable)
2024-06-24T01:19:31,641   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-06-24T01:19:31,642   !!

2024-06-24T01:19:31,643           ********************************************************************************
2024-06-24T01:19:31,644           ############################
2024-06-24T01:19:31,644           # Package would be ignored #
2024-06-24T01:19:31,645           ############################
2024-06-24T01:19:31,645           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-06-24T01:19:31,646           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,647           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,647           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-06-24T01:19:31,648           to the `packages` configuration field.

2024-06-24T01:19:31,649           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,649           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,650           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,651           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,652           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,653           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-06-24T01:19:31,654           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-06-24T01:19:31,655           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,655           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,656           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,656           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,657           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,658           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,659                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,659                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,659                 directory, all directories are treated like packages.
2024-06-24T01:19:31,660           ********************************************************************************

2024-06-24T01:19:31,660   !!
2024-06-24T01:19:31,661     check.warn(importable)
2024-06-24T01:19:31,661   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-06-24T01:19:31,661   !!

2024-06-24T01:19:31,662           ********************************************************************************
2024-06-24T01:19:31,663           ############################
2024-06-24T01:19:31,663           # Package would be ignored #
2024-06-24T01:19:31,664           ############################
2024-06-24T01:19:31,664           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-06-24T01:19:31,665           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,666           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,666           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-06-24T01:19:31,667           to the `packages` configuration field.

2024-06-24T01:19:31,668           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,668           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,669           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,670           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,671           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,672           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-06-24T01:19:31,672           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-06-24T01:19:31,673           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,673           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,674           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,675           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,676           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,678           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,678                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,679                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,680                 directory, all directories are treated like packages.
2024-06-24T01:19:31,680           ********************************************************************************

2024-06-24T01:19:31,681   !!
2024-06-24T01:19:31,682     check.warn(importable)
2024-06-24T01:19:31,682   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-06-24T01:19:31,682   !!

2024-06-24T01:19:31,683           ********************************************************************************
2024-06-24T01:19:31,683           ############################
2024-06-24T01:19:31,684           # Package would be ignored #
2024-06-24T01:19:31,684           ############################
2024-06-24T01:19:31,685           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-06-24T01:19:31,685           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,686           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,686           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-06-24T01:19:31,686           to the `packages` configuration field.

2024-06-24T01:19:31,687           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,688           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,688           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,689           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,690           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,691           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-06-24T01:19:31,691           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-06-24T01:19:31,692           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,692           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,693           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,694           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,695           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,697           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,697                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,698                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,698                 directory, all directories are treated like packages.
2024-06-24T01:19:31,699           ********************************************************************************

2024-06-24T01:19:31,700   !!
2024-06-24T01:19:31,700     check.warn(importable)
2024-06-24T01:19:31,701   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:31,701   !!

2024-06-24T01:19:31,702           ********************************************************************************
2024-06-24T01:19:31,703           ############################
2024-06-24T01:19:31,703           # Package would be ignored #
2024-06-24T01:19:31,704           ############################
2024-06-24T01:19:31,704           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-06-24T01:19:31,705           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,706           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,706           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-06-24T01:19:31,707           to the `packages` configuration field.

2024-06-24T01:19:31,708           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,708           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,709           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,709           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,710           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,711           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-06-24T01:19:31,711           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-06-24T01:19:31,711           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,712           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,712           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,713           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,714           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,716           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,716                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,716                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,717                 directory, all directories are treated like packages.
2024-06-24T01:19:31,717           ********************************************************************************

2024-06-24T01:19:31,719   !!
2024-06-24T01:19:31,719     check.warn(importable)
2024-06-24T01:19:31,720   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-06-24T01:19:31,720   !!

2024-06-24T01:19:31,721           ********************************************************************************
2024-06-24T01:19:31,722           ############################
2024-06-24T01:19:31,722           # Package would be ignored #
2024-06-24T01:19:31,723           ############################
2024-06-24T01:19:31,724           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-06-24T01:19:31,724           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,725           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,726           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-06-24T01:19:31,726           to the `packages` configuration field.

2024-06-24T01:19:31,727           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,728           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,728           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,729           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,730           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,731           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-06-24T01:19:31,732           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-06-24T01:19:31,732           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,734           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,734           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,735           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,736           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,736                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,737                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,737                 directory, all directories are treated like packages.
2024-06-24T01:19:31,737           ********************************************************************************

2024-06-24T01:19:31,738   !!
2024-06-24T01:19:31,738     check.warn(importable)
2024-06-24T01:19:31,739   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-06-24T01:19:31,739   !!

2024-06-24T01:19:31,740           ********************************************************************************
2024-06-24T01:19:31,740           ############################
2024-06-24T01:19:31,741           # Package would be ignored #
2024-06-24T01:19:31,741           ############################
2024-06-24T01:19:31,741           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-06-24T01:19:31,742           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,743           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,744           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-06-24T01:19:31,744           to the `packages` configuration field.

2024-06-24T01:19:31,745           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,746           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,746           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,747           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,748           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,749           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-06-24T01:19:31,750           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-06-24T01:19:31,750           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,751           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,751           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,752           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,753           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,755           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,755                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,756                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,756                 directory, all directories are treated like packages.
2024-06-24T01:19:31,757           ********************************************************************************

2024-06-24T01:19:31,758   !!
2024-06-24T01:19:31,758     check.warn(importable)
2024-06-24T01:19:31,759   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-06-24T01:19:31,759   !!

2024-06-24T01:19:31,761           ********************************************************************************
2024-06-24T01:19:31,761           ############################
2024-06-24T01:19:31,761           # Package would be ignored #
2024-06-24T01:19:31,762           ############################
2024-06-24T01:19:31,762           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-06-24T01:19:31,762           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,763           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,763           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-06-24T01:19:31,764           to the `packages` configuration field.

2024-06-24T01:19:31,765           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,765           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,765           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,766           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,767           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,768           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-06-24T01:19:31,768           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-06-24T01:19:31,769           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,769           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,770           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,771           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,772           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,774           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,774                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,775                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,775                 directory, all directories are treated like packages.
2024-06-24T01:19:31,776           ********************************************************************************

2024-06-24T01:19:31,777   !!
2024-06-24T01:19:31,777     check.warn(importable)
2024-06-24T01:19:31,778   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-06-24T01:19:31,778   !!

2024-06-24T01:19:31,779           ********************************************************************************
2024-06-24T01:19:31,780           ############################
2024-06-24T01:19:31,780           # Package would be ignored #
2024-06-24T01:19:31,780           ############################
2024-06-24T01:19:31,781           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-06-24T01:19:31,781           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,782           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,783           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-06-24T01:19:31,784           to the `packages` configuration field.

2024-06-24T01:19:31,785           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,785           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,786           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,786           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,787           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,788           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-06-24T01:19:31,788           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-06-24T01:19:31,788           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,789           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,789           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,790           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,791           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,792           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,792                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,792                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,793                 directory, all directories are treated like packages.
2024-06-24T01:19:31,793           ********************************************************************************

2024-06-24T01:19:31,794   !!
2024-06-24T01:19:31,795     check.warn(importable)
2024-06-24T01:19:31,796   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is absent from the `packages` configuration.
2024-06-24T01:19:31,796   !!

2024-06-24T01:19:31,797           ********************************************************************************
2024-06-24T01:19:31,798           ############################
2024-06-24T01:19:31,798           # Package would be ignored #
2024-06-24T01:19:31,799           ############################
2024-06-24T01:19:31,799           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' as an importable package[^1],
2024-06-24T01:19:31,800           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,801           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,801           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is explicitly added
2024-06-24T01:19:31,802           to the `packages` configuration field.

2024-06-24T01:19:31,803           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,804           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,804           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,805           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,806           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,807           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' to be distributed and are
2024-06-24T01:19:31,807           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' via
2024-06-24T01:19:31,808           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,809           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,810           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,812           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,812                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,813                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,813                 directory, all directories are treated like packages.
2024-06-24T01:19:31,813           ********************************************************************************

2024-06-24T01:19:31,814   !!
2024-06-24T01:19:31,814     check.warn(importable)
2024-06-24T01:19:31,814   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-06-24T01:19:31,815   !!

2024-06-24T01:19:31,815           ********************************************************************************
2024-06-24T01:19:31,816           ############################
2024-06-24T01:19:31,816           # Package would be ignored #
2024-06-24T01:19:31,817           ############################
2024-06-24T01:19:31,817           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-06-24T01:19:31,817           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,818           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,819           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-06-24T01:19:31,819           to the `packages` configuration field.

2024-06-24T01:19:31,820           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,820           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,821           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,822           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,823           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,824           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-06-24T01:19:31,824           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-06-24T01:19:31,825           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,825           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,826           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,827           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,828           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,829           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,829                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,830                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,830                 directory, all directories are treated like packages.
2024-06-24T01:19:31,831           ********************************************************************************

2024-06-24T01:19:31,832   !!
2024-06-24T01:19:31,832     check.warn(importable)
2024-06-24T01:19:31,833   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:31,833   !!

2024-06-24T01:19:31,834           ********************************************************************************
2024-06-24T01:19:31,835           ############################
2024-06-24T01:19:31,836           # Package would be ignored #
2024-06-24T01:19:31,836           ############################
2024-06-24T01:19:31,836           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-06-24T01:19:31,837           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,837           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,838           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-06-24T01:19:31,838           to the `packages` configuration field.

2024-06-24T01:19:31,839           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,839           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,840           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,840           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,841           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,842           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-06-24T01:19:31,842           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-06-24T01:19:31,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,843           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,843           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,844           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,845           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,847           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,847                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,848                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,849                 directory, all directories are treated like packages.
2024-06-24T01:19:31,849           ********************************************************************************

2024-06-24T01:19:31,850   !!
2024-06-24T01:19:31,851     check.warn(importable)
2024-06-24T01:19:31,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:31,852   !!

2024-06-24T01:19:31,853           ********************************************************************************
2024-06-24T01:19:31,854           ############################
2024-06-24T01:19:31,854           # Package would be ignored #
2024-06-24T01:19:31,855           ############################
2024-06-24T01:19:31,856           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-06-24T01:19:31,856           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,857           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,858           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-06-24T01:19:31,858           to the `packages` configuration field.

2024-06-24T01:19:31,859           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,860           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,861           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,862           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,863           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-06-24T01:19:31,863           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-06-24T01:19:31,864           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,864           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,864           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,865           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,866           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,867           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,867                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,868                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,868                 directory, all directories are treated like packages.
2024-06-24T01:19:31,868           ********************************************************************************

2024-06-24T01:19:31,869   !!
2024-06-24T01:19:31,869     check.warn(importable)
2024-06-24T01:19:31,870   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-06-24T01:19:31,870   !!

2024-06-24T01:19:31,871           ********************************************************************************
2024-06-24T01:19:31,872           ############################
2024-06-24T01:19:31,872           # Package would be ignored #
2024-06-24T01:19:31,873           ############################
2024-06-24T01:19:31,873           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-06-24T01:19:31,874           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,875           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,876           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-06-24T01:19:31,876           to the `packages` configuration field.

2024-06-24T01:19:31,877           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,877           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,878           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,879           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,880           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,881           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-06-24T01:19:31,881           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-06-24T01:19:31,881           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,882           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,882           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,884           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,885           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,886           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,887                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,887                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,888                 directory, all directories are treated like packages.
2024-06-24T01:19:31,888           ********************************************************************************

2024-06-24T01:19:31,889   !!
2024-06-24T01:19:31,889     check.warn(importable)
2024-06-24T01:19:31,890   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-06-24T01:19:31,890   !!

2024-06-24T01:19:31,891           ********************************************************************************
2024-06-24T01:19:31,891           ############################
2024-06-24T01:19:31,892           # Package would be ignored #
2024-06-24T01:19:31,892           ############################
2024-06-24T01:19:31,892           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-06-24T01:19:31,893           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,893           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,894           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-06-24T01:19:31,894           to the `packages` configuration field.

2024-06-24T01:19:31,895           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,895           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,896           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,897           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,898           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,899           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-06-24T01:19:31,900           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-06-24T01:19:31,901           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,902           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,902           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,904           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,905           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,907           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,908                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,908                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,909                 directory, all directories are treated like packages.
2024-06-24T01:19:31,909           ********************************************************************************

2024-06-24T01:19:31,910   !!
2024-06-24T01:19:31,911     check.warn(importable)
2024-06-24T01:19:31,912   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-06-24T01:19:31,912   !!

2024-06-24T01:19:31,914           ********************************************************************************
2024-06-24T01:19:31,914           ############################
2024-06-24T01:19:31,915           # Package would be ignored #
2024-06-24T01:19:31,916           ############################
2024-06-24T01:19:31,916           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-06-24T01:19:31,917           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,918           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,919           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-06-24T01:19:31,919           to the `packages` configuration field.

2024-06-24T01:19:31,920           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,921           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,921           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,922           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,923           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,924           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-06-24T01:19:31,924           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-06-24T01:19:31,925           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,926           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,927           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,928           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,929           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,930                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,930                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,931                 directory, all directories are treated like packages.
2024-06-24T01:19:31,931           ********************************************************************************

2024-06-24T01:19:31,933   !!
2024-06-24T01:19:31,933     check.warn(importable)
2024-06-24T01:19:31,934   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-06-24T01:19:31,935   !!

2024-06-24T01:19:31,936           ********************************************************************************
2024-06-24T01:19:31,936           ############################
2024-06-24T01:19:31,937           # Package would be ignored #
2024-06-24T01:19:31,938           ############################
2024-06-24T01:19:31,938           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-06-24T01:19:31,939           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,940           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,941           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-06-24T01:19:31,941           to the `packages` configuration field.

2024-06-24T01:19:31,942           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,943           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,944           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,945           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,946           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,947           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-06-24T01:19:31,948           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-06-24T01:19:31,949           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,949           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,950           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,951           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,952           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,953           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,954                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,954                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,955                 directory, all directories are treated like packages.
2024-06-24T01:19:31,955           ********************************************************************************

2024-06-24T01:19:31,956   !!
2024-06-24T01:19:31,956     check.warn(importable)
2024-06-24T01:19:31,957   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-06-24T01:19:31,957   !!

2024-06-24T01:19:31,958           ********************************************************************************
2024-06-24T01:19:31,959           ############################
2024-06-24T01:19:31,959           # Package would be ignored #
2024-06-24T01:19:31,960           ############################
2024-06-24T01:19:31,960           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-06-24T01:19:31,960           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,962           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,962           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-06-24T01:19:31,963           to the `packages` configuration field.

2024-06-24T01:19:31,965           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,966           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,968           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,970           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,972           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,974           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-06-24T01:19:31,975           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-06-24T01:19:31,975           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,976           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,976           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,977           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:31,979           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:31,980           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:31,981                 even if it does not contain any `.py` files.
2024-06-24T01:19:31,981                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:31,982                 directory, all directories are treated like packages.
2024-06-24T01:19:31,983           ********************************************************************************

2024-06-24T01:19:31,984   !!
2024-06-24T01:19:31,984     check.warn(importable)
2024-06-24T01:19:31,985   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-06-24T01:19:31,986   !!

2024-06-24T01:19:31,987           ********************************************************************************
2024-06-24T01:19:31,988           ############################
2024-06-24T01:19:31,988           # Package would be ignored #
2024-06-24T01:19:31,988           ############################
2024-06-24T01:19:31,989           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-06-24T01:19:31,989           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:31,990           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:31,990           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-06-24T01:19:31,991           to the `packages` configuration field.

2024-06-24T01:19:31,992           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:31,992           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:31,993           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:31,994           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:31,994           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:31,995           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-06-24T01:19:31,996           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-06-24T01:19:31,996           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:31,997           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:31,997           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:31,998           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,000           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,002           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,002                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,003                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,004                 directory, all directories are treated like packages.
2024-06-24T01:19:32,004           ********************************************************************************

2024-06-24T01:19:32,005   !!
2024-06-24T01:19:32,006     check.warn(importable)
2024-06-24T01:19:32,007   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-06-24T01:19:32,007   !!

2024-06-24T01:19:32,008           ********************************************************************************
2024-06-24T01:19:32,009           ############################
2024-06-24T01:19:32,010           # Package would be ignored #
2024-06-24T01:19:32,010           ############################
2024-06-24T01:19:32,011           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-06-24T01:19:32,011           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,012           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,013           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-06-24T01:19:32,014           to the `packages` configuration field.

2024-06-24T01:19:32,015           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,016           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,017           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,018           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,019           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,020           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-06-24T01:19:32,021           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-06-24T01:19:32,022           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,022           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,023           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,024           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,025           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,027           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,027                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,028                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,028                 directory, all directories are treated like packages.
2024-06-24T01:19:32,029           ********************************************************************************

2024-06-24T01:19:32,030   !!
2024-06-24T01:19:32,030     check.warn(importable)
2024-06-24T01:19:32,031   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-06-24T01:19:32,031   !!

2024-06-24T01:19:32,033           ********************************************************************************
2024-06-24T01:19:32,033           ############################
2024-06-24T01:19:32,034           # Package would be ignored #
2024-06-24T01:19:32,034           ############################
2024-06-24T01:19:32,035           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-06-24T01:19:32,036           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,037           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,038           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-06-24T01:19:32,038           to the `packages` configuration field.

2024-06-24T01:19:32,040           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,040           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,041           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,042           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,043           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,044           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-06-24T01:19:32,045           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-06-24T01:19:32,045           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,046           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,047           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,048           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,049           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,052           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,052                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,053                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,054                 directory, all directories are treated like packages.
2024-06-24T01:19:32,054           ********************************************************************************

2024-06-24T01:19:32,055   !!
2024-06-24T01:19:32,056     check.warn(importable)
2024-06-24T01:19:32,056   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-06-24T01:19:32,057   !!

2024-06-24T01:19:32,058           ********************************************************************************
2024-06-24T01:19:32,058           ############################
2024-06-24T01:19:32,059           # Package would be ignored #
2024-06-24T01:19:32,059           ############################
2024-06-24T01:19:32,060           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-06-24T01:19:32,060           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,061           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,062           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-06-24T01:19:32,062           to the `packages` configuration field.

2024-06-24T01:19:32,063           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,064           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,064           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,065           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,067           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,068           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-06-24T01:19:32,069           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-06-24T01:19:32,069           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,070           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,071           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,072           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,073           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,075           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,076                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,076                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,077                 directory, all directories are treated like packages.
2024-06-24T01:19:32,077           ********************************************************************************

2024-06-24T01:19:32,079   !!
2024-06-24T01:19:32,079     check.warn(importable)
2024-06-24T01:19:32,080   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-06-24T01:19:32,080   !!

2024-06-24T01:19:32,082           ********************************************************************************
2024-06-24T01:19:32,082           ############################
2024-06-24T01:19:32,083           # Package would be ignored #
2024-06-24T01:19:32,084           ############################
2024-06-24T01:19:32,084           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-06-24T01:19:32,085           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,087           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,087           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-06-24T01:19:32,088           to the `packages` configuration field.

2024-06-24T01:19:32,088           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,089           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,089           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,090           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,091           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,092           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-06-24T01:19:32,093           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-06-24T01:19:32,093           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,093           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,094           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,095           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,096           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,097           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,098                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,098                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,099                 directory, all directories are treated like packages.
2024-06-24T01:19:32,099           ********************************************************************************

2024-06-24T01:19:32,101   !!
2024-06-24T01:19:32,101     check.warn(importable)
2024-06-24T01:19:32,102   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:32,102   !!

2024-06-24T01:19:32,103           ********************************************************************************
2024-06-24T01:19:32,104           ############################
2024-06-24T01:19:32,104           # Package would be ignored #
2024-06-24T01:19:32,105           ############################
2024-06-24T01:19:32,105           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-06-24T01:19:32,106           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,107           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,107           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-06-24T01:19:32,108           to the `packages` configuration field.

2024-06-24T01:19:32,109           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,109           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,110           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,111           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,112           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,114           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-06-24T01:19:32,114           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-06-24T01:19:32,115           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,116           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,116           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,117           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,118           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,119           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,119                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,120                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,120                 directory, all directories are treated like packages.
2024-06-24T01:19:32,120           ********************************************************************************

2024-06-24T01:19:32,121   !!
2024-06-24T01:19:32,121     check.warn(importable)
2024-06-24T01:19:32,122   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-06-24T01:19:32,122   !!

2024-06-24T01:19:32,123           ********************************************************************************
2024-06-24T01:19:32,124           ############################
2024-06-24T01:19:32,124           # Package would be ignored #
2024-06-24T01:19:32,124           ############################
2024-06-24T01:19:32,125           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-06-24T01:19:32,126           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,127           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,128           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-06-24T01:19:32,128           to the `packages` configuration field.

2024-06-24T01:19:32,130           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,130           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,131           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,132           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,133           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,134           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-06-24T01:19:32,135           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-06-24T01:19:32,136           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,136           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,136           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,137           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,138           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,140           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,141                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,141                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,142                 directory, all directories are treated like packages.
2024-06-24T01:19:32,142           ********************************************************************************

2024-06-24T01:19:32,143   !!
2024-06-24T01:19:32,144     check.warn(importable)
2024-06-24T01:19:32,144   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-06-24T01:19:32,145   !!

2024-06-24T01:19:32,146           ********************************************************************************
2024-06-24T01:19:32,146           ############################
2024-06-24T01:19:32,147           # Package would be ignored #
2024-06-24T01:19:32,147           ############################
2024-06-24T01:19:32,147           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-06-24T01:19:32,148           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,148           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,149           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-06-24T01:19:32,149           to the `packages` configuration field.

2024-06-24T01:19:32,150           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,150           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,150           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,151           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,153           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-06-24T01:19:32,153           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-06-24T01:19:32,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,154           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,155           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,156           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,157           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,158           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,159                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,159                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,160                 directory, all directories are treated like packages.
2024-06-24T01:19:32,161           ********************************************************************************

2024-06-24T01:19:32,162   !!
2024-06-24T01:19:32,162     check.warn(importable)
2024-06-24T01:19:32,163   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-06-24T01:19:32,163   !!

2024-06-24T01:19:32,164           ********************************************************************************
2024-06-24T01:19:32,165           ############################
2024-06-24T01:19:32,165           # Package would be ignored #
2024-06-24T01:19:32,166           ############################
2024-06-24T01:19:32,166           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-06-24T01:19:32,167           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,168           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,168           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-06-24T01:19:32,169           to the `packages` configuration field.

2024-06-24T01:19:32,170           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,170           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,171           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,172           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,172           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,173           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-06-24T01:19:32,173           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-06-24T01:19:32,174           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,174           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,174           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,175           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,176           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,177                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,177                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,178                 directory, all directories are treated like packages.
2024-06-24T01:19:32,178           ********************************************************************************

2024-06-24T01:19:32,179   !!
2024-06-24T01:19:32,180     check.warn(importable)
2024-06-24T01:19:32,180   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-06-24T01:19:32,180   !!

2024-06-24T01:19:32,181           ********************************************************************************
2024-06-24T01:19:32,182           ############################
2024-06-24T01:19:32,182           # Package would be ignored #
2024-06-24T01:19:32,183           ############################
2024-06-24T01:19:32,184           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-06-24T01:19:32,184           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,186           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,186           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-06-24T01:19:32,187           to the `packages` configuration field.

2024-06-24T01:19:32,188           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,188           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,189           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,189           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,190           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,191           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-06-24T01:19:32,192           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-06-24T01:19:32,192           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,193           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,193           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,194           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,196           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,197           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,197                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,197                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,198                 directory, all directories are treated like packages.
2024-06-24T01:19:32,198           ********************************************************************************

2024-06-24T01:19:32,199   !!
2024-06-24T01:19:32,199     check.warn(importable)
2024-06-24T01:19:32,200   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-06-24T01:19:32,200   !!

2024-06-24T01:19:32,201           ********************************************************************************
2024-06-24T01:19:32,201           ############################
2024-06-24T01:19:32,202           # Package would be ignored #
2024-06-24T01:19:32,202           ############################
2024-06-24T01:19:32,203           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-06-24T01:19:32,203           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,204           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,204           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-06-24T01:19:32,205           to the `packages` configuration field.

2024-06-24T01:19:32,206           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,206           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,207           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,208           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,209           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,210           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-06-24T01:19:32,210           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-06-24T01:19:32,211           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,212           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,212           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,213           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,214           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,215           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,218                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,218                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,219                 directory, all directories are treated like packages.
2024-06-24T01:19:32,219           ********************************************************************************

2024-06-24T01:19:32,220   !!
2024-06-24T01:19:32,221     check.warn(importable)
2024-06-24T01:19:32,221   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-06-24T01:19:32,222   !!

2024-06-24T01:19:32,223           ********************************************************************************
2024-06-24T01:19:32,224           ############################
2024-06-24T01:19:32,224           # Package would be ignored #
2024-06-24T01:19:32,225           ############################
2024-06-24T01:19:32,225           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-06-24T01:19:32,225           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,226           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,226           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-06-24T01:19:32,227           to the `packages` configuration field.

2024-06-24T01:19:32,228           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,228           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,228           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,229           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,230           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,231           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-06-24T01:19:32,231           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-06-24T01:19:32,231           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,232           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,232           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,233           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,234           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,236           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,236                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,237                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,237                 directory, all directories are treated like packages.
2024-06-24T01:19:32,238           ********************************************************************************

2024-06-24T01:19:32,239   !!
2024-06-24T01:19:32,239     check.warn(importable)
2024-06-24T01:19:32,240   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:32,240   !!

2024-06-24T01:19:32,241           ********************************************************************************
2024-06-24T01:19:32,242           ############################
2024-06-24T01:19:32,242           # Package would be ignored #
2024-06-24T01:19:32,243           ############################
2024-06-24T01:19:32,243           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-06-24T01:19:32,244           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,245           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,245           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-06-24T01:19:32,245           to the `packages` configuration field.

2024-06-24T01:19:32,247           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,247           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,248           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,249           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,251           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,252           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-06-24T01:19:32,252           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-06-24T01:19:32,252           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,253           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,253           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,254           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,255           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,256           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,256                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,257                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,257                 directory, all directories are treated like packages.
2024-06-24T01:19:32,258           ********************************************************************************

2024-06-24T01:19:32,259   !!
2024-06-24T01:19:32,259     check.warn(importable)
2024-06-24T01:19:32,260   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:32,260   !!

2024-06-24T01:19:32,261           ********************************************************************************
2024-06-24T01:19:32,261           ############################
2024-06-24T01:19:32,262           # Package would be ignored #
2024-06-24T01:19:32,262           ############################
2024-06-24T01:19:32,263           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-06-24T01:19:32,263           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,265           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,265           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-06-24T01:19:32,266           to the `packages` configuration field.

2024-06-24T01:19:32,267           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,267           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,268           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,269           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,270           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,271           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-06-24T01:19:32,272           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-06-24T01:19:32,272           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,273           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,273           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,274           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,275           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,277           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,278                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,278                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,279                 directory, all directories are treated like packages.
2024-06-24T01:19:32,280           ********************************************************************************

2024-06-24T01:19:32,280   !!
2024-06-24T01:19:32,281     check.warn(importable)
2024-06-24T01:19:32,281   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:32,281   !!

2024-06-24T01:19:32,282           ********************************************************************************
2024-06-24T01:19:32,283           ############################
2024-06-24T01:19:32,283           # Package would be ignored #
2024-06-24T01:19:32,284           ############################
2024-06-24T01:19:32,284           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-06-24T01:19:32,284           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,285           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,285           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-06-24T01:19:32,286           to the `packages` configuration field.

2024-06-24T01:19:32,287           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,287           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,288           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,289           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,290           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,291           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-06-24T01:19:32,291           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-06-24T01:19:32,292           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,292           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,293           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,294           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,295           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,297           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,297                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,298                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,298                 directory, all directories are treated like packages.
2024-06-24T01:19:32,299           ********************************************************************************

2024-06-24T01:19:32,300   !!
2024-06-24T01:19:32,300     check.warn(importable)
2024-06-24T01:19:32,301   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-06-24T01:19:32,301   !!

2024-06-24T01:19:32,302           ********************************************************************************
2024-06-24T01:19:32,303           ############################
2024-06-24T01:19:32,304           # Package would be ignored #
2024-06-24T01:19:32,304           ############################
2024-06-24T01:19:32,305           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-06-24T01:19:32,305           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,307           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,307           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-06-24T01:19:32,308           to the `packages` configuration field.

2024-06-24T01:19:32,308           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,309           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,309           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,310           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,310           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,311           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-06-24T01:19:32,312           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-06-24T01:19:32,312           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,312           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,313           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,313           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,314           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,315           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,316                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,316                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,317                 directory, all directories are treated like packages.
2024-06-24T01:19:32,317           ********************************************************************************

2024-06-24T01:19:32,318   !!
2024-06-24T01:19:32,319     check.warn(importable)
2024-06-24T01:19:32,320   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-06-24T01:19:32,320   !!

2024-06-24T01:19:32,321           ********************************************************************************
2024-06-24T01:19:32,322           ############################
2024-06-24T01:19:32,322           # Package would be ignored #
2024-06-24T01:19:32,323           ############################
2024-06-24T01:19:32,323           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-06-24T01:19:32,324           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,325           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,325           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-06-24T01:19:32,326           to the `packages` configuration field.

2024-06-24T01:19:32,327           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,327           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,328           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,329           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,330           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,331           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-06-24T01:19:32,331           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-06-24T01:19:32,332           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,333           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,334           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,335           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,336           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,336                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,336                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,337                 directory, all directories are treated like packages.
2024-06-24T01:19:32,337           ********************************************************************************

2024-06-24T01:19:32,338   !!
2024-06-24T01:19:32,338     check.warn(importable)
2024-06-24T01:19:32,338   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-06-24T01:19:32,339   !!

2024-06-24T01:19:32,339           ********************************************************************************
2024-06-24T01:19:32,340           ############################
2024-06-24T01:19:32,340           # Package would be ignored #
2024-06-24T01:19:32,341           ############################
2024-06-24T01:19:32,341           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-06-24T01:19:32,341           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,342           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,343           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-06-24T01:19:32,344           to the `packages` configuration field.

2024-06-24T01:19:32,345           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,345           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,346           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,347           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,348           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,349           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-06-24T01:19:32,350           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-06-24T01:19:32,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,351           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,352           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,352           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,353           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,355           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,356                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,356                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,356                 directory, all directories are treated like packages.
2024-06-24T01:19:32,357           ********************************************************************************

2024-06-24T01:19:32,358   !!
2024-06-24T01:19:32,358     check.warn(importable)
2024-06-24T01:19:32,359   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-06-24T01:19:32,360   !!

2024-06-24T01:19:32,361           ********************************************************************************
2024-06-24T01:19:32,361           ############################
2024-06-24T01:19:32,361           # Package would be ignored #
2024-06-24T01:19:32,362           ############################
2024-06-24T01:19:32,362           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-06-24T01:19:32,362           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,363           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,364           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-06-24T01:19:32,364           to the `packages` configuration field.

2024-06-24T01:19:32,365           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,365           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,365           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,366           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,367           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,368           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-06-24T01:19:32,368           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-06-24T01:19:32,368           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,369           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,370           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,371           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,372           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,373           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,374                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,375                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,375                 directory, all directories are treated like packages.
2024-06-24T01:19:32,376           ********************************************************************************

2024-06-24T01:19:32,377   !!
2024-06-24T01:19:32,377     check.warn(importable)
2024-06-24T01:19:32,378   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-06-24T01:19:32,378   !!

2024-06-24T01:19:32,379           ********************************************************************************
2024-06-24T01:19:32,380           ############################
2024-06-24T01:19:32,380           # Package would be ignored #
2024-06-24T01:19:32,380           ############################
2024-06-24T01:19:32,381           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-06-24T01:19:32,381           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,382           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,383           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-06-24T01:19:32,384           to the `packages` configuration field.

2024-06-24T01:19:32,385           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,385           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,385           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,386           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,387           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,388           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-06-24T01:19:32,388           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-06-24T01:19:32,388           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,389           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,389           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,390           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,390           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,391           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,392                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,392                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,393                 directory, all directories are treated like packages.
2024-06-24T01:19:32,393           ********************************************************************************

2024-06-24T01:19:32,394   !!
2024-06-24T01:19:32,395     check.warn(importable)
2024-06-24T01:19:32,395   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is absent from the `packages` configuration.
2024-06-24T01:19:32,396   !!

2024-06-24T01:19:32,397           ********************************************************************************
2024-06-24T01:19:32,398           ############################
2024-06-24T01:19:32,398           # Package would be ignored #
2024-06-24T01:19:32,398           ############################
2024-06-24T01:19:32,399           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' as an importable package[^1],
2024-06-24T01:19:32,400           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,401           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,401           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is explicitly added
2024-06-24T01:19:32,402           to the `packages` configuration field.

2024-06-24T01:19:32,403           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,404           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,404           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,405           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,406           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,407           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' to be distributed and are
2024-06-24T01:19:32,408           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' via
2024-06-24T01:19:32,408           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,409           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,409           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,411           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,412           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,413           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,413                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,413                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,414                 directory, all directories are treated like packages.
2024-06-24T01:19:32,414           ********************************************************************************

2024-06-24T01:19:32,415   !!
2024-06-24T01:19:32,415     check.warn(importable)
2024-06-24T01:19:32,416   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-06-24T01:19:32,416   !!

2024-06-24T01:19:32,417           ********************************************************************************
2024-06-24T01:19:32,417           ############################
2024-06-24T01:19:32,417           # Package would be ignored #
2024-06-24T01:19:32,418           ############################
2024-06-24T01:19:32,418           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-06-24T01:19:32,418           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,419           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,420           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-06-24T01:19:32,420           to the `packages` configuration field.

2024-06-24T01:19:32,421           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,422           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,423           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,424           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,426           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-06-24T01:19:32,426           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-06-24T01:19:32,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,427           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,428           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,429           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,430           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,431           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,432                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,432                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,433                 directory, all directories are treated like packages.
2024-06-24T01:19:32,433           ********************************************************************************

2024-06-24T01:19:32,434   !!
2024-06-24T01:19:32,435     check.warn(importable)
2024-06-24T01:19:32,435   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-06-24T01:19:32,436   !!

2024-06-24T01:19:32,437           ********************************************************************************
2024-06-24T01:19:32,437           ############################
2024-06-24T01:19:32,438           # Package would be ignored #
2024-06-24T01:19:32,439           ############################
2024-06-24T01:19:32,439           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-06-24T01:19:32,439           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,440           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,440           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-06-24T01:19:32,441           to the `packages` configuration field.

2024-06-24T01:19:32,442           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,442           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,442           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,443           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,444           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,444           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-06-24T01:19:32,445           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-06-24T01:19:32,445           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,446           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,446           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,447           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,448           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,450           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,450                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,451                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,451                 directory, all directories are treated like packages.
2024-06-24T01:19:32,452           ********************************************************************************

2024-06-24T01:19:32,453   !!
2024-06-24T01:19:32,453     check.warn(importable)
2024-06-24T01:19:32,454   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-06-24T01:19:32,454   !!

2024-06-24T01:19:32,456           ********************************************************************************
2024-06-24T01:19:32,456           ############################
2024-06-24T01:19:32,456           # Package would be ignored #
2024-06-24T01:19:32,457           ############################
2024-06-24T01:19:32,457           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-06-24T01:19:32,458           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,459           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,459           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-06-24T01:19:32,460           to the `packages` configuration field.

2024-06-24T01:19:32,460           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,461           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,462           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,463           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,464           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,465           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-06-24T01:19:32,465           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-06-24T01:19:32,465           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,466           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,466           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,467           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,467           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,468           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,469                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,469                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,469                 directory, all directories are treated like packages.
2024-06-24T01:19:32,470           ********************************************************************************

2024-06-24T01:19:32,471   !!
2024-06-24T01:19:32,471     check.warn(importable)
2024-06-24T01:19:32,471   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-06-24T01:19:32,472   !!

2024-06-24T01:19:32,473           ********************************************************************************
2024-06-24T01:19:32,473           ############################
2024-06-24T01:19:32,474           # Package would be ignored #
2024-06-24T01:19:32,474           ############################
2024-06-24T01:19:32,475           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-06-24T01:19:32,476           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,477           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,477           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-06-24T01:19:32,478           to the `packages` configuration field.

2024-06-24T01:19:32,479           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,480           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,481           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,482           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,483           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,484           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-06-24T01:19:32,484           already explicitly excluding 'alpaca_eval.models_configs' via
2024-06-24T01:19:32,485           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,485           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,486           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,487           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,488           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,489           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,490                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,490                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,491                 directory, all directories are treated like packages.
2024-06-24T01:19:32,492           ********************************************************************************

2024-06-24T01:19:32,493   !!
2024-06-24T01:19:32,494     check.warn(importable)
2024-06-24T01:19:32,494   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-06-24T01:19:32,495   !!

2024-06-24T01:19:32,496           ********************************************************************************
2024-06-24T01:19:32,496           ############################
2024-06-24T01:19:32,497           # Package would be ignored #
2024-06-24T01:19:32,497           ############################
2024-06-24T01:19:32,497           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-06-24T01:19:32,498           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,499           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,499           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-06-24T01:19:32,500           to the `packages` configuration field.

2024-06-24T01:19:32,500           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,501           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,501           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,502           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,503           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,504           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-06-24T01:19:32,505           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-06-24T01:19:32,505           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,505           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,506           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,507           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,508           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,509           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,510                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,510                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,511                 directory, all directories are treated like packages.
2024-06-24T01:19:32,511           ********************************************************************************

2024-06-24T01:19:32,512   !!
2024-06-24T01:19:32,513     check.warn(importable)
2024-06-24T01:19:32,513   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-06-24T01:19:32,514   !!

2024-06-24T01:19:32,515           ********************************************************************************
2024-06-24T01:19:32,515           ############################
2024-06-24T01:19:32,516           # Package would be ignored #
2024-06-24T01:19:32,516           ############################
2024-06-24T01:19:32,517           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-06-24T01:19:32,517           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,518           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,519           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-06-24T01:19:32,520           to the `packages` configuration field.

2024-06-24T01:19:32,521           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,521           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,522           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,522           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,523           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,524           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-06-24T01:19:32,524           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-06-24T01:19:32,525           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,525           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,526           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,526           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,528           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,529           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,529                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,530                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,530                 directory, all directories are treated like packages.
2024-06-24T01:19:32,531           ********************************************************************************

2024-06-24T01:19:32,532   !!
2024-06-24T01:19:32,532     check.warn(importable)
2024-06-24T01:19:32,533   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-06-24T01:19:32,533   !!

2024-06-24T01:19:32,534           ********************************************************************************
2024-06-24T01:19:32,535           ############################
2024-06-24T01:19:32,535           # Package would be ignored #
2024-06-24T01:19:32,536           ############################
2024-06-24T01:19:32,536           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-06-24T01:19:32,537           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,538           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,538           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-06-24T01:19:32,539           to the `packages` configuration field.

2024-06-24T01:19:32,540           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,540           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,541           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,542           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,543           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,544           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-06-24T01:19:32,544           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-06-24T01:19:32,545           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,545           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,546           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,547           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,548           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,550                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,550                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,551                 directory, all directories are treated like packages.
2024-06-24T01:19:32,551           ********************************************************************************

2024-06-24T01:19:32,552   !!
2024-06-24T01:19:32,552     check.warn(importable)
2024-06-24T01:19:32,553   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-06-24T01:19:32,553   !!

2024-06-24T01:19:32,554           ********************************************************************************
2024-06-24T01:19:32,554           ############################
2024-06-24T01:19:32,555           # Package would be ignored #
2024-06-24T01:19:32,555           ############################
2024-06-24T01:19:32,556           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-06-24T01:19:32,556           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,557           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,558           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-06-24T01:19:32,558           to the `packages` configuration field.

2024-06-24T01:19:32,559           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,559           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,560           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,561           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,562           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,563           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-06-24T01:19:32,564           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-06-24T01:19:32,564           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,565           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,565           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,566           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,567           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,569           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,569                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,570                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,570                 directory, all directories are treated like packages.
2024-06-24T01:19:32,571           ********************************************************************************

2024-06-24T01:19:32,572   !!
2024-06-24T01:19:32,572     check.warn(importable)
2024-06-24T01:19:32,573   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-06-24T01:19:32,573   !!

2024-06-24T01:19:32,574           ********************************************************************************
2024-06-24T01:19:32,575           ############################
2024-06-24T01:19:32,576           # Package would be ignored #
2024-06-24T01:19:32,576           ############################
2024-06-24T01:19:32,576           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-06-24T01:19:32,577           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,578           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,578           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-06-24T01:19:32,578           to the `packages` configuration field.

2024-06-24T01:19:32,579           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,580           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,580           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,581           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,582           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,583           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-06-24T01:19:32,583           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-06-24T01:19:32,584           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,584           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,584           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,585           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,586           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,588           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,588                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,588                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,589                 directory, all directories are treated like packages.
2024-06-24T01:19:32,589           ********************************************************************************

2024-06-24T01:19:32,590   !!
2024-06-24T01:19:32,591     check.warn(importable)
2024-06-24T01:19:32,591   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-06-24T01:19:32,592   !!

2024-06-24T01:19:32,593           ********************************************************************************
2024-06-24T01:19:32,593           ############################
2024-06-24T01:19:32,594           # Package would be ignored #
2024-06-24T01:19:32,594           ############################
2024-06-24T01:19:32,594           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-06-24T01:19:32,595           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,596           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,597           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-06-24T01:19:32,597           to the `packages` configuration field.

2024-06-24T01:19:32,598           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,599           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,599           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,600           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,601           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,603           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-06-24T01:19:32,603           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-06-24T01:19:32,603           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,604           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,604           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,605           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,606           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,607           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,607                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,608                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,608                 directory, all directories are treated like packages.
2024-06-24T01:19:32,608           ********************************************************************************

2024-06-24T01:19:32,609   !!
2024-06-24T01:19:32,610     check.warn(importable)
2024-06-24T01:19:32,610   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-06-24T01:19:32,610   !!

2024-06-24T01:19:32,611           ********************************************************************************
2024-06-24T01:19:32,612           ############################
2024-06-24T01:19:32,612           # Package would be ignored #
2024-06-24T01:19:32,613           ############################
2024-06-24T01:19:32,613           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-06-24T01:19:32,613           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,614           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,615           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-06-24T01:19:32,615           to the `packages` configuration field.

2024-06-24T01:19:32,616           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,617           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,617           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,618           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,619           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,620           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-06-24T01:19:32,620           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-06-24T01:19:32,621           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,621           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,622           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,623           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,624           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,625           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,626                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,626                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,627                 directory, all directories are treated like packages.
2024-06-24T01:19:32,627           ********************************************************************************

2024-06-24T01:19:32,628   !!
2024-06-24T01:19:32,629     check.warn(importable)
2024-06-24T01:19:32,629   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-06-24T01:19:32,630   !!

2024-06-24T01:19:32,630           ********************************************************************************
2024-06-24T01:19:32,631           ############################
2024-06-24T01:19:32,631           # Package would be ignored #
2024-06-24T01:19:32,632           ############################
2024-06-24T01:19:32,632           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-06-24T01:19:32,632           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,633           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,633           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-06-24T01:19:32,634           to the `packages` configuration field.

2024-06-24T01:19:32,635           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,635           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,636           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,637           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,637           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,638           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-06-24T01:19:32,639           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-06-24T01:19:32,639           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,640           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,640           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,641           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,642           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,643           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,644                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,644                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,644                 directory, all directories are treated like packages.
2024-06-24T01:19:32,645           ********************************************************************************

2024-06-24T01:19:32,646   !!
2024-06-24T01:19:32,646     check.warn(importable)
2024-06-24T01:19:32,647   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-06-24T01:19:32,647   !!

2024-06-24T01:19:32,648           ********************************************************************************
2024-06-24T01:19:32,649           ############################
2024-06-24T01:19:32,649           # Package would be ignored #
2024-06-24T01:19:32,650           ############################
2024-06-24T01:19:32,650           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-06-24T01:19:32,651           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,652           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,652           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-06-24T01:19:32,653           to the `packages` configuration field.

2024-06-24T01:19:32,654           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,654           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,654           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,655           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,656           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,657           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-06-24T01:19:32,657           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-06-24T01:19:32,658           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,658           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,659           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,660           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,661           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,662                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,662                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,663                 directory, all directories are treated like packages.
2024-06-24T01:19:32,663           ********************************************************************************

2024-06-24T01:19:32,664   !!
2024-06-24T01:19:32,664     check.warn(importable)
2024-06-24T01:19:32,665   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-06-24T01:19:32,665   !!

2024-06-24T01:19:32,666           ********************************************************************************
2024-06-24T01:19:32,667           ############################
2024-06-24T01:19:32,667           # Package would be ignored #
2024-06-24T01:19:32,668           ############################
2024-06-24T01:19:32,668           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-06-24T01:19:32,669           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,670           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,670           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-06-24T01:19:32,671           to the `packages` configuration field.

2024-06-24T01:19:32,672           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,672           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,673           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,674           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,676           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-06-24T01:19:32,677           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-06-24T01:19:32,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,678           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,679           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,680           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,683                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,683                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,684                 directory, all directories are treated like packages.
2024-06-24T01:19:32,684           ********************************************************************************

2024-06-24T01:19:32,685   !!
2024-06-24T01:19:32,685     check.warn(importable)
2024-06-24T01:19:32,686   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-06-24T01:19:32,686   !!

2024-06-24T01:19:32,687           ********************************************************************************
2024-06-24T01:19:32,688           ############################
2024-06-24T01:19:32,688           # Package would be ignored #
2024-06-24T01:19:32,689           ############################
2024-06-24T01:19:32,689           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-06-24T01:19:32,689           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,690           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,691           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-06-24T01:19:32,691           to the `packages` configuration field.

2024-06-24T01:19:32,692           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,693           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,693           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,694           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,695           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,696           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-06-24T01:19:32,697           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-06-24T01:19:32,697           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,698           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,698           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,699           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,700           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,702           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,702                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,703                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,703                 directory, all directories are treated like packages.
2024-06-24T01:19:32,704           ********************************************************************************

2024-06-24T01:19:32,705   !!
2024-06-24T01:19:32,705     check.warn(importable)
2024-06-24T01:19:32,706   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-06-24T01:19:32,706   !!

2024-06-24T01:19:32,708           ********************************************************************************
2024-06-24T01:19:32,708           ############################
2024-06-24T01:19:32,709           # Package would be ignored #
2024-06-24T01:19:32,709           ############################
2024-06-24T01:19:32,710           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-06-24T01:19:32,710           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,711           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,712           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-06-24T01:19:32,712           to the `packages` configuration field.

2024-06-24T01:19:32,713           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,713           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,714           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,715           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,716           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,717           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-06-24T01:19:32,717           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-06-24T01:19:32,717           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,718           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,718           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,719           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,720           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,722           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,722                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,723                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,723                 directory, all directories are treated like packages.
2024-06-24T01:19:32,724           ********************************************************************************

2024-06-24T01:19:32,725   !!
2024-06-24T01:19:32,725     check.warn(importable)
2024-06-24T01:19:32,725   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-06-24T01:19:32,726   !!

2024-06-24T01:19:32,727           ********************************************************************************
2024-06-24T01:19:32,728           ############################
2024-06-24T01:19:32,728           # Package would be ignored #
2024-06-24T01:19:32,729           ############################
2024-06-24T01:19:32,729           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-06-24T01:19:32,730           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,730           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,731           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-06-24T01:19:32,732           to the `packages` configuration field.

2024-06-24T01:19:32,733           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,733           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,734           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,735           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,736           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,737           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-06-24T01:19:32,737           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-06-24T01:19:32,737           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,738           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,738           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,739           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,740           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,742           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,742                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,743                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,743                 directory, all directories are treated like packages.
2024-06-24T01:19:32,744           ********************************************************************************

2024-06-24T01:19:32,745   !!
2024-06-24T01:19:32,745     check.warn(importable)
2024-06-24T01:19:32,745   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-06-24T01:19:32,746   !!

2024-06-24T01:19:32,747           ********************************************************************************
2024-06-24T01:19:32,747           ############################
2024-06-24T01:19:32,748           # Package would be ignored #
2024-06-24T01:19:32,748           ############################
2024-06-24T01:19:32,749           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-06-24T01:19:32,749           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,750           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,751           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-06-24T01:19:32,751           to the `packages` configuration field.

2024-06-24T01:19:32,752           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,753           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,753           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,754           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,756           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,757           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-06-24T01:19:32,757           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-06-24T01:19:32,758           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,758           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,759           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,760           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,761           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,762           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,763                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,764                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,764                 directory, all directories are treated like packages.
2024-06-24T01:19:32,765           ********************************************************************************

2024-06-24T01:19:32,765   !!
2024-06-24T01:19:32,766     check.warn(importable)
2024-06-24T01:19:32,766   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-06-24T01:19:32,767   !!

2024-06-24T01:19:32,768           ********************************************************************************
2024-06-24T01:19:32,768           ############################
2024-06-24T01:19:32,769           # Package would be ignored #
2024-06-24T01:19:32,769           ############################
2024-06-24T01:19:32,769           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-06-24T01:19:32,770           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,771           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,771           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-06-24T01:19:32,772           to the `packages` configuration field.

2024-06-24T01:19:32,773           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,773           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,773           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,774           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,776           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,777           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-06-24T01:19:32,777           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-06-24T01:19:32,778           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,778           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,779           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,780           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,781           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,782           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,783                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,783                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,784                 directory, all directories are treated like packages.
2024-06-24T01:19:32,784           ********************************************************************************

2024-06-24T01:19:32,785   !!
2024-06-24T01:19:32,786     check.warn(importable)
2024-06-24T01:19:32,786   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-06-24T01:19:32,787   !!

2024-06-24T01:19:32,788           ********************************************************************************
2024-06-24T01:19:32,789           ############################
2024-06-24T01:19:32,789           # Package would be ignored #
2024-06-24T01:19:32,790           ############################
2024-06-24T01:19:32,790           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-06-24T01:19:32,791           but it is absent from setuptools' `packages` configuration.

2024-06-24T01:19:32,792           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-24T01:19:32,793           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-06-24T01:19:32,793           to the `packages` configuration field.

2024-06-24T01:19:32,794           Alternatively, you can also rely on setuptools' discovery methods
2024-06-24T01:19:32,794           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-24T01:19:32,795           instead of `find_packages(...)`/`find:`).

2024-06-24T01:19:32,796           You can read more about "package discovery" on setuptools documentation page:

2024-06-24T01:19:32,797           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-24T01:19:32,798           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-06-24T01:19:32,798           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-06-24T01:19:32,798           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-24T01:19:32,799           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-24T01:19:32,800           combination with a more fine grained `package-data` configuration.

2024-06-24T01:19:32,801           You can read more about "package data files" on setuptools documentation page:

2024-06-24T01:19:32,802           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-24T01:19:32,803           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-24T01:19:32,804                 even if it does not contain any `.py` files.
2024-06-24T01:19:32,804                 On the other hand, currently there is no concept of package data
2024-06-24T01:19:32,805                 directory, all directories are treated like packages.
2024-06-24T01:19:32,805           ********************************************************************************

2024-06-24T01:19:32,806   !!
2024-06-24T01:19:32,807     check.warn(importable)
2024-06-24T01:19:32,808   creating build/lib/alpaca_eval/evaluators_configs
2024-06-24T01:19:32,808   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-06-24T01:19:32,809   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:32,809   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:32,810   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:32,810   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:32,811   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:32,811   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:32,812   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:32,813   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:32,813   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:32,814   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:32,814   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:32,815   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:32,815   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-06-24T01:19:32,816   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-06-24T01:19:32,816   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-06-24T01:19:32,817   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-06-24T01:19:32,817   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:32,818   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:32,818   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:32,819   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:32,819   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:32,820   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:32,820   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:32,821   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:32,821   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:32,822   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,822   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,823   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,823   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,824   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,824   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,825   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,825   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,826   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,826   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,827   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,827   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,828   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,828   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:32,829   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:32,829   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:32,830   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:32,830   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:32,831   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:32,831   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:32,832   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-06-24T01:19:32,832   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-06-24T01:19:32,833   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-06-24T01:19:32,833   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-06-24T01:19:32,834   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:32,834   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:32,835   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:32,835   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:32,836   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:32,836   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:32,837   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:32,837   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:32,838   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:32,838   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-06-24T01:19:32,839   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-06-24T01:19:32,839   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:32,840   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:32,840   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:32,841   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:32,841   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:32,842   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:32,842   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-06-24T01:19:32,843   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-06-24T01:19:32,843   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:32,844   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:32,844   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:32,845   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-06-24T01:19:32,845   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-06-24T01:19:32,845   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-06-24T01:19:32,846   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-06-24T01:19:32,846   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-06-24T01:19:32,847   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-06-24T01:19:32,847   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:32,848   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:32,848   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:32,848   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:32,849   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:32,849   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:32,850   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-06-24T01:19:32,850   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-06-24T01:19:32,851   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-06-24T01:19:32,851   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-06-24T01:19:32,852   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:32,852   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:32,852   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:32,853   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-06-24T01:19:32,853   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-06-24T01:19:32,854   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-06-24T01:19:32,854   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-06-24T01:19:32,855   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:32,855   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:32,856   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:32,856   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-06-24T01:19:32,857   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-06-24T01:19:32,857   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:32,858   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:32,858   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:32,859   creating build/lib/alpaca_eval/evaluators_configs/test
2024-06-24T01:19:32,859   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-06-24T01:19:32,860   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:32,860   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:32,860   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:32,861   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-06-24T01:19:32,861   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-06-24T01:19:32,862   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-06-24T01:19:32,862   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-06-24T01:19:32,862   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-06-24T01:19:32,863   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-06-24T01:19:32,863   creating build/lib/alpaca_eval/leaderboards
2024-06-24T01:19:32,864   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:32,864   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:32,865   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:32,865   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:32,866   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:32,866   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,867   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,867   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,868   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,868   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,869   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:32,869   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-06-24T01:19:32,870   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-06-24T01:19:32,870   creating build/lib/alpaca_eval/models_configs
2024-06-24T01:19:32,871   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:32,871   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:32,872   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:32,872   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:32,872   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:32,873   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:32,873   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:32,874   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:32,874   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:32,874   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:32,875   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:32,875   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:32,876   creating build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-06-24T01:19:32,876   copying src/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-06-24T01:19:32,877   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:32,877   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:32,877   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:32,878   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:32,878   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:32,879   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:32,879   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:32,880   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:32,880   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:32,881   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-06-24T01:19:32,881   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-06-24T01:19:32,882   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-06-24T01:19:32,882   copying src/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-06-24T01:19:32,883   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-06-24T01:19:32,883   copying src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-06-24T01:19:32,884   creating build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:32,885   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:32,885   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:32,885   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-06-24T01:19:32,886   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-06-24T01:19:32,886   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:32,887   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:32,887   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:32,888   creating build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-06-24T01:19:32,888   copying src/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-06-24T01:19:32,889   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:32,889   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:32,889   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:32,890   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:32,890   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:32,891   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:32,891   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:32,892   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:32,892   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:32,893   creating build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:32,893   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:32,894   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:32,894   creating build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:32,895   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:32,895   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:32,896   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:32,896   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:32,897   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:32,897   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:32,898   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:32,899   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:32,899   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:32,900   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:32,900   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:32,900   creating build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-06-24T01:19:32,901   copying src/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-06-24T01:19:32,901   creating build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:32,902   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:32,902   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:32,903   creating build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-06-24T01:19:32,903   copying src/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-06-24T01:19:32,904   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:32,904   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:32,905   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:32,905   creating build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-06-24T01:19:32,906   copying src/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-06-24T01:19:32,906   creating build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:32,906   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:32,907   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:32,908   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:32,908   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:32,908   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:32,909   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-06-24T01:19:32,909   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-06-24T01:19:32,910   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:32,911   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:32,911   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:32,912   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-06-24T01:19:32,912   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-06-24T01:19:32,913   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-06-24T01:19:32,914   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-06-24T01:19:32,914   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:32,914   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:32,916   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:32,917   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:32,918   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:32,920   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:32,922   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:32,923   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:32,925   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:32,927   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-06-24T01:19:32,928   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-06-24T01:19:32,931   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-06-24T01:19:32,932   copying src/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-06-24T01:19:32,934   creating build/lib/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:32,935   copying src/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:32,937   copying src/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:32,939   creating build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-06-24T01:19:32,939   copying src/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-06-24T01:19:32,941   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-06-24T01:19:32,942   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-06-24T01:19:32,944   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:32,945   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:32,947   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:32,949   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:32,950   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:32,952   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:32,954   creating build/lib/alpaca_eval/models_configs/Together-MoA
2024-06-24T01:19:32,955   copying src/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA
2024-06-24T01:19:32,957   creating build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-06-24T01:19:32,958   copying src/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-06-24T01:19:32,960   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:32,961   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:32,963   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:32,965   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:32,966   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:32,969   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:32,971   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:32,972   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:32,974   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:32,975   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-06-24T01:19:32,976   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-06-24T01:19:32,978   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:32,979   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:32,981   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:32,983   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:32,985   creating build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:32,986   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:32,990   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:32,994   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:32,996   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:32,997   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:32,999   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:33,001   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:33,003   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:33,004   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:33,006   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:33,008   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:33,009   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:33,011   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:33,013   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-06-24T01:19:33,014   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-06-24T01:19:33,016   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-06-24T01:19:33,017   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-06-24T01:19:33,019   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-06-24T01:19:33,020   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-06-24T01:19:33,022   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-06-24T01:19:33,022   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-06-24T01:19:33,024   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:33,025   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:33,027   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:33,029   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:33,030   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:33,032   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:33,034   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-06-24T01:19:33,035   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-06-24T01:19:33,037   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-06-24T01:19:33,038   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-06-24T01:19:33,040   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-06-24T01:19:33,041   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-06-24T01:19:33,043   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:33,044   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:33,046   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:33,048   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:33,049   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:33,052   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:33,054   creating build/lib/alpaca_eval/models_configs/claude
2024-06-24T01:19:33,055   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-06-24T01:19:33,057   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-06-24T01:19:33,059   creating build/lib/alpaca_eval/models_configs/claude-2
2024-06-24T01:19:33,060   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-06-24T01:19:33,062   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-06-24T01:19:33,063   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-06-24T01:19:33,065   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:33,066   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:33,068   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:33,070   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:33,071   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:33,073   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:33,075   creating build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:33,076   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:33,078   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:33,080   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-06-24T01:19:33,081   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-06-24T01:19:33,083   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:33,084   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:33,086   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:33,088   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-06-24T01:19:33,089   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-06-24T01:19:33,091   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-06-24T01:19:33,092   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-06-24T01:19:33,094   creating build/lib/alpaca_eval/models_configs/cohere
2024-06-24T01:19:33,095   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-06-24T01:19:33,097   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-06-24T01:19:33,099   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:33,100   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:33,103   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:33,105   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-06-24T01:19:33,106   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-06-24T01:19:33,108   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:33,109   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:33,111   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:33,113   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-06-24T01:19:33,114   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-06-24T01:19:33,117   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-06-24T01:19:33,118   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-06-24T01:19:33,120   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-06-24T01:19:33,121   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-06-24T01:19:33,123   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-06-24T01:19:33,123   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-06-24T01:19:33,125   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-06-24T01:19:33,126   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-06-24T01:19:33,128   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-06-24T01:19:33,129   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-06-24T01:19:33,131   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:33,132   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:33,134   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:33,136   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-06-24T01:19:33,137   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-06-24T01:19:33,139   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-06-24T01:19:33,140   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-06-24T01:19:33,142   creating build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:33,143   copying src/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:33,145   copying src/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:33,147   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-06-24T01:19:33,148   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-06-24T01:19:33,150   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-06-24T01:19:33,152   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-06-24T01:19:33,154   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-06-24T01:19:33,155   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-06-24T01:19:33,158   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-06-24T01:19:33,159   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-06-24T01:19:33,161   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-06-24T01:19:33,162   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-06-24T01:19:33,164   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-06-24T01:19:33,165   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-06-24T01:19:33,167   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-06-24T01:19:33,168   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-06-24T01:19:33,171   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-06-24T01:19:33,171   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-06-24T01:19:33,173   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-06-24T01:19:33,174   copying src/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-06-24T01:19:33,176   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-06-24T01:19:33,177   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-06-24T01:19:33,180   creating build/lib/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:33,180   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:33,183   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:33,185   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-06-24T01:19:33,185   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-06-24T01:19:33,187   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-06-24T01:19:33,188   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-06-24T01:19:33,190   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-06-24T01:19:33,191   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-06-24T01:19:33,194   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-06-24T01:19:33,195   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-06-24T01:19:33,197   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:33,198   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:33,200   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:33,202   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:33,203   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:33,206   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:33,208   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:33,209   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:33,211   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:33,213   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-06-24T01:19:33,214   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-06-24T01:19:33,216   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-06-24T01:19:33,217   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-06-24T01:19:33,220   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-06-24T01:19:33,221   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-06-24T01:19:33,223   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-06-24T01:19:33,224   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-06-24T01:19:33,226   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-06-24T01:19:33,227   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-06-24T01:19:33,229   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:33,230   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:33,232   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:33,234   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:33,234   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:33,237   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:33,238   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-06-24T01:19:33,239   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-06-24T01:19:33,241   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-06-24T01:19:33,242   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-06-24T01:19:33,244   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:33,245   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:33,247   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:33,249   creating build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-06-24T01:19:33,250   copying src/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-06-24T01:19:33,252   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:33,253   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:33,255   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:33,257   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-06-24T01:19:33,258   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-06-24T01:19:33,260   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:33,261   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:33,264   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:33,266   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:33,267   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:33,269   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:33,272   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:33,273   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:33,275   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:33,277   creating build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:33,278   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:33,280   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:33,283   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-06-24T01:19:33,284   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-06-24T01:19:33,286   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:33,287   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:33,289   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:33,291   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:33,292   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:33,294   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:33,296   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-06-24T01:19:33,297   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-06-24T01:19:33,299   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:33,300   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:33,302   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:33,304   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:33,305   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:33,308   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:33,309   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:33,310   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:33,313   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:33,314   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-06-24T01:19:33,316   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-06-24T01:19:33,318   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:33,319   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:33,321   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:33,323   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:33,324   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:33,326   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:33,329   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:33,330   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:33,332   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:33,334   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:33,335   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:33,337   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:33,339   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:33,340   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:33,342   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:33,344   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:33,345   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:33,347   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:33,349   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:33,350   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:33,352   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:33,354   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:33,355   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:33,357   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:33,360   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:33,361   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:33,363   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:33,365   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-06-24T01:19:33,366   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-06-24T01:19:33,368   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-06-24T01:19:33,369   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-06-24T01:19:33,584   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-06-24T01:19:33,585   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-06-24T01:19:33,588   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-06-24T01:19:33,589   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-06-24T01:19:33,592   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-06-24T01:19:33,593   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-06-24T01:19:33,596   creating build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-06-24T01:19:33,598   copying src/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-06-24T01:19:33,601   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-06-24T01:19:33,602   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-06-24T01:19:33,604   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-06-24T01:19:33,605   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-06-24T01:19:33,608   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:33,609   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:33,611   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:33,614   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-06-24T01:19:33,615   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-06-24T01:19:33,618   creating build/lib/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:33,619   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:33,622   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:33,625   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:33,626   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:33,629   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:33,631   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:33,633   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:33,636   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:33,638   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:33,640   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:33,643   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:33,646   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-06-24T01:19:33,647   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-06-24T01:19:33,650   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-06-24T01:19:33,651   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-06-24T01:19:33,654   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-06-24T01:19:33,655   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-06-24T01:19:33,658   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-06-24T01:19:33,660   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-06-24T01:19:33,663   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:33,664   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:33,667   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:33,670   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-06-24T01:19:33,671   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-06-24T01:19:33,674   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-06-24T01:19:33,675   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-06-24T01:19:33,678   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:33,679   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:33,682   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:33,685   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-06-24T01:19:33,686   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-06-24T01:19:33,689   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-06-24T01:19:33,690   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-06-24T01:19:33,693   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-06-24T01:19:33,694   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-06-24T01:19:33,697   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:33,698   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:33,701   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:33,704   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:33,705   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:33,708   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:33,711   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:33,712   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:33,715   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:33,717   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:33,718   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:33,720   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:33,721   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-06-24T01:19:33,722   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-06-24T01:19:33,724   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-06-24T01:19:33,725   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-06-24T01:19:33,728   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-06-24T01:19:33,729   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-06-24T01:19:33,731   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-06-24T01:19:33,732   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-06-24T01:19:33,733   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-06-24T01:19:33,734   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-06-24T01:19:33,736   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:33,737   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:33,739   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:33,741   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-06-24T01:19:33,741   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-06-24T01:19:33,743   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-06-24T01:19:33,744   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-06-24T01:19:33,746   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:33,747   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:33,749   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:33,751   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-06-24T01:19:33,752   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-06-24T01:19:33,753   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-06-24T01:19:33,754   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-06-24T01:19:33,756   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-06-24T01:19:33,757   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-06-24T01:19:33,760   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-06-24T01:19:33,761   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-06-24T01:19:33,763   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-06-24T01:19:33,764   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-06-24T01:19:33,766   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-06-24T01:19:33,767   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-06-24T01:19:33,769   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:33,770   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:33,772   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:33,774   creating build/lib/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:33,775   copying src/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:33,777   copying src/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:33,779   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:33,780   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:33,782   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:33,784   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:33,785   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:33,787   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:33,789   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-06-24T01:19:33,789   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-06-24T01:19:33,791   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-06-24T01:19:33,797   copying src/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-06-24T01:19:33,833   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-06-24T01:19:33,834   !!

2024-06-24T01:19:33,836           ********************************************************************************
2024-06-24T01:19:33,837           Please avoid running ``setup.py`` directly.
2024-06-24T01:19:33,838           Instead, use pypa/build, pypa/installer or other
2024-06-24T01:19:33,838           standards-based tools.

2024-06-24T01:19:33,840           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-06-24T01:19:33,840           ********************************************************************************

2024-06-24T01:19:33,841   !!
2024-06-24T01:19:33,842     self.initialize_options()
2024-06-24T01:19:33,860   installing to build/bdist.linux-armv7l/wheel
2024-06-24T01:19:33,861   running install
2024-06-24T01:19:33,885   running install_lib
2024-06-24T01:19:33,909   creating build/bdist.linux-armv7l
2024-06-24T01:19:33,909   creating build/bdist.linux-armv7l/wheel
2024-06-24T01:19:33,911   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:33,912   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:33,915   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:33,917   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:33,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-06-24T01:19:33,921   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:33,922   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:33,926   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-06-24T01:19:33,928   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:33,929   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:33,931   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-06-24T01:19:33,933   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,934   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,937   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,939   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,940   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,942   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,944   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,946   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,948   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,950   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,952   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,954   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,956   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,958   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-06-24T01:19:33,961   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:33,962   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:33,964   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-06-24T01:19:33,966   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:33,967   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:33,969   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-06-24T01:19:33,971   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:33,972   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:33,974   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-06-24T01:19:33,976   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:33,977   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:33,979   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-06-24T01:19:33,981   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:33,982   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:33,983   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-06-24T01:19:33,985   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:33,986   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:33,988   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-06-24T01:19:33,991   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-06-24T01:19:33,992   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-06-24T01:19:33,994   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:33,995   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:33,997   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-06-24T01:19:33,999   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-06-24T01:19:34,001   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-06-24T01:19:34,003   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:34,004   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:34,006   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-06-24T01:19:34,009   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-06-24T01:19:34,010   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-06-24T01:19:34,012   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:34,013   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:34,015   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-06-24T01:19:34,017   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:34,018   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:34,020   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-06-24T01:19:34,022   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:34,023   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:34,025   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-06-24T01:19:34,027   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-06-24T01:19:34,028   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-06-24T01:19:34,030   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-06-24T01:19:34,031   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-06-24T01:19:34,033   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-06-24T01:19:34,034   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-06-24T01:19:34,036   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-06-24T01:19:34,037   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-06-24T01:19:34,039   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:34,040   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:34,042   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-06-24T01:19:34,044   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:34,045   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:34,047   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-06-24T01:19:34,049   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-06-24T01:19:34,050   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-06-24T01:19:34,053   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-06-24T01:19:34,053   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-06-24T01:19:34,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:34,057   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:34,058   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-06-24T01:19:34,061   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-06-24T01:19:34,062   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-06-24T01:19:34,065   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:34,066   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:34,068   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-06-24T01:19:34,070   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-06-24T01:19:34,071   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-06-24T01:19:34,073   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-06-24T01:19:34,076   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-06-24T01:19:34,077   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-06-24T01:19:34,079   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-06-24T01:19:34,080   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-06-24T01:19:34,082   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-06-24T01:19:34,083   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-06-24T01:19:34,085   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:34,086   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:34,088   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-06-24T01:19:34,090   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:34,091   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:34,092   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-06-24T01:19:34,095   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:34,096   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:34,098   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-06-24T01:19:34,100   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-06-24T01:19:34,101   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-06-24T01:19:34,103   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-06-24T01:19:34,104   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-06-24T01:19:34,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-06-24T01:19:34,108   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-06-24T01:19:34,110   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:34,110   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:34,113   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-06-24T01:19:34,115   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-06-24T01:19:34,115   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-06-24T01:19:34,117   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,119   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-06-24T01:19:34,120   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-06-24T01:19:34,122   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-06-24T01:19:34,124   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-06-24T01:19:34,127   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,130   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-06-24T01:19:34,131   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-06-24T01:19:34,133   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-06-24T01:19:34,135   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-06-24T01:19:34,137   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-06-24T01:19:34,143   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-06-24T01:19:34,144   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:34,145   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:34,147   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-06-24T01:19:34,149   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:34,150   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:34,152   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-06-24T01:19:34,154   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-06-24T01:19:34,155   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-06-24T01:19:34,158   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:34,159   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:34,161   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-06-24T01:19:34,163   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,164   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,166   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-06-24T01:19:34,167   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-06-24T01:19:34,169   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:34,170   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:34,172   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-06-24T01:19:34,174   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-06-24T01:19:34,175   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-06-24T01:19:34,177   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-06-24T01:19:34,178   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-06-24T01:19:34,181   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:34,182   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:34,185   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-06-24T01:19:34,187   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:34,188   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:34,191   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-06-24T01:19:34,194   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-06-24T01:19:34,195   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-06-24T01:19:34,197   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-06-24T01:19:34,198   copying build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-06-24T01:19:34,200   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:34,201   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:34,203   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-06-24T01:19:34,206   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:34,207   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:34,209   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-06-24T01:19:34,211   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:34,212   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:34,213   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-06-24T01:19:34,215   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-06-24T01:19:34,216   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-06-24T01:19:34,218   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:34,219   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:34,221   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-06-24T01:19:34,223   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-06-24T01:19:34,224   copying build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-06-24T01:19:34,226   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:34,227   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:34,229   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-06-24T01:19:34,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-06-24T01:19:34,232   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-06-24T01:19:34,234   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:34,235   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:34,238   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-06-24T01:19:34,240   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-06-24T01:19:34,241   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-06-24T01:19:34,244   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:34,245   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:34,247   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-06-24T01:19:34,249   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-06-24T01:19:34,250   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-06-24T01:19:34,253   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-06-24T01:19:34,253   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-06-24T01:19:34,256   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-06-24T01:19:34,256   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-06-24T01:19:34,259   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-06-24T01:19:34,259   copying build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-06-24T01:19:34,262   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-06-24T01:19:34,262   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-06-24T01:19:34,264   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-06-24T01:19:34,265   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-06-24T01:19:34,267   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:34,268   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:34,270   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-06-24T01:19:34,272   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:34,273   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:34,275   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-06-24T01:19:34,277   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-06-24T01:19:34,278   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-06-24T01:19:34,281   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:34,282   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:34,284   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-06-24T01:19:34,286   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-06-24T01:19:34,287   copying build/lib/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-06-24T01:19:34,289   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-06-24T01:19:34,290   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-06-24T01:19:34,292   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-06-24T01:19:34,293   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-06-24T01:19:34,296   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:34,296   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:34,298   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-06-24T01:19:34,300   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:34,301   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:34,302   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-06-24T01:19:34,305   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-06-24T01:19:34,305   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-06-24T01:19:34,308   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:34,308   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:34,310   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-06-24T01:19:34,312   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:34,313   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:34,315   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-06-24T01:19:34,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:34,319   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:34,321   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-06-24T01:19:34,323   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-06-24T01:19:34,324   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-06-24T01:19:34,326   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:34,327   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:34,329   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-06-24T01:19:34,331   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-06-24T01:19:34,332   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-06-24T01:19:34,335   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-06-24T01:19:34,336   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-06-24T01:19:34,338   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:34,339   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:34,341   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:34,342   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-06-24T01:19:34,344   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-06-24T01:19:34,345   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-06-24T01:19:34,348   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:34,349   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:34,350   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-06-24T01:19:34,353   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:34,354   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:34,356   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-06-24T01:19:34,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:34,361   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:34,364   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-06-24T01:19:34,368   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:34,370   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:34,372   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-06-24T01:19:34,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:34,375   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:34,377   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-06-24T01:19:34,379   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:34,380   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:34,382   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-06-24T01:19:34,385   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-06-24T01:19:34,386   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-06-24T01:19:34,388   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:34,389   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:34,391   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-06-24T01:19:34,393   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-06-24T01:19:34,394   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-06-24T01:19:34,396   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-06-24T01:19:34,397   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-06-24T01:19:34,399   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:34,400   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:34,402   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-06-24T01:19:34,404   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-06-24T01:19:34,405   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-06-24T01:19:34,407   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:34,408   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:34,410   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-06-24T01:19:34,413   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-06-24T01:19:34,414   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-06-24T01:19:34,416   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:34,417   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:34,419   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-06-24T01:19:34,421   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:34,422   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:34,424   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-06-24T01:19:34,426   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:34,427   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:34,429   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-06-24T01:19:34,431   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-06-24T01:19:34,432   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-06-24T01:19:34,434   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:34,435   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:34,437   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-06-24T01:19:34,439   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-06-24T01:19:34,440   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-06-24T01:19:34,442   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-06-24T01:19:34,443   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-06-24T01:19:34,445   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-06-24T01:19:34,446   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-06-24T01:19:34,449   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:34,449   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:34,451   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-06-24T01:19:34,454   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:34,454   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:34,457   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-06-24T01:19:34,459   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-06-24T01:19:34,460   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-06-24T01:19:34,463   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-06-24T01:19:34,464   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-06-24T01:19:34,466   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-06-24T01:19:34,467   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-06-24T01:19:34,469   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-06-24T01:19:34,471   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:34,472   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:34,474   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-06-24T01:19:34,476   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:34,477   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:34,479   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-06-24T01:19:34,481   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:34,482   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:34,484   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-06-24T01:19:34,486   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-06-24T01:19:34,487   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-06-24T01:19:34,490   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-06-24T01:19:34,492   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:34,493   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:34,495   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-06-24T01:19:34,497   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-06-24T01:19:34,498   copying build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-06-24T01:19:34,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:34,501   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:34,503   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-06-24T01:19:34,505   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-06-24T01:19:34,506   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-06-24T01:19:34,509   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-06-24T01:19:34,510   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-06-24T01:19:34,512   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-06-24T01:19:34,513   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-06-24T01:19:34,515   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:34,516   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:34,519   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-06-24T01:19:34,521   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:34,522   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:34,524   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-06-24T01:19:34,526   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:34,527   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:34,530   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-06-24T01:19:34,534   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:34,536   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:34,538   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-06-24T01:19:34,542   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-06-24T01:19:34,545   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-06-24T01:19:34,549   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-06-24T01:19:34,550   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-06-24T01:19:34,553   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-06-24T01:19:34,554   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-06-24T01:19:34,556   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-06-24T01:19:34,557   copying build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-06-24T01:19:34,560   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-06-24T01:19:34,561   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-06-24T01:19:34,563   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-06-24T01:19:34,564   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-06-24T01:19:34,566   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-06-24T01:19:34,567   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-06-24T01:19:34,569   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:34,570   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:34,572   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-06-24T01:19:34,575   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-06-24T01:19:34,576   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-06-24T01:19:34,578   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:34,579   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:34,580   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-06-24T01:19:34,582   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:34,583   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:34,585   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-06-24T01:19:34,587   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:34,588   copying build/lib/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:34,590   copying build/lib/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-06-24T01:19:34,592   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-06-24T01:19:34,593   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-06-24T01:19:34,595   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-06-24T01:19:34,596   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-06-24T01:19:34,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-06-24T01:19:34,599   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-06-24T01:19:34,602   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:34,603   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:34,604   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-06-24T01:19:34,607   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-06-24T01:19:34,608   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-06-24T01:19:34,610   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:34,611   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:34,613   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-06-24T01:19:34,615   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-06-24T01:19:34,616   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-06-24T01:19:34,618   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:34,619   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:34,621   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-06-24T01:19:34,623   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-06-24T01:19:34,623   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-06-24T01:19:34,625   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:34,626   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:34,628   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-06-24T01:19:34,630   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-06-24T01:19:34,631   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-06-24T01:19:34,633   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:34,634   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:34,636   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-06-24T01:19:34,638   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-06-24T01:19:34,639   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-06-24T01:19:34,641   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:34,642   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:34,644   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-06-24T01:19:34,646   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:34,647   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:34,649   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-06-24T01:19:34,651   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:34,652   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:34,654   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-06-24T01:19:34,656   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,657   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,659   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,661   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-06-24T01:19:34,663   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-06-24T01:19:34,664   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-06-24T01:19:34,666   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-06-24T01:19:34,666   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-06-24T01:19:34,669   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-06-24T01:19:34,669   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-06-24T01:19:34,671   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:34,672   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:34,674   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-06-24T01:19:34,676   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-06-24T01:19:34,677   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-06-24T01:19:34,679   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-06-24T01:19:34,680   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-06-24T01:19:34,682   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-06-24T01:19:34,683   copying build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-06-24T01:19:34,685   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:34,686   copying build/lib/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:34,688   copying build/lib/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-06-24T01:19:34,690   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-06-24T01:19:34,691   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-06-24T01:19:34,693   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-06-24T01:19:34,694   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-06-24T01:19:34,696   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-06-24T01:19:34,697   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-06-24T01:19:34,699   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-06-24T01:19:34,700   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-06-24T01:19:34,702   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-06-24T01:19:34,703   copying build/lib/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-06-24T01:19:34,705   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-06-24T01:19:34,706   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-06-24T01:19:34,708   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:34,709   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:34,711   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-06-24T01:19:34,713   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-06-24T01:19:34,714   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-06-24T01:19:34,716   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:34,717   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:34,719   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-06-24T01:19:34,721   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:34,722   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:34,724   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-06-24T01:19:34,726   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-06-24T01:19:34,727   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-06-24T01:19:34,729   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:34,730   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:34,732   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-06-24T01:19:34,734   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-06-24T01:19:34,735   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-06-24T01:19:34,737   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:34,738   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:34,740   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-06-24T01:19:34,742   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-06-24T01:19:34,743   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-06-24T01:19:34,745   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:34,746   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:34,748   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-06-24T01:19:34,750   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-06-24T01:19:34,750   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-06-24T01:19:34,753   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:34,753   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:34,755   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-06-24T01:19:34,757   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-06-24T01:19:34,758   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-06-24T01:19:34,761   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:34,761   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:34,763   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-06-24T01:19:34,765   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-06-24T01:19:34,766   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-06-24T01:19:34,768   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:34,769   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:34,771   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-06-24T01:19:34,773   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-06-24T01:19:34,774   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-06-24T01:19:34,776   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:34,777   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:34,779   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-06-24T01:19:34,781   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:34,782   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:34,784   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-06-24T01:19:34,786   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:34,787   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:34,789   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-06-24T01:19:34,791   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:34,792   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:34,794   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-06-24T01:19:34,796   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-06-24T01:19:34,796   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-06-24T01:19:34,799   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:34,800   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:34,801   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-06-24T01:19:34,803   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-06-24T01:19:34,804   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-06-24T01:19:34,806   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-06-24T01:19:34,807   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-06-24T01:19:34,809   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-06-24T01:19:34,810   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-06-24T01:19:34,813   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-06-24T01:19:34,814   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-06-24T01:19:34,816   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-06-24T01:19:34,817   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-06-24T01:19:34,819   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-06-24T01:19:34,820   copying build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-06-24T01:19:34,822   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:34,823   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:34,825   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-06-24T01:19:34,827   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-06-24T01:19:34,828   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-06-24T01:19:34,830   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:34,831   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:34,833   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-06-24T01:19:34,835   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:34,836   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:34,837   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-06-24T01:19:34,839   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:34,840   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:34,842   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-06-24T01:19:34,844   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:34,845   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:34,847   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-06-24T01:19:34,849   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-06-24T01:19:34,850   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-06-24T01:19:34,853   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:34,854   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:34,855   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-06-24T01:19:34,857   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-06-24T01:19:34,858   copying build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-06-24T01:19:34,861   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-06-24T01:19:34,861   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-06-24T01:19:34,864   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-06-24T01:19:34,865   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-06-24T01:19:34,867   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-06-24T01:19:34,868   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-06-24T01:19:34,870   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-06-24T01:19:34,871   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-06-24T01:19:34,873   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-06-24T01:19:34,874   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-06-24T01:19:34,876   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:34,877   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:34,878   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-06-24T01:19:34,880   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:34,881   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:34,883   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-06-24T01:19:34,885   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-06-24T01:19:34,886   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-06-24T01:19:34,888   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-06-24T01:19:34,889   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-06-24T01:19:34,891   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:34,892   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:34,894   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-06-24T01:19:34,896   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:34,897   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:34,899   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:34,900   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-06-24T01:19:34,903   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-06-24T01:19:34,904   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-06-24T01:19:34,906   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-06-24T01:19:34,907   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-06-24T01:19:34,909   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-06-24T01:19:34,910   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-06-24T01:19:34,913   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:34,914   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:34,916   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-06-24T01:19:34,918   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:34,919   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:34,921   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-06-24T01:19:34,923   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:34,924   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:34,926   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-06-24T01:19:34,929   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:34,929   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:34,931   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-06-24T01:19:34,934   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-06-24T01:19:34,934   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-06-24T01:19:34,937   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:34,938   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:34,940   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-06-24T01:19:34,942   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-06-24T01:19:34,943   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-06-24T01:19:34,945   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,947   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,951   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,952   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,954   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,956   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,958   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,960   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,962   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,964   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,966   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,968   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,970   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,971   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-06-24T01:19:34,974   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,976   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-06-24T01:19:34,979   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-06-24T01:19:34,981   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-06-24T01:19:34,981   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-06-24T01:19:34,984   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:34,985   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:34,987   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:34,989   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:34,991   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-06-24T01:19:34,993   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:34,994   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:34,996   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:34,998   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:35,000   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:35,001   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-06-24T01:19:35,004   running install_egg_info
2024-06-24T01:19:35,035   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.3-py3.11.egg-info
2024-06-24T01:19:35,048   running install_scripts
2024-06-24T01:19:35,091   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.3.dist-info/WHEEL
2024-06-24T01:19:35,094   creating '/tmp/pip-wheel-0oghweyw/alpaca_eval-0.6.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-06-24T01:19:35,096   adding 'alpaca_eval/__init__.py'
2024-06-24T01:19:35,099   adding 'alpaca_eval/analyze.py'
2024-06-24T01:19:35,101   adding 'alpaca_eval/completion_parsers.py'
2024-06-24T01:19:35,103   adding 'alpaca_eval/constants.py'
2024-06-24T01:19:35,106   adding 'alpaca_eval/main.py'
2024-06-24T01:19:35,110   adding 'alpaca_eval/plotting.py'
2024-06-24T01:19:35,112   adding 'alpaca_eval/processors.py'
2024-06-24T01:19:35,113   adding 'alpaca_eval/types.py'
2024-06-24T01:19:35,116   adding 'alpaca_eval/utils.py'
2024-06-24T01:19:35,117   adding 'alpaca_eval/annotators/__init__.py'
2024-06-24T01:19:35,121   adding 'alpaca_eval/annotators/base.py'
2024-06-24T01:19:35,124   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-06-24T01:19:35,126   adding 'alpaca_eval/decoders/__init__.py'
2024-06-24T01:19:35,127   adding 'alpaca_eval/decoders/anthropic.py'
2024-06-24T01:19:35,129   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-06-24T01:19:35,130   adding 'alpaca_eval/decoders/cohere.py'
2024-06-24T01:19:35,131   adding 'alpaca_eval/decoders/google.py'
2024-06-24T01:19:35,133   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-06-24T01:19:35,135   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-06-24T01:19:35,136   adding 'alpaca_eval/decoders/jinachat.py'
2024-06-24T01:19:35,139   adding 'alpaca_eval/decoders/openai.py'
2024-06-24T01:19:35,140   adding 'alpaca_eval/decoders/replicate.py'
2024-06-24T01:19:35,141   adding 'alpaca_eval/decoders/vllm_local.py'
2024-06-24T01:19:35,144   adding 'alpaca_eval/evaluators_configs/README.md'
2024-06-24T01:19:35,146   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-06-24T01:19:35,147   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-06-24T01:19:35,149   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-06-24T01:19:35,150   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-06-24T01:19:35,152   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-06-24T01:19:35,153   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-06-24T01:19:35,155   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-06-24T01:19:35,156   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-06-24T01:19:35,157   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-06-24T01:19:35,159   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-06-24T01:19:35,160   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-06-24T01:19:35,162   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-06-24T01:19:35,164   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-06-24T01:19:35,165   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-06-24T01:19:35,166   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt'
2024-06-24T01:19:35,168   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml'
2024-06-24T01:19:35,169   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-06-24T01:19:35,171   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-06-24T01:19:35,172   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-06-24T01:19:35,174   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-06-24T01:19:35,175   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-06-24T01:19:35,177   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-06-24T01:19:35,178   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-06-24T01:19:35,180   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-06-24T01:19:35,181   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-06-24T01:19:35,182   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-06-24T01:19:35,184   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-06-24T01:19:35,185   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-06-24T01:19:35,186   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-06-24T01:19:35,189   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-06-24T01:19:35,190   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-06-24T01:19:35,191   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-06-24T01:19:35,192   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-06-24T01:19:35,194   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-06-24T01:19:35,195   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-06-24T01:19:35,197   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-06-24T01:19:35,198   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-06-24T01:19:35,200   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-06-24T01:19:35,201   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-06-24T01:19:35,202   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-06-24T01:19:35,203   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-06-24T01:19:35,205   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-06-24T01:19:35,207   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-06-24T01:19:35,208   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-06-24T01:19:35,210   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-06-24T01:19:35,211   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-06-24T01:19:35,213   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-06-24T01:19:35,215   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-06-24T01:19:35,216   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-06-24T01:19:35,218   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-06-24T01:19:35,219   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-06-24T01:19:35,221   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-06-24T01:19:35,223   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-06-24T01:19:35,224   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-06-24T01:19:35,225   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-06-24T01:19:35,227   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-06-24T01:19:35,229   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-06-24T01:19:35,230   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-06-24T01:19:35,232   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-06-24T01:19:35,233   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-06-24T01:19:35,235   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-06-24T01:19:35,236   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-06-24T01:19:35,238   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-06-24T01:19:35,240   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-06-24T01:19:35,241   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-06-24T01:19:35,243   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-06-24T01:19:35,244   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-06-24T01:19:35,246   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-06-24T01:19:35,248   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-06-24T01:19:35,249   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-06-24T01:19:35,250   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-06-24T01:19:35,252   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-06-24T01:19:35,254   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml'
2024-06-24T01:19:35,256   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-06-24T01:19:35,258   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-06-24T01:19:35,259   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-06-24T01:19:35,260   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-06-24T01:19:35,262   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-06-24T01:19:35,263   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-06-24T01:19:35,264   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-06-24T01:19:35,265   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-06-24T01:19:35,269   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-06-24T01:19:35,271   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-06-24T01:19:35,273   adding 'alpaca_eval/metrics/__init__.py'
2024-06-24T01:19:35,275   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-06-24T01:19:35,276   adding 'alpaca_eval/metrics/helpers.py'
2024-06-24T01:19:35,278   adding 'alpaca_eval/metrics/winrate.py'
2024-06-24T01:19:35,283   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-06-24T01:19:35,284   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-06-24T01:19:35,285   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-06-24T01:19:35,287   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-06-24T01:19:35,288   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-06-24T01:19:35,289   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-06-24T01:19:35,291   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-06-24T01:19:35,292   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-06-24T01:19:35,294   adding 'alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml'
2024-06-24T01:19:35,295   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml'
2024-06-24T01:19:35,296   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt'
2024-06-24T01:19:35,298   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-06-24T01:19:35,299   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-06-24T01:19:35,301   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml'
2024-06-24T01:19:35,302   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt'
2024-06-24T01:19:35,304   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml'
2024-06-24T01:19:35,305   adding 'alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml'
2024-06-24T01:19:35,307   adding 'alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml'
2024-06-24T01:19:35,308   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml'
2024-06-24T01:19:35,310   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt'
2024-06-24T01:19:35,311   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-06-24T01:19:35,313   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-06-24T01:19:35,314   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-06-24T01:19:35,315   adding 'alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml'
2024-06-24T01:19:35,317   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-06-24T01:19:35,318   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-06-24T01:19:35,320   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-06-24T01:19:35,321   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-06-24T01:19:35,322   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-06-24T01:19:35,323   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-06-24T01:19:35,325   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml'
2024-06-24T01:19:35,326   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt'
2024-06-24T01:19:35,328   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml'
2024-06-24T01:19:35,329   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt'
2024-06-24T01:19:35,330   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-06-24T01:19:35,332   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-06-24T01:19:35,334   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-06-24T01:19:35,335   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-06-24T01:19:35,336   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-06-24T01:19:35,337   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-06-24T01:19:35,339   adding 'alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml'
2024-06-24T01:19:35,341   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml'
2024-06-24T01:19:35,342   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt'
2024-06-24T01:19:35,344   adding 'alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml'
2024-06-24T01:19:35,346   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-06-24T01:19:35,347   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-06-24T01:19:35,349   adding 'alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml'
2024-06-24T01:19:35,350   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml'
2024-06-24T01:19:35,352   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt'
2024-06-24T01:19:35,353   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml'
2024-06-24T01:19:35,354   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt'
2024-06-24T01:19:35,356   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml'
2024-06-24T01:19:35,358   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-06-24T01:19:35,359   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-06-24T01:19:35,360   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-06-24T01:19:35,362   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-06-24T01:19:35,364   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-06-24T01:19:35,365   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-06-24T01:19:35,366   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-06-24T01:19:35,368   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-06-24T01:19:35,369   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-06-24T01:19:35,370   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-06-24T01:19:35,372   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml'
2024-06-24T01:19:35,373   adding 'alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml'
2024-06-24T01:19:35,375   adding 'alpaca_eval/models_configs/Storm-7B/configs.yaml'
2024-06-24T01:19:35,376   adding 'alpaca_eval/models_configs/Storm-7B/prompt.txt'
2024-06-24T01:19:35,377   adding 'alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml'
2024-06-24T01:19:35,379   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-06-24T01:19:35,380   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-06-24T01:19:35,381   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-06-24T01:19:35,383   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-06-24T01:19:35,384   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-06-24T01:19:35,386   adding 'alpaca_eval/models_configs/Together-MoA/configs.yaml'
2024-06-24T01:19:35,387   adding 'alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml'
2024-06-24T01:19:35,389   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-06-24T01:19:35,390   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-06-24T01:19:35,391   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-06-24T01:19:35,392   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-06-24T01:19:35,394   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-06-24T01:19:35,395   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-06-24T01:19:35,396   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-06-24T01:19:35,398   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-06-24T01:19:35,399   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-06-24T01:19:35,400   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-06-24T01:19:35,402   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml'
2024-06-24T01:19:35,403   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml'
2024-06-24T01:19:35,404   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt'
2024-06-24T01:19:35,406   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-06-24T01:19:35,407   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-06-24T01:19:35,408   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-06-24T01:19:35,410   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-06-24T01:19:35,411   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-06-24T01:19:35,413   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-06-24T01:19:35,414   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-06-24T01:19:35,415   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-06-24T01:19:35,417   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-06-24T01:19:35,419   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-06-24T01:19:35,420   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-06-24T01:19:35,422   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-06-24T01:19:35,423   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-06-24T01:19:35,425   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-06-24T01:19:35,426   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-06-24T01:19:35,427   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-06-24T01:19:35,429   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-06-24T01:19:35,431   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-06-24T01:19:35,432   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-06-24T01:19:35,433   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-06-24T01:19:35,435   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-06-24T01:19:35,436   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-06-24T01:19:35,437   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-06-24T01:19:35,438   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-06-24T01:19:35,440   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-06-24T01:19:35,441   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-06-24T01:19:35,443   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-06-24T01:19:35,444   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-06-24T01:19:35,445   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-06-24T01:19:35,446   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-06-24T01:19:35,448   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml'
2024-06-24T01:19:35,449   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt'
2024-06-24T01:19:35,450   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-06-24T01:19:35,452   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-06-24T01:19:35,453   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-06-24T01:19:35,454   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-06-24T01:19:35,456   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-06-24T01:19:35,457   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-06-24T01:19:35,459   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-06-24T01:19:35,460   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-06-24T01:19:35,461   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-06-24T01:19:35,463   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-06-24T01:19:35,464   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-06-24T01:19:35,466   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-06-24T01:19:35,467   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-06-24T01:19:35,469   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-06-24T01:19:35,471   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-06-24T01:19:35,472   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-06-24T01:19:35,474   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-06-24T01:19:35,476   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-06-24T01:19:35,477   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-06-24T01:19:35,478   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-06-24T01:19:35,480   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-06-24T01:19:35,481   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-06-24T01:19:35,483   adding 'alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml'
2024-06-24T01:19:35,484   adding 'alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt'
2024-06-24T01:19:35,486   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-06-24T01:19:35,488   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-06-24T01:19:35,489   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-06-24T01:19:35,491   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-06-24T01:19:35,492   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-06-24T01:19:35,494   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-06-24T01:19:35,495   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-06-24T01:19:35,497   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-06-24T01:19:35,498   adding 'alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml'
2024-06-24T01:19:35,499   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-06-24T01:19:35,501   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-06-24T01:19:35,502   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-06-24T01:19:35,503   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-06-24T01:19:35,505   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-06-24T01:19:35,506   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-06-24T01:19:35,508   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-06-24T01:19:35,509   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-06-24T01:19:35,510   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-06-24T01:19:35,512   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-06-24T01:19:35,513   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-06-24T01:19:35,514   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-06-24T01:19:35,515   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-06-24T01:19:35,517   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-06-24T01:19:35,519   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-06-24T01:19:35,520   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-06-24T01:19:35,522   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-06-24T01:19:35,523   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-06-24T01:19:35,525   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-06-24T01:19:35,526   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-06-24T01:19:35,528   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-06-24T01:19:35,529   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-06-24T01:19:35,530   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-06-24T01:19:35,532   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml'
2024-06-24T01:19:35,534   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-06-24T01:19:35,535   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-06-24T01:19:35,536   adding 'alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml'
2024-06-24T01:19:35,538   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-06-24T01:19:35,539   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-06-24T01:19:35,541   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-06-24T01:19:35,542   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-06-24T01:19:35,543   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-06-24T01:19:35,545   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-06-24T01:19:35,546   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-06-24T01:19:35,548   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-06-24T01:19:35,549   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-06-24T01:19:35,551   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml'
2024-06-24T01:19:35,552   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt'
2024-06-24T01:19:35,554   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-06-24T01:19:35,555   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-06-24T01:19:35,557   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-06-24T01:19:35,558   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-06-24T01:19:35,559   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-06-24T01:19:35,561   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-06-24T01:19:35,562   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-06-24T01:19:35,563   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-06-24T01:19:35,565   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-06-24T01:19:35,566   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-06-24T01:19:35,567   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-06-24T01:19:35,568   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-06-24T01:19:35,570   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-06-24T01:19:35,571   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-06-24T01:19:35,572   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-06-24T01:19:35,574   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-06-24T01:19:35,575   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-06-24T01:19:35,577   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-06-24T01:19:35,578   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-06-24T01:19:35,579   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-06-24T01:19:35,580   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-06-24T01:19:35,582   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-06-24T01:19:35,583   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-06-24T01:19:35,585   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-06-24T01:19:35,586   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-06-24T01:19:35,588   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-06-24T01:19:35,589   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-06-24T01:19:35,591   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-06-24T01:19:35,592   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-06-24T01:19:35,594   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-06-24T01:19:35,595   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-06-24T01:19:35,597   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-06-24T01:19:35,599   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-06-24T01:19:35,600   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-06-24T01:19:35,602   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-06-24T01:19:35,603   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-06-24T01:19:35,605   adding 'alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml'
2024-06-24T01:19:35,607   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-06-24T01:19:35,608   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-06-24T01:19:35,610   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-06-24T01:19:35,611   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-06-24T01:19:35,613   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-06-24T01:19:35,615   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-06-24T01:19:35,616   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-06-24T01:19:35,618   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-06-24T01:19:35,619   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-06-24T01:19:35,621   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-06-24T01:19:35,621   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-06-24T01:19:35,623   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-06-24T01:19:35,624   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-06-24T01:19:35,626   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-06-24T01:19:35,627   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-06-24T01:19:35,629   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-06-24T01:19:35,630   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-06-24T01:19:35,631   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-06-24T01:19:35,633   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-06-24T01:19:35,634   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-06-24T01:19:35,636   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml'
2024-06-24T01:19:35,637   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-06-24T01:19:35,639   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-06-24T01:19:35,640   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml'
2024-06-24T01:19:35,642   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-06-24T01:19:35,643   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml'
2024-06-24T01:19:35,645   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-06-24T01:19:35,646   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-06-24T01:19:35,647   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-06-24T01:19:35,649   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-06-24T01:19:35,650   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-06-24T01:19:35,651   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-06-24T01:19:35,653   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-06-24T01:19:35,654   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-06-24T01:19:35,656   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-06-24T01:19:35,659   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-06-24T01:19:35,660   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-06-24T01:19:35,662   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml'
2024-06-24T01:19:35,663   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-06-24T01:19:35,665   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-06-24T01:19:35,666   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-06-24T01:19:35,668   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-06-24T01:19:35,670   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-06-24T01:19:35,671   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-06-24T01:19:35,672   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-06-24T01:19:35,674   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-06-24T01:19:35,675   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-06-24T01:19:35,677   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-06-24T01:19:35,679   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-06-24T01:19:35,680   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-06-24T01:19:35,682   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-06-24T01:19:35,684   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-06-24T01:19:35,685   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-06-24T01:19:35,687   adding 'alpaca_eval/models_configs/yi-large-preview/configs.yaml'
2024-06-24T01:19:35,688   adding 'alpaca_eval/models_configs/yi-large-preview/prompt.txt'
2024-06-24T01:19:35,689   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-06-24T01:19:35,690   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-06-24T01:19:35,692   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml'
2024-06-24T01:19:35,693   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt'
2024-06-24T01:19:35,694   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-06-24T01:19:35,696   adding 'alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml'
2024-06-24T01:19:35,698   adding 'alpaca_eval-0.6.3.dist-info/LICENSE'
2024-06-24T01:19:35,710   adding 'alpaca_eval-0.6.3.dist-info/METADATA'
2024-06-24T01:19:35,712   adding 'alpaca_eval-0.6.3.dist-info/WHEEL'
2024-06-24T01:19:35,713   adding 'alpaca_eval-0.6.3.dist-info/entry_points.txt'
2024-06-24T01:19:35,713   adding 'alpaca_eval-0.6.3.dist-info/top_level.txt'
2024-06-24T01:19:35,720   adding 'alpaca_eval-0.6.3.dist-info/RECORD'
2024-06-24T01:19:35,730   removing build/bdist.linux-armv7l/wheel
2024-06-24T01:19:36,052   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-06-24T01:19:36,057   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.3-py3-none-any.whl size=321706 sha256=fe5ebfbbbbfd8d774873f20b778cf9b914febe7f116e1a82ac86186a804da4f5
2024-06-24T01:19:36,058   Stored in directory: /tmp/pip-ephem-wheel-cache-zlwsasyr/wheels/c6/fe/ff/d0f021160ffe05dacbdc9afc191e92d188a461f26fade37ca4
2024-06-24T01:19:36,096 Successfully built alpaca-eval
2024-06-24T01:19:36,106 Removed build tracker: '/tmp/pip-build-tracker-b8ihxdkz'