2024-08-19T18:19:50,081 Created temporary directory: /tmp/pip-build-tracker-hn7a_tix
2024-08-19T18:19:50,082 Initialized build tracking at /tmp/pip-build-tracker-hn7a_tix
2024-08-19T18:19:50,082 Created build tracker: /tmp/pip-build-tracker-hn7a_tix
2024-08-19T18:19:50,083 Entered build tracker: /tmp/pip-build-tracker-hn7a_tix
2024-08-19T18:19:50,084 Created temporary directory: /tmp/pip-wheel-3spgmp03
2024-08-19T18:19:50,087 Created temporary directory: /tmp/pip-ephem-wheel-cache-pudyoq7s
2024-08-19T18:19:50,131 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-08-19T18:19:50,134 2 location(s) to search for versions of alpaca-eval:
2024-08-19T18:19:50,134 * https://pypi.org/simple/alpaca-eval/
2024-08-19T18:19:50,134 * https://www.piwheels.org/simple/alpaca-eval/
2024-08-19T18:19:50,135 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-08-19T18:19:50,135 Getting page https://pypi.org/simple/alpaca-eval/
2024-08-19T18:19:50,137 Found index url https://pypi.org/simple/
2024-08-19T18:19:50,355 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-08-19T18:19:50,368   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,369   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-08-19T18:19:50,370   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,371   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-08-19T18:19:50,371   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,372   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-08-19T18:19:50,373   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,374   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-08-19T18:19:50,375   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,376   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-08-19T18:19:50,377   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,378   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-08-19T18:19:50,379   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,380   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-08-19T18:19:50,380   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,381   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-08-19T18:19:50,382   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,382   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-08-19T18:19:50,383   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,384   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-08-19T18:19:50,385   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,385   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-08-19T18:19:50,386   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,387   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-08-19T18:19:50,388   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,389   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-08-19T18:19:50,389   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,391   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-08-19T18:19:50,391   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,392   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-08-19T18:19:50,392   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,393   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-08-19T18:19:50,394   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,395   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-08-19T18:19:50,395   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,396   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-08-19T18:19:50,397   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,398   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-08-19T18:19:50,399   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,399   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-08-19T18:19:50,400   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,401   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-08-19T18:19:50,402   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,403   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-08-19T18:19:50,403   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,404   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-08-19T18:19:50,405   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,405   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-08-19T18:19:50,406   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,407   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-08-19T18:19:50,408   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,409   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-08-19T18:19:50,409   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,410   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-08-19T18:19:50,411   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,412   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-08-19T18:19:50,413   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,414   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-08-19T18:19:50,414   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,415   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-08-19T18:19:50,416   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,416   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-08-19T18:19:50,417   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,418   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-08-19T18:19:50,418   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ea/4d/9b44ccd56c4f7579c9e4b6886096daa1ad6d75019e4a2b03f0b94476a623/alpaca_eval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,419   Found link https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.2
2024-08-19T18:19:50,420   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/94/e2/86131f32b7f7d5b1b400e08393d8b3c490a893e9bb8139313cb93c23369d/alpaca_eval-0.6.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,421   Found link https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.3
2024-08-19T18:19:50,422   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e1/7f/7c7ab03e465637ee08158c9c4dfeb914b7e6549f19f996ae1cd3d19d7a07/alpaca_eval-0.6.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,423   Found link https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.4
2024-08-19T18:19:50,423   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/9d/44/6e0c171949a1b42858c7bb1eee7023494ec058db73b581401b4ddf7d3195/alpaca_eval-0.6.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,424   Found link https://files.pythonhosted.org/packages/a1/98/d2944a0c07a0700c13e22b4fd39f7bac8131e35436669ae16111c964465e/alpaca_eval-0.6.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.5
2024-08-19T18:19:50,425 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-08-19T18:19:50,426 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-08-19T18:19:50,427 Found index url https://www.piwheels.org/simple/
2024-08-19T18:19:50,578 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-08-19T18:19:50,587   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.4-py3-none-any.whl#sha256=fb2f9d67dd37cc01f579c0718b8eaedb9245543919e550264a403fec3bac13e0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,588   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.3-py3-none-any.whl#sha256=fe5ebfbbbbfd8d774873f20b778cf9b914febe7f116e1a82ac86186a804da4f5 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,588   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.2-py3-none-any.whl#sha256=f93aa4f39f46ac56b280e9c6249815ad57fb21f6f676abcf76640e872d4a1832 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,589   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.1-py3-none-any.whl#sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,589   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,590   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,590   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,591   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,591   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,592   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,592   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,593   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,594   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,595   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,595   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,595   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,596   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,596   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,597   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,597   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,598   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,599   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,599   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,600   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,600   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,601   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,601   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,602   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-08-19T18:19:50,602   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,603   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,603   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-08-19T18:19:50,604 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-08-19T18:19:50,604 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-08-19T18:19:50,627 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-08-19T18:19:50,629 Collecting alpaca-eval==0.6.5
2024-08-19T18:19:50,631   Created temporary directory: /tmp/pip-unpack-96ycu49k
2024-08-19T18:19:51,008   Downloading alpaca_eval-0.6.5.tar.gz (383 kB)
2024-08-19T18:19:52,002   Added alpaca-eval==0.6.5 from https://files.pythonhosted.org/packages/a1/98/d2944a0c07a0700c13e22b4fd39f7bac8131e35436669ae16111c964465e/alpaca_eval-0.6.5.tar.gz to build tracker '/tmp/pip-build-tracker-hn7a_tix'
2024-08-19T18:19:52,004   Running setup.py (path:/tmp/pip-wheel-3spgmp03/alpaca-eval_e0dd887feb7244c4ae86aed5995787a4/setup.py) egg_info for package alpaca-eval
2024-08-19T18:19:52,004   Created temporary directory: /tmp/pip-pip-egg-info-36zc8m16
2024-08-19T18:19:52,005   Preparing metadata (setup.py): started
2024-08-19T18:19:52,006   Running command python setup.py egg_info
2024-08-19T18:19:53,173   running egg_info
2024-08-19T18:19:53,174   creating /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info
2024-08-19T18:19:53,202   writing /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/PKG-INFO
2024-08-19T18:19:53,222   writing dependency_links to /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/dependency_links.txt
2024-08-19T18:19:53,223   writing entry points to /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/entry_points.txt
2024-08-19T18:19:53,233   writing requirements to /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/requires.txt
2024-08-19T18:19:53,234   writing top-level names to /tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/top_level.txt
2024-08-19T18:19:53,235   writing manifest file '/tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/SOURCES.txt'
2024-08-19T18:19:53,325   reading manifest file '/tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/SOURCES.txt'
2024-08-19T18:19:53,326   reading manifest template 'MANIFEST.in'
2024-08-19T18:19:53,613   adding license file 'LICENSE'
2024-08-19T18:19:53,630   writing manifest file '/tmp/pip-pip-egg-info-36zc8m16/alpaca_eval.egg-info/SOURCES.txt'
2024-08-19T18:19:53,747   Preparing metadata (setup.py): finished with status 'done'
2024-08-19T18:19:53,757   Source in /tmp/pip-wheel-3spgmp03/alpaca-eval_e0dd887feb7244c4ae86aed5995787a4 has version 0.6.5, which satisfies requirement alpaca-eval==0.6.5 from https://files.pythonhosted.org/packages/a1/98/d2944a0c07a0700c13e22b4fd39f7bac8131e35436669ae16111c964465e/alpaca_eval-0.6.5.tar.gz
2024-08-19T18:19:53,758   Removed alpaca-eval==0.6.5 from https://files.pythonhosted.org/packages/a1/98/d2944a0c07a0700c13e22b4fd39f7bac8131e35436669ae16111c964465e/alpaca_eval-0.6.5.tar.gz from build tracker '/tmp/pip-build-tracker-hn7a_tix'
2024-08-19T18:19:53,795 Created temporary directory: /tmp/pip-unpack-_h3_teg4
2024-08-19T18:19:53,796 Created temporary directory: /tmp/pip-unpack-luzpmkvs
2024-08-19T18:19:53,796 Building wheels for collected packages: alpaca-eval
2024-08-19T18:19:53,800   Created temporary directory: /tmp/pip-wheel-3l8y6nvu
2024-08-19T18:19:53,801   Building wheel for alpaca-eval (setup.py): started
2024-08-19T18:19:53,802   Destination directory: /tmp/pip-wheel-3l8y6nvu
2024-08-19T18:19:53,802   Running command python setup.py bdist_wheel
2024-08-19T18:19:54,862   running bdist_wheel
2024-08-19T18:19:55,001   running build
2024-08-19T18:19:55,001   running build_py
2024-08-19T18:19:55,032   creating build
2024-08-19T18:19:55,033   creating build/lib
2024-08-19T18:19:55,034   creating build/lib/alpaca_eval
2024-08-19T18:19:55,035   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,038   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,040   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,043   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,046   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,048   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,050   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,052   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,054   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-08-19T18:19:55,056   creating build/lib/alpaca_eval/metrics
2024-08-19T18:19:55,058   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-08-19T18:19:55,060   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-08-19T18:19:55,061   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-08-19T18:19:55,063   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-08-19T18:19:55,066   creating build/lib/alpaca_eval/annotators
2024-08-19T18:19:55,067   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-08-19T18:19:55,070   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-08-19T18:19:55,072   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-08-19T18:19:55,075   creating build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,076   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,079   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,081   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,083   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,084   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,086   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,089   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,091   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,093   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,094   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,096   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-08-19T18:19:55,098   running egg_info
2024-08-19T18:19:55,124   writing src/alpaca_eval.egg-info/PKG-INFO
2024-08-19T18:19:55,145   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-08-19T18:19:55,146   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-08-19T18:19:55,155   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-08-19T18:19:55,156   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-08-19T18:19:55,189   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-08-19T18:19:55,214   reading manifest template 'MANIFEST.in'
2024-08-19T18:19:55,450   adding license file 'LICENSE'
2024-08-19T18:19:55,472   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-08-19T18:19:55,476   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-08-19T18:19:55,476   !!

2024-08-19T18:19:55,477           ********************************************************************************
2024-08-19T18:19:55,478           ############################
2024-08-19T18:19:55,478           # Package would be ignored #
2024-08-19T18:19:55,479           ############################
2024-08-19T18:19:55,479           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-08-19T18:19:55,480           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,481           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,482           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-08-19T18:19:55,482           to the `packages` configuration field.

2024-08-19T18:19:55,484           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,484           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,485           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,486           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,487           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,488           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-08-19T18:19:55,488           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-08-19T18:19:55,489           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,489           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,490           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,491           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,492           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,493           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,494                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,494                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,495                 directory, all directories are treated like packages.
2024-08-19T18:19:55,495           ********************************************************************************

2024-08-19T18:19:55,496   !!
2024-08-19T18:19:55,497     check.warn(importable)
2024-08-19T18:19:55,497   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-08-19T18:19:55,498   !!

2024-08-19T18:19:55,499           ********************************************************************************
2024-08-19T18:19:55,500           ############################
2024-08-19T18:19:55,500           # Package would be ignored #
2024-08-19T18:19:55,500           ############################
2024-08-19T18:19:55,501           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-08-19T18:19:55,501           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,502           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,502           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-08-19T18:19:55,502           to the `packages` configuration field.

2024-08-19T18:19:55,503           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,503           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,504           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,505           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,505           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,506           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-08-19T18:19:55,507           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-08-19T18:19:55,507           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,508           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,508           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,509           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,510           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,512           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,512                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,513                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,513                 directory, all directories are treated like packages.
2024-08-19T18:19:55,514           ********************************************************************************

2024-08-19T18:19:55,515   !!
2024-08-19T18:19:55,515     check.warn(importable)
2024-08-19T18:19:55,516   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-08-19T18:19:55,516   !!

2024-08-19T18:19:55,517           ********************************************************************************
2024-08-19T18:19:55,518           ############################
2024-08-19T18:19:55,518           # Package would be ignored #
2024-08-19T18:19:55,519           ############################
2024-08-19T18:19:55,519           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-08-19T18:19:55,520           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,521           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-08-19T18:19:55,522           to the `packages` configuration field.

2024-08-19T18:19:55,523           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,523           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,524           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,525           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,525           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-08-19T18:19:55,526           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-08-19T18:19:55,526           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,526           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,527           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,527           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,528           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,529           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,529                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,530                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,530                 directory, all directories are treated like packages.
2024-08-19T18:19:55,531           ********************************************************************************

2024-08-19T18:19:55,532   !!
2024-08-19T18:19:55,532     check.warn(importable)
2024-08-19T18:19:55,533   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,534   !!

2024-08-19T18:19:55,535           ********************************************************************************
2024-08-19T18:19:55,535           ############################
2024-08-19T18:19:55,536           # Package would be ignored #
2024-08-19T18:19:55,536           ############################
2024-08-19T18:19:55,537           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-08-19T18:19:55,537           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,538           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,539           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-08-19T18:19:55,539           to the `packages` configuration field.

2024-08-19T18:19:55,540           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,540           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,541           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,542           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,543           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,543           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-08-19T18:19:55,544           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-08-19T18:19:55,545           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,545           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,546           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,547           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,548           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,549                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,549                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,550                 directory, all directories are treated like packages.
2024-08-19T18:19:55,550           ********************************************************************************

2024-08-19T18:19:55,551   !!
2024-08-19T18:19:55,551     check.warn(importable)
2024-08-19T18:19:55,551   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:55,552   !!

2024-08-19T18:19:55,553           ********************************************************************************
2024-08-19T18:19:55,553           ############################
2024-08-19T18:19:55,553           # Package would be ignored #
2024-08-19T18:19:55,554           ############################
2024-08-19T18:19:55,554           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-08-19T18:19:55,555           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,555           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,556           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-08-19T18:19:55,557           to the `packages` configuration field.

2024-08-19T18:19:55,558           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,558           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,559           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,560           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,561           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,562           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-08-19T18:19:55,562           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-08-19T18:19:55,563           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,564           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,564           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,566           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,566           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,568           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,568                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,569                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,569                 directory, all directories are treated like packages.
2024-08-19T18:19:55,570           ********************************************************************************

2024-08-19T18:19:55,571   !!
2024-08-19T18:19:55,572     check.warn(importable)
2024-08-19T18:19:55,572   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-08-19T18:19:55,573   !!

2024-08-19T18:19:55,574           ********************************************************************************
2024-08-19T18:19:55,574           ############################
2024-08-19T18:19:55,575           # Package would be ignored #
2024-08-19T18:19:55,575           ############################
2024-08-19T18:19:55,575           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-08-19T18:19:55,575           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,576           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,576           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-08-19T18:19:55,577           to the `packages` configuration field.

2024-08-19T18:19:55,578           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,578           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,578           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,579           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,580           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,580           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-08-19T18:19:55,581           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-08-19T18:19:55,581           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,582           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,583           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,583           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,584           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,586           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,587                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,587                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,588                 directory, all directories are treated like packages.
2024-08-19T18:19:55,588           ********************************************************************************

2024-08-19T18:19:55,589   !!
2024-08-19T18:19:55,590     check.warn(importable)
2024-08-19T18:19:55,590   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-08-19T18:19:55,591   !!

2024-08-19T18:19:55,592           ********************************************************************************
2024-08-19T18:19:55,592           ############################
2024-08-19T18:19:55,593           # Package would be ignored #
2024-08-19T18:19:55,593           ############################
2024-08-19T18:19:55,594           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-08-19T18:19:55,594           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,595           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,595           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-08-19T18:19:55,596           to the `packages` configuration field.

2024-08-19T18:19:55,597           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,597           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,598           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,599           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,600           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,600           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-08-19T18:19:55,600           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-08-19T18:19:55,601           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,601           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,602           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,602           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,603           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,604           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,604                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,604                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,605                 directory, all directories are treated like packages.
2024-08-19T18:19:55,605           ********************************************************************************

2024-08-19T18:19:55,606   !!
2024-08-19T18:19:55,606     check.warn(importable)
2024-08-19T18:19:55,607   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,607   !!

2024-08-19T18:19:55,608           ********************************************************************************
2024-08-19T18:19:55,608           ############################
2024-08-19T18:19:55,609           # Package would be ignored #
2024-08-19T18:19:55,610           ############################
2024-08-19T18:19:55,610           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-08-19T18:19:55,611           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,612           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,612           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-08-19T18:19:55,613           to the `packages` configuration field.

2024-08-19T18:19:55,614           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,614           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,614           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,615           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,616           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,617           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-08-19T18:19:55,618           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-08-19T18:19:55,618           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,618           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,619           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,620           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,621           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,623           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,623                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,624                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,624                 directory, all directories are treated like packages.
2024-08-19T18:19:55,624           ********************************************************************************

2024-08-19T18:19:55,625   !!
2024-08-19T18:19:55,625     check.warn(importable)
2024-08-19T18:19:55,626   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,626   !!

2024-08-19T18:19:55,627           ********************************************************************************
2024-08-19T18:19:55,627           ############################
2024-08-19T18:19:55,627           # Package would be ignored #
2024-08-19T18:19:55,628           ############################
2024-08-19T18:19:55,628           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-08-19T18:19:55,628           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,629           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,629           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-08-19T18:19:55,630           to the `packages` configuration field.

2024-08-19T18:19:55,631           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,631           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,632           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,633           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,634           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,635           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-08-19T18:19:55,636           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-08-19T18:19:55,636           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,637           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,638           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,639           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,640           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,641           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,642                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,642                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,642                 directory, all directories are treated like packages.
2024-08-19T18:19:55,643           ********************************************************************************

2024-08-19T18:19:55,644   !!
2024-08-19T18:19:55,644     check.warn(importable)
2024-08-19T18:19:55,645   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,645   !!

2024-08-19T18:19:55,646           ********************************************************************************
2024-08-19T18:19:55,647           ############################
2024-08-19T18:19:55,647           # Package would be ignored #
2024-08-19T18:19:55,648           ############################
2024-08-19T18:19:55,648           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' as an importable package[^1],
2024-08-19T18:19:55,649           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,650           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,650           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is explicitly added
2024-08-19T18:19:55,651           to the `packages` configuration field.

2024-08-19T18:19:55,651           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,652           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,652           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,652           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,653           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,654           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' to be distributed and are
2024-08-19T18:19:55,654           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' via
2024-08-19T18:19:55,655           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,655           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,655           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,656           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,657           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,659           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,659                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,660                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,660                 directory, all directories are treated like packages.
2024-08-19T18:19:55,660           ********************************************************************************

2024-08-19T18:19:55,661   !!
2024-08-19T18:19:55,662     check.warn(importable)
2024-08-19T18:19:55,663   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,663   !!

2024-08-19T18:19:55,664           ********************************************************************************
2024-08-19T18:19:55,665           ############################
2024-08-19T18:19:55,665           # Package would be ignored #
2024-08-19T18:19:55,666           ############################
2024-08-19T18:19:55,666           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' as an importable package[^1],
2024-08-19T18:19:55,666           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,667           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,668           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' is explicitly added
2024-08-19T18:19:55,668           to the `packages` configuration field.

2024-08-19T18:19:55,669           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,670           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,670           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,671           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,672           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,673           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' to be distributed and are
2024-08-19T18:19:55,674           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' via
2024-08-19T18:19:55,674           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,674           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,675           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,675           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,676           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,677           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,677                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,678                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,678                 directory, all directories are treated like packages.
2024-08-19T18:19:55,678           ********************************************************************************

2024-08-19T18:19:55,679   !!
2024-08-19T18:19:55,679     check.warn(importable)
2024-08-19T18:19:55,680   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-08-19T18:19:55,680   !!

2024-08-19T18:19:55,681           ********************************************************************************
2024-08-19T18:19:55,681           ############################
2024-08-19T18:19:55,682           # Package would be ignored #
2024-08-19T18:19:55,682           ############################
2024-08-19T18:19:55,683           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-08-19T18:19:55,683           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,684           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,685           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-08-19T18:19:55,686           to the `packages` configuration field.

2024-08-19T18:19:55,687           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,687           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,688           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,689           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,690           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,690           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-08-19T18:19:55,691           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-08-19T18:19:55,691           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,692           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,692           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,693           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,694           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,696           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,696                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,697                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,697                 directory, all directories are treated like packages.
2024-08-19T18:19:55,698           ********************************************************************************

2024-08-19T18:19:55,699   !!
2024-08-19T18:19:55,699     check.warn(importable)
2024-08-19T18:19:55,699   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:55,700   !!

2024-08-19T18:19:55,701           ********************************************************************************
2024-08-19T18:19:55,701           ############################
2024-08-19T18:19:55,701           # Package would be ignored #
2024-08-19T18:19:55,702           ############################
2024-08-19T18:19:55,702           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-08-19T18:19:55,702           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,703           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,704           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-08-19T18:19:55,704           to the `packages` configuration field.

2024-08-19T18:19:55,705           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,705           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,706           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,706           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,709           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-08-19T18:19:55,709           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-08-19T18:19:55,710           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,711           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,712           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,713           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,714           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,715                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,715                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,716                 directory, all directories are treated like packages.
2024-08-19T18:19:55,716           ********************************************************************************

2024-08-19T18:19:55,717   !!
2024-08-19T18:19:55,718     check.warn(importable)
2024-08-19T18:19:55,718   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:55,718   !!

2024-08-19T18:19:55,719           ********************************************************************************
2024-08-19T18:19:55,720           ############################
2024-08-19T18:19:55,720           # Package would be ignored #
2024-08-19T18:19:55,721           ############################
2024-08-19T18:19:55,722           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-08-19T18:19:55,722           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,723           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,724           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-08-19T18:19:55,725           to the `packages` configuration field.

2024-08-19T18:19:55,725           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,726           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,726           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,727           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,727           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,728           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-08-19T18:19:55,728           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-08-19T18:19:55,729           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,729           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,729           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,730           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,731           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,732           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,732                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,733                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,733                 directory, all directories are treated like packages.
2024-08-19T18:19:55,734           ********************************************************************************

2024-08-19T18:19:55,735   !!
2024-08-19T18:19:55,735     check.warn(importable)
2024-08-19T18:19:55,736   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-08-19T18:19:55,736   !!

2024-08-19T18:19:55,737           ********************************************************************************
2024-08-19T18:19:55,738           ############################
2024-08-19T18:19:55,738           # Package would be ignored #
2024-08-19T18:19:55,739           ############################
2024-08-19T18:19:55,740           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-08-19T18:19:55,740           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,741           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,742           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-08-19T18:19:55,742           to the `packages` configuration field.

2024-08-19T18:19:55,743           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,744           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,745           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,746           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,747           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-08-19T18:19:55,747           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-08-19T18:19:55,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,749           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,750           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,750           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,751           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,752           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,752                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,753                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,753                 directory, all directories are treated like packages.
2024-08-19T18:19:55,753           ********************************************************************************

2024-08-19T18:19:55,754   !!
2024-08-19T18:19:55,754     check.warn(importable)
2024-08-19T18:19:55,755   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-08-19T18:19:55,755   !!

2024-08-19T18:19:55,756           ********************************************************************************
2024-08-19T18:19:55,756           ############################
2024-08-19T18:19:55,757           # Package would be ignored #
2024-08-19T18:19:55,757           ############################
2024-08-19T18:19:55,758           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-08-19T18:19:55,758           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,759           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,759           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-08-19T18:19:55,760           to the `packages` configuration field.

2024-08-19T18:19:55,761           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,762           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,762           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,763           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,764           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,765           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-08-19T18:19:55,766           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-08-19T18:19:55,766           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,767           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,767           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,768           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,769           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,771           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,771                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,772                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,772                 directory, all directories are treated like packages.
2024-08-19T18:19:55,773           ********************************************************************************

2024-08-19T18:19:55,774   !!
2024-08-19T18:19:55,775     check.warn(importable)
2024-08-19T18:19:55,775   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-08-19T18:19:55,776   !!

2024-08-19T18:19:55,777           ********************************************************************************
2024-08-19T18:19:55,777           ############################
2024-08-19T18:19:55,778           # Package would be ignored #
2024-08-19T18:19:55,778           ############################
2024-08-19T18:19:55,778           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-08-19T18:19:55,779           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,779           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,780           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-08-19T18:19:55,780           to the `packages` configuration field.

2024-08-19T18:19:55,781           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,781           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,781           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,782           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,783           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,784           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-08-19T18:19:55,784           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-08-19T18:19:55,784           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,785           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,786           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,787           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,788           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,790           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,790                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,791                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,791                 directory, all directories are treated like packages.
2024-08-19T18:19:55,792           ********************************************************************************

2024-08-19T18:19:55,793   !!
2024-08-19T18:19:55,794     check.warn(importable)
2024-08-19T18:19:55,794   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-08-19T18:19:55,795   !!

2024-08-19T18:19:55,795           ********************************************************************************
2024-08-19T18:19:55,796           ############################
2024-08-19T18:19:55,796           # Package would be ignored #
2024-08-19T18:19:55,797           ############################
2024-08-19T18:19:55,797           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-08-19T18:19:55,798           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,799           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,799           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-08-19T18:19:55,800           to the `packages` configuration field.

2024-08-19T18:19:55,801           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,802           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,802           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,803           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,804           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,805           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-08-19T18:19:55,805           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-08-19T18:19:55,805           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,806           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,806           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,807           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,807           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,809           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,809                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,809                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,810                 directory, all directories are treated like packages.
2024-08-19T18:19:55,810           ********************************************************************************

2024-08-19T18:19:55,811   !!
2024-08-19T18:19:55,811     check.warn(importable)
2024-08-19T18:19:55,812   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-08-19T18:19:55,812   !!

2024-08-19T18:19:55,813           ********************************************************************************
2024-08-19T18:19:55,814           ############################
2024-08-19T18:19:55,814           # Package would be ignored #
2024-08-19T18:19:55,815           ############################
2024-08-19T18:19:55,815           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-08-19T18:19:55,816           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,817           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,818           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-08-19T18:19:55,818           to the `packages` configuration field.

2024-08-19T18:19:55,819           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,820           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,821           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,822           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,822           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,823           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-08-19T18:19:55,824           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-08-19T18:19:55,824           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,825           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,825           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,826           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,827           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,829           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,830                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,830                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,831                 directory, all directories are treated like packages.
2024-08-19T18:19:55,831           ********************************************************************************

2024-08-19T18:19:55,832   !!
2024-08-19T18:19:55,832     check.warn(importable)
2024-08-19T18:19:55,832   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-08-19T18:19:55,833   !!

2024-08-19T18:19:55,833           ********************************************************************************
2024-08-19T18:19:55,834           ############################
2024-08-19T18:19:55,834           # Package would be ignored #
2024-08-19T18:19:55,834           ############################
2024-08-19T18:19:55,835           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-08-19T18:19:55,835           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,836           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,836           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-08-19T18:19:55,837           to the `packages` configuration field.

2024-08-19T18:19:55,838           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,838           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,839           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,840           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,841           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,842           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-08-19T18:19:55,843           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-08-19T18:19:55,843           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,844           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,845           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,846           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,847           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,848           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,849                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,850                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,850                 directory, all directories are treated like packages.
2024-08-19T18:19:55,851           ********************************************************************************

2024-08-19T18:19:55,852   !!
2024-08-19T18:19:55,852     check.warn(importable)
2024-08-19T18:19:55,853   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-08-19T18:19:55,853   !!

2024-08-19T18:19:55,854           ********************************************************************************
2024-08-19T18:19:55,855           ############################
2024-08-19T18:19:55,855           # Package would be ignored #
2024-08-19T18:19:55,856           ############################
2024-08-19T18:19:55,856           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-08-19T18:19:55,857           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,858           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,858           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-08-19T18:19:55,859           to the `packages` configuration field.

2024-08-19T18:19:55,859           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,860           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,861           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,861           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,862           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-08-19T18:19:55,862           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-08-19T18:19:55,863           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,863           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,863           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,864           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,865           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,866           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,867                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,868                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,868                 directory, all directories are treated like packages.
2024-08-19T18:19:55,869           ********************************************************************************

2024-08-19T18:19:55,870   !!
2024-08-19T18:19:55,870     check.warn(importable)
2024-08-19T18:19:55,871   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-08-19T18:19:55,871   !!

2024-08-19T18:19:55,872           ********************************************************************************
2024-08-19T18:19:55,873           ############################
2024-08-19T18:19:55,874           # Package would be ignored #
2024-08-19T18:19:55,874           ############################
2024-08-19T18:19:55,875           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-08-19T18:19:55,875           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,876           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,877           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-08-19T18:19:55,877           to the `packages` configuration field.

2024-08-19T18:19:55,878           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,879           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,879           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,880           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,881           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,882           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-08-19T18:19:55,883           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-08-19T18:19:55,883           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,885           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,885           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,886           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,887           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,888                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,888                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,888                 directory, all directories are treated like packages.
2024-08-19T18:19:55,889           ********************************************************************************

2024-08-19T18:19:55,889   !!
2024-08-19T18:19:55,890     check.warn(importable)
2024-08-19T18:19:55,890   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-08-19T18:19:55,890   !!

2024-08-19T18:19:55,891           ********************************************************************************
2024-08-19T18:19:55,891           ############################
2024-08-19T18:19:55,892           # Package would be ignored #
2024-08-19T18:19:55,892           ############################
2024-08-19T18:19:55,893           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-08-19T18:19:55,893           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,894           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,895           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-08-19T18:19:55,895           to the `packages` configuration field.

2024-08-19T18:19:55,897           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,897           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,897           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,898           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,900           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,901           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-08-19T18:19:55,901           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-08-19T18:19:55,902           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,902           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,903           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,904           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,905           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,906           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,906                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,907                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,907                 directory, all directories are treated like packages.
2024-08-19T18:19:55,908           ********************************************************************************

2024-08-19T18:19:55,909   !!
2024-08-19T18:19:55,910     check.warn(importable)
2024-08-19T18:19:55,910   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-08-19T18:19:55,911   !!

2024-08-19T18:19:55,912           ********************************************************************************
2024-08-19T18:19:55,912           ############################
2024-08-19T18:19:55,912           # Package would be ignored #
2024-08-19T18:19:55,912           ############################
2024-08-19T18:19:55,913           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-08-19T18:19:55,913           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,914           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,914           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-08-19T18:19:55,915           to the `packages` configuration field.

2024-08-19T18:19:55,915           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,916           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,916           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,917           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,918           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,919           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-08-19T18:19:55,919           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-08-19T18:19:55,920           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,920           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,921           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,923           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,924           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,926           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,927                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,928                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,928                 directory, all directories are treated like packages.
2024-08-19T18:19:55,929           ********************************************************************************

2024-08-19T18:19:55,930   !!
2024-08-19T18:19:55,931     check.warn(importable)
2024-08-19T18:19:55,931   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:55,932   !!

2024-08-19T18:19:55,933           ********************************************************************************
2024-08-19T18:19:55,934           ############################
2024-08-19T18:19:55,934           # Package would be ignored #
2024-08-19T18:19:55,935           ############################
2024-08-19T18:19:55,936           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-08-19T18:19:55,936           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,938           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,938           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-08-19T18:19:55,939           to the `packages` configuration field.

2024-08-19T18:19:55,940           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,941           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,942           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,943           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,944           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,945           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-08-19T18:19:55,945           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-08-19T18:19:55,946           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,946           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,947           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,948           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,949           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,951           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,951                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,952                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,952                 directory, all directories are treated like packages.
2024-08-19T18:19:55,953           ********************************************************************************

2024-08-19T18:19:55,954   !!
2024-08-19T18:19:55,955     check.warn(importable)
2024-08-19T18:19:55,956   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-08-19T18:19:55,956   !!

2024-08-19T18:19:55,958           ********************************************************************************
2024-08-19T18:19:55,958           ############################
2024-08-19T18:19:55,959           # Package would be ignored #
2024-08-19T18:19:55,960           ############################
2024-08-19T18:19:55,960           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-08-19T18:19:55,961           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,962           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,963           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-08-19T18:19:55,964           to the `packages` configuration field.

2024-08-19T18:19:55,965           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,966           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,966           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,968           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,969           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,970           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-08-19T18:19:55,971           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-08-19T18:19:55,971           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,972           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,973           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,974           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,975           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:55,978           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:55,979                 even if it does not contain any `.py` files.
2024-08-19T18:19:55,979                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:55,980                 directory, all directories are treated like packages.
2024-08-19T18:19:55,980           ********************************************************************************

2024-08-19T18:19:55,981   !!
2024-08-19T18:19:55,982     check.warn(importable)
2024-08-19T18:19:55,982   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-08-19T18:19:55,982   !!

2024-08-19T18:19:55,983           ********************************************************************************
2024-08-19T18:19:55,984           ############################
2024-08-19T18:19:55,984           # Package would be ignored #
2024-08-19T18:19:55,985           ############################
2024-08-19T18:19:55,985           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-08-19T18:19:55,986           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:55,987           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:55,987           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-08-19T18:19:55,988           to the `packages` configuration field.

2024-08-19T18:19:55,989           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:55,990           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:55,991           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:55,992           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:55,993           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:55,994           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-08-19T18:19:55,995           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-08-19T18:19:55,996           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:55,996           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:55,997           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:55,998           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:55,999           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,001           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,001                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,002                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,002                 directory, all directories are treated like packages.
2024-08-19T18:19:56,003           ********************************************************************************

2024-08-19T18:19:56,004   !!
2024-08-19T18:19:56,005     check.warn(importable)
2024-08-19T18:19:56,005   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-08-19T18:19:56,006   !!

2024-08-19T18:19:56,007           ********************************************************************************
2024-08-19T18:19:56,008           ############################
2024-08-19T18:19:56,009           # Package would be ignored #
2024-08-19T18:19:56,010           ############################
2024-08-19T18:19:56,011           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-08-19T18:19:56,011           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,012           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,013           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-08-19T18:19:56,013           to the `packages` configuration field.

2024-08-19T18:19:56,014           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,015           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,015           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,016           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,018           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,019           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-08-19T18:19:56,019           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-08-19T18:19:56,020           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,021           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,021           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,022           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,026           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,026                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,027                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,028                 directory, all directories are treated like packages.
2024-08-19T18:19:56,028           ********************************************************************************

2024-08-19T18:19:56,030   !!
2024-08-19T18:19:56,030     check.warn(importable)
2024-08-19T18:19:56,031   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-08-19T18:19:56,032   !!

2024-08-19T18:19:56,033           ********************************************************************************
2024-08-19T18:19:56,034           ############################
2024-08-19T18:19:56,034           # Package would be ignored #
2024-08-19T18:19:56,035           ############################
2024-08-19T18:19:56,035           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-08-19T18:19:56,036           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,037           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,038           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-08-19T18:19:56,038           to the `packages` configuration field.

2024-08-19T18:19:56,040           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,040           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,041           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,042           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,043           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,045           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-08-19T18:19:56,045           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-08-19T18:19:56,046           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,046           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,046           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,047           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,048           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,050           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,050                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,050                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,051                 directory, all directories are treated like packages.
2024-08-19T18:19:56,051           ********************************************************************************

2024-08-19T18:19:56,052   !!
2024-08-19T18:19:56,053     check.warn(importable)
2024-08-19T18:19:56,053   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-08-19T18:19:56,054   !!

2024-08-19T18:19:56,055           ********************************************************************************
2024-08-19T18:19:56,056           ############################
2024-08-19T18:19:56,056           # Package would be ignored #
2024-08-19T18:19:56,057           ############################
2024-08-19T18:19:56,057           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-08-19T18:19:56,058           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,059           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,060           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-08-19T18:19:56,061           to the `packages` configuration field.

2024-08-19T18:19:56,062           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,063           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,063           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,065           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,067           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,068           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-08-19T18:19:56,069           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-08-19T18:19:56,069           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,070           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,070           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,072           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,073           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,075           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,075                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,076                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,077                 directory, all directories are treated like packages.
2024-08-19T18:19:56,077           ********************************************************************************

2024-08-19T18:19:56,078   !!
2024-08-19T18:19:56,079     check.warn(importable)
2024-08-19T18:19:56,079   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-08-19T18:19:56,080   !!

2024-08-19T18:19:56,081           ********************************************************************************
2024-08-19T18:19:56,081           ############################
2024-08-19T18:19:56,082           # Package would be ignored #
2024-08-19T18:19:56,082           ############################
2024-08-19T18:19:56,082           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-08-19T18:19:56,083           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,084           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,084           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-08-19T18:19:56,085           to the `packages` configuration field.

2024-08-19T18:19:56,086           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,086           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,086           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,088           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,089           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,090           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-08-19T18:19:56,091           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-08-19T18:19:56,092           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,092           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,093           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,095           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,096           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,098           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,098                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,099                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,100                 directory, all directories are treated like packages.
2024-08-19T18:19:56,101           ********************************************************************************

2024-08-19T18:19:56,102   !!
2024-08-19T18:19:56,102     check.warn(importable)
2024-08-19T18:19:56,103   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:56,104   !!

2024-08-19T18:19:56,105           ********************************************************************************
2024-08-19T18:19:56,106           ############################
2024-08-19T18:19:56,106           # Package would be ignored #
2024-08-19T18:19:56,107           ############################
2024-08-19T18:19:56,108           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-08-19T18:19:56,108           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,110           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,110           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-08-19T18:19:56,111           to the `packages` configuration field.

2024-08-19T18:19:56,112           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,113           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,113           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,114           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,115           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,116           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-08-19T18:19:56,116           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-08-19T18:19:56,116           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,117           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,118           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,118           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,119           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,121           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,121                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,122                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,122                 directory, all directories are treated like packages.
2024-08-19T18:19:56,123           ********************************************************************************

2024-08-19T18:19:56,124   !!
2024-08-19T18:19:56,124     check.warn(importable)
2024-08-19T18:19:56,125   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:56,125   !!

2024-08-19T18:19:56,127           ********************************************************************************
2024-08-19T18:19:56,127           ############################
2024-08-19T18:19:56,128           # Package would be ignored #
2024-08-19T18:19:56,128           ############################
2024-08-19T18:19:56,129           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-08-19T18:19:56,129           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,130           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,130           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-08-19T18:19:56,131           to the `packages` configuration field.

2024-08-19T18:19:56,132           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,132           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,132           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,133           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,134           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,135           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-08-19T18:19:56,136           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-08-19T18:19:56,137           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,137           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,138           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,139           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,139           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,140           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,140                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,141                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,141                 directory, all directories are treated like packages.
2024-08-19T18:19:56,141           ********************************************************************************

2024-08-19T18:19:56,142   !!
2024-08-19T18:19:56,142     check.warn(importable)
2024-08-19T18:19:56,143   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:56,143   !!

2024-08-19T18:19:56,144           ********************************************************************************
2024-08-19T18:19:56,144           ############################
2024-08-19T18:19:56,144           # Package would be ignored #
2024-08-19T18:19:56,145           ############################
2024-08-19T18:19:56,145           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-08-19T18:19:56,145           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,146           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,147           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-08-19T18:19:56,147           to the `packages` configuration field.

2024-08-19T18:19:56,148           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,149           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,150           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,151           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,153           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-08-19T18:19:56,153           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-08-19T18:19:56,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,154           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,155           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,155           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,156           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,158           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,158                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,159                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,159                 directory, all directories are treated like packages.
2024-08-19T18:19:56,160           ********************************************************************************

2024-08-19T18:19:56,161   !!
2024-08-19T18:19:56,161     check.warn(importable)
2024-08-19T18:19:56,162   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-08-19T18:19:56,162   !!

2024-08-19T18:19:56,163           ********************************************************************************
2024-08-19T18:19:56,164           ############################
2024-08-19T18:19:56,164           # Package would be ignored #
2024-08-19T18:19:56,164           ############################
2024-08-19T18:19:56,165           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-08-19T18:19:56,165           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,166           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,166           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-08-19T18:19:56,166           to the `packages` configuration field.

2024-08-19T18:19:56,167           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,167           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,168           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,169           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,169           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,170           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-08-19T18:19:56,170           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-08-19T18:19:56,171           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,171           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,172           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,173           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,174           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,176           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,176                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,177                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,178                 directory, all directories are treated like packages.
2024-08-19T18:19:56,178           ********************************************************************************

2024-08-19T18:19:56,179   !!
2024-08-19T18:19:56,180     check.warn(importable)
2024-08-19T18:19:56,180   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-08-19T18:19:56,180   !!

2024-08-19T18:19:56,181           ********************************************************************************
2024-08-19T18:19:56,182           ############################
2024-08-19T18:19:56,182           # Package would be ignored #
2024-08-19T18:19:56,183           ############################
2024-08-19T18:19:56,183           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-08-19T18:19:56,183           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,184           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,185           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-08-19T18:19:56,186           to the `packages` configuration field.

2024-08-19T18:19:56,187           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,187           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,188           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,189           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,190           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,190           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-08-19T18:19:56,191           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-08-19T18:19:56,191           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,191           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,192           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,192           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,193           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,194           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,194                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,195                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,195                 directory, all directories are treated like packages.
2024-08-19T18:19:56,195           ********************************************************************************

2024-08-19T18:19:56,196   !!
2024-08-19T18:19:56,197     check.warn(importable)
2024-08-19T18:19:56,197   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-08-19T18:19:56,198   !!

2024-08-19T18:19:56,198           ********************************************************************************
2024-08-19T18:19:56,199           ############################
2024-08-19T18:19:56,199           # Package would be ignored #
2024-08-19T18:19:56,200           ############################
2024-08-19T18:19:56,200           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-08-19T18:19:56,200           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,202           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,202           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-08-19T18:19:56,203           to the `packages` configuration field.

2024-08-19T18:19:56,204           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,204           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,205           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,206           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,207           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,207           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-08-19T18:19:56,208           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-08-19T18:19:56,208           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,209           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,209           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,210           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,211           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,212           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,213                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,213                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,214                 directory, all directories are treated like packages.
2024-08-19T18:19:56,214           ********************************************************************************

2024-08-19T18:19:56,215   !!
2024-08-19T18:19:56,215     check.warn(importable)
2024-08-19T18:19:56,215   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-08-19T18:19:56,216   !!

2024-08-19T18:19:56,216           ********************************************************************************
2024-08-19T18:19:56,216           ############################
2024-08-19T18:19:56,217           # Package would be ignored #
2024-08-19T18:19:56,217           ############################
2024-08-19T18:19:56,218           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-08-19T18:19:56,218           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,219           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,219           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-08-19T18:19:56,219           to the `packages` configuration field.

2024-08-19T18:19:56,220           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,220           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,221           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,222           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,222           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,223           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-08-19T18:19:56,224           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-08-19T18:19:56,225           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,225           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,226           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,227           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,227           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,229           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,229                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,230                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,230                 directory, all directories are treated like packages.
2024-08-19T18:19:56,230           ********************************************************************************

2024-08-19T18:19:56,231   !!
2024-08-19T18:19:56,232     check.warn(importable)
2024-08-19T18:19:56,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-08-19T18:19:56,233   !!

2024-08-19T18:19:56,234           ********************************************************************************
2024-08-19T18:19:56,234           ############################
2024-08-19T18:19:56,235           # Package would be ignored #
2024-08-19T18:19:56,235           ############################
2024-08-19T18:19:56,236           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-08-19T18:19:56,236           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,237           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,238           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-08-19T18:19:56,238           to the `packages` configuration field.

2024-08-19T18:19:56,239           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,240           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,241           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,241           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,242           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-08-19T18:19:56,243           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-08-19T18:19:56,243           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,244           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,245           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,246           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,248           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,248                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,249                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,250                 directory, all directories are treated like packages.
2024-08-19T18:19:56,250           ********************************************************************************

2024-08-19T18:19:56,251   !!
2024-08-19T18:19:56,252     check.warn(importable)
2024-08-19T18:19:56,252   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is absent from the `packages` configuration.
2024-08-19T18:19:56,253   !!

2024-08-19T18:19:56,254           ********************************************************************************
2024-08-19T18:19:56,254           ############################
2024-08-19T18:19:56,255           # Package would be ignored #
2024-08-19T18:19:56,255           ############################
2024-08-19T18:19:56,256           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' as an importable package[^1],
2024-08-19T18:19:56,256           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,257           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,258           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is explicitly added
2024-08-19T18:19:56,258           to the `packages` configuration field.

2024-08-19T18:19:56,259           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,260           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,260           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,261           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,263           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' to be distributed and are
2024-08-19T18:19:56,263           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' via
2024-08-19T18:19:56,264           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,264           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,265           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,265           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,266           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,267           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,268                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,268                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,268                 directory, all directories are treated like packages.
2024-08-19T18:19:56,269           ********************************************************************************

2024-08-19T18:19:56,270   !!
2024-08-19T18:19:56,270     check.warn(importable)
2024-08-19T18:19:56,270   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-08-19T18:19:56,271   !!

2024-08-19T18:19:56,271           ********************************************************************************
2024-08-19T18:19:56,272           ############################
2024-08-19T18:19:56,272           # Package would be ignored #
2024-08-19T18:19:56,273           ############################
2024-08-19T18:19:56,273           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-08-19T18:19:56,274           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,275           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,275           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-08-19T18:19:56,276           to the `packages` configuration field.

2024-08-19T18:19:56,277           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,277           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,278           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,279           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,280           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,281           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-08-19T18:19:56,281           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-08-19T18:19:56,282           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,282           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,282           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,283           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,285           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,286           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,287                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,287                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,288                 directory, all directories are treated like packages.
2024-08-19T18:19:56,289           ********************************************************************************

2024-08-19T18:19:56,289   !!
2024-08-19T18:19:56,290     check.warn(importable)
2024-08-19T18:19:56,290   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-08-19T18:19:56,290   !!

2024-08-19T18:19:56,291           ********************************************************************************
2024-08-19T18:19:56,291           ############################
2024-08-19T18:19:56,291           # Package would be ignored #
2024-08-19T18:19:56,292           ############################
2024-08-19T18:19:56,292           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-08-19T18:19:56,292           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,293           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,293           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-08-19T18:19:56,294           to the `packages` configuration field.

2024-08-19T18:19:56,294           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,295           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,295           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,296           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,297           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,298           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-08-19T18:19:56,299           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-08-19T18:19:56,299           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,300           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,300           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,301           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,302           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,303           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,304                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,304                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,305                 directory, all directories are treated like packages.
2024-08-19T18:19:56,305           ********************************************************************************

2024-08-19T18:19:56,306   !!
2024-08-19T18:19:56,306     check.warn(importable)
2024-08-19T18:19:56,307   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-08-19T18:19:56,307   !!

2024-08-19T18:19:56,309           ********************************************************************************
2024-08-19T18:19:56,309           ############################
2024-08-19T18:19:56,310           # Package would be ignored #
2024-08-19T18:19:56,310           ############################
2024-08-19T18:19:56,311           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-08-19T18:19:56,311           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,312           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,313           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-08-19T18:19:56,314           to the `packages` configuration field.

2024-08-19T18:19:56,315           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,315           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,315           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,316           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,317           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,318           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-08-19T18:19:56,318           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-08-19T18:19:56,319           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,319           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,319           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,320           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,321           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,322           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,323                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,323                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,324                 directory, all directories are treated like packages.
2024-08-19T18:19:56,324           ********************************************************************************

2024-08-19T18:19:56,325   !!
2024-08-19T18:19:56,325     check.warn(importable)
2024-08-19T18:19:56,326   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-08-19T18:19:56,326   !!

2024-08-19T18:19:56,327           ********************************************************************************
2024-08-19T18:19:56,328           ############################
2024-08-19T18:19:56,328           # Package would be ignored #
2024-08-19T18:19:56,329           ############################
2024-08-19T18:19:56,330           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-08-19T18:19:56,330           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,331           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,332           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-08-19T18:19:56,332           to the `packages` configuration field.

2024-08-19T18:19:56,333           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,334           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,334           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,335           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,336           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,338           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-08-19T18:19:56,338           already explicitly excluding 'alpaca_eval.models_configs' via
2024-08-19T18:19:56,339           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,339           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,340           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,341           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,342           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,343           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,344                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,344                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,344                 directory, all directories are treated like packages.
2024-08-19T18:19:56,345           ********************************************************************************

2024-08-19T18:19:56,346   !!
2024-08-19T18:19:56,346     check.warn(importable)
2024-08-19T18:19:56,346   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-08-19T18:19:56,347   !!

2024-08-19T18:19:56,348           ********************************************************************************
2024-08-19T18:19:56,348           ############################
2024-08-19T18:19:56,349           # Package would be ignored #
2024-08-19T18:19:56,349           ############################
2024-08-19T18:19:56,350           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-08-19T18:19:56,350           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,351           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,352           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-08-19T18:19:56,352           to the `packages` configuration field.

2024-08-19T18:19:56,353           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,354           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,354           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,355           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,356           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,357           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-08-19T18:19:56,358           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-08-19T18:19:56,358           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,359           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,359           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,360           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,362           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,363           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,364                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,364                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,364                 directory, all directories are treated like packages.
2024-08-19T18:19:56,365           ********************************************************************************

2024-08-19T18:19:56,366   !!
2024-08-19T18:19:56,367     check.warn(importable)
2024-08-19T18:19:56,367   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-08-19T18:19:56,368   !!

2024-08-19T18:19:56,369           ********************************************************************************
2024-08-19T18:19:56,369           ############################
2024-08-19T18:19:56,370           # Package would be ignored #
2024-08-19T18:19:56,370           ############################
2024-08-19T18:19:56,371           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-08-19T18:19:56,371           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,372           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,372           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-08-19T18:19:56,373           to the `packages` configuration field.

2024-08-19T18:19:56,374           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,374           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,374           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,375           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,376           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,377           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-08-19T18:19:56,378           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-08-19T18:19:56,378           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,379           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,379           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,380           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,381           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,383           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,383                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,384                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,384                 directory, all directories are treated like packages.
2024-08-19T18:19:56,385           ********************************************************************************

2024-08-19T18:19:56,386   !!
2024-08-19T18:19:56,386     check.warn(importable)
2024-08-19T18:19:56,387   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-08-19T18:19:56,387   !!

2024-08-19T18:19:56,388           ********************************************************************************
2024-08-19T18:19:56,389           ############################
2024-08-19T18:19:56,389           # Package would be ignored #
2024-08-19T18:19:56,390           ############################
2024-08-19T18:19:56,390           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-08-19T18:19:56,391           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,392           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,392           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-08-19T18:19:56,393           to the `packages` configuration field.

2024-08-19T18:19:56,394           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,394           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,395           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,396           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,397           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,398           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-08-19T18:19:56,398           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-08-19T18:19:56,399           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,399           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,400           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,401           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,401           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,403           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,403                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,403                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,404                 directory, all directories are treated like packages.
2024-08-19T18:19:56,404           ********************************************************************************

2024-08-19T18:19:56,405   !!
2024-08-19T18:19:56,406     check.warn(importable)
2024-08-19T18:19:56,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-08-19T18:19:56,407   !!

2024-08-19T18:19:56,408           ********************************************************************************
2024-08-19T18:19:56,409           ############################
2024-08-19T18:19:56,409           # Package would be ignored #
2024-08-19T18:19:56,410           ############################
2024-08-19T18:19:56,411           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-08-19T18:19:56,411           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,412           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,413           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-08-19T18:19:56,415           to the `packages` configuration field.

2024-08-19T18:19:56,416           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,417           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,418           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,419           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,420           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,421           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-08-19T18:19:56,422           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-08-19T18:19:56,423           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,423           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,424           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,425           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,426           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,427           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,428                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,428                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,429                 directory, all directories are treated like packages.
2024-08-19T18:19:56,430           ********************************************************************************

2024-08-19T18:19:56,431   !!
2024-08-19T18:19:56,431     check.warn(importable)
2024-08-19T18:19:56,431   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-08-19T18:19:56,432   !!

2024-08-19T18:19:56,433           ********************************************************************************
2024-08-19T18:19:56,433           ############################
2024-08-19T18:19:56,434           # Package would be ignored #
2024-08-19T18:19:56,434           ############################
2024-08-19T18:19:56,435           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-08-19T18:19:56,435           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,436           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,436           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-08-19T18:19:56,437           to the `packages` configuration field.

2024-08-19T18:19:56,438           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,439           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,439           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,440           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,441           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,442           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-08-19T18:19:56,443           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-08-19T18:19:56,443           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,444           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,444           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,445           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,446           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,448           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,448                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,449                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,449                 directory, all directories are treated like packages.
2024-08-19T18:19:56,450           ********************************************************************************

2024-08-19T18:19:56,451   !!
2024-08-19T18:19:56,451     check.warn(importable)
2024-08-19T18:19:56,452   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-08-19T18:19:56,452   !!

2024-08-19T18:19:56,454           ********************************************************************************
2024-08-19T18:19:56,454           ############################
2024-08-19T18:19:56,455           # Package would be ignored #
2024-08-19T18:19:56,455           ############################
2024-08-19T18:19:56,456           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-08-19T18:19:56,456           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,457           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,458           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-08-19T18:19:56,459           to the `packages` configuration field.

2024-08-19T18:19:56,460           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,460           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,460           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,462           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,462           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,463           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-08-19T18:19:56,464           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-08-19T18:19:56,464           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,465           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,465           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,466           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,467           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,468           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,469                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,469                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,470                 directory, all directories are treated like packages.
2024-08-19T18:19:56,470           ********************************************************************************

2024-08-19T18:19:56,471   !!
2024-08-19T18:19:56,472     check.warn(importable)
2024-08-19T18:19:56,472   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-08-19T18:19:56,473   !!

2024-08-19T18:19:56,474           ********************************************************************************
2024-08-19T18:19:56,475           ############################
2024-08-19T18:19:56,475           # Package would be ignored #
2024-08-19T18:19:56,476           ############################
2024-08-19T18:19:56,476           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-08-19T18:19:56,477           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,478           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,478           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-08-19T18:19:56,479           to the `packages` configuration field.

2024-08-19T18:19:56,480           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,480           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,481           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,482           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,483           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,484           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-08-19T18:19:56,485           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-08-19T18:19:56,485           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,486           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,487           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,488           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,489           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,490           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,490                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,491                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,492                 directory, all directories are treated like packages.
2024-08-19T18:19:56,492           ********************************************************************************

2024-08-19T18:19:56,493   !!
2024-08-19T18:19:56,494     check.warn(importable)
2024-08-19T18:19:56,495   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-08-19T18:19:56,495   !!

2024-08-19T18:19:56,496           ********************************************************************************
2024-08-19T18:19:56,497           ############################
2024-08-19T18:19:56,497           # Package would be ignored #
2024-08-19T18:19:56,498           ############################
2024-08-19T18:19:56,499           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-08-19T18:19:56,499           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,500           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,500           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-08-19T18:19:56,501           to the `packages` configuration field.

2024-08-19T18:19:56,502           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,503           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,503           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,504           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,505           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,506           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-08-19T18:19:56,507           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-08-19T18:19:56,507           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,508           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,508           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,509           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,510           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,512           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,512                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,513                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,514                 directory, all directories are treated like packages.
2024-08-19T18:19:56,514           ********************************************************************************

2024-08-19T18:19:56,515   !!
2024-08-19T18:19:56,516     check.warn(importable)
2024-08-19T18:19:56,516   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-08-19T18:19:56,517   !!

2024-08-19T18:19:56,518           ********************************************************************************
2024-08-19T18:19:56,518           ############################
2024-08-19T18:19:56,519           # Package would be ignored #
2024-08-19T18:19:56,519           ############################
2024-08-19T18:19:56,520           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-08-19T18:19:56,520           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,522           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-08-19T18:19:56,522           to the `packages` configuration field.

2024-08-19T18:19:56,523           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,524           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,525           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,526           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,527           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-08-19T18:19:56,527           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-08-19T18:19:56,528           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,528           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,529           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,530           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,531           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,532           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,533                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,533                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,534                 directory, all directories are treated like packages.
2024-08-19T18:19:56,534           ********************************************************************************

2024-08-19T18:19:56,535   !!
2024-08-19T18:19:56,536     check.warn(importable)
2024-08-19T18:19:56,536   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-08-19T18:19:56,537   !!

2024-08-19T18:19:56,538           ********************************************************************************
2024-08-19T18:19:56,538           ############################
2024-08-19T18:19:56,539           # Package would be ignored #
2024-08-19T18:19:56,539           ############################
2024-08-19T18:19:56,540           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-08-19T18:19:56,540           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,541           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,542           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-08-19T18:19:56,542           to the `packages` configuration field.

2024-08-19T18:19:56,543           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,544           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,544           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,546           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,547           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,548           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-08-19T18:19:56,548           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-08-19T18:19:56,549           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,549           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,550           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,550           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,551           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,553           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,553                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,554                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,554                 directory, all directories are treated like packages.
2024-08-19T18:19:56,555           ********************************************************************************

2024-08-19T18:19:56,556   !!
2024-08-19T18:19:56,556     check.warn(importable)
2024-08-19T18:19:56,557   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-08-19T18:19:56,557   !!

2024-08-19T18:19:56,558           ********************************************************************************
2024-08-19T18:19:56,559           ############################
2024-08-19T18:19:56,559           # Package would be ignored #
2024-08-19T18:19:56,560           ############################
2024-08-19T18:19:56,560           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-08-19T18:19:56,561           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,562           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,562           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-08-19T18:19:56,563           to the `packages` configuration field.

2024-08-19T18:19:56,564           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,564           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,565           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,566           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,567           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,568           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-08-19T18:19:56,569           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-08-19T18:19:56,569           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,570           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,570           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,571           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,572           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,574           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,574                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,575                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,576                 directory, all directories are treated like packages.
2024-08-19T18:19:56,576           ********************************************************************************

2024-08-19T18:19:56,577   !!
2024-08-19T18:19:56,578     check.warn(importable)
2024-08-19T18:19:56,578   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-08-19T18:19:56,579   !!

2024-08-19T18:19:56,580           ********************************************************************************
2024-08-19T18:19:56,580           ############################
2024-08-19T18:19:56,580           # Package would be ignored #
2024-08-19T18:19:56,581           ############################
2024-08-19T18:19:56,581           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-08-19T18:19:56,582           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,582           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,583           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-08-19T18:19:56,583           to the `packages` configuration field.

2024-08-19T18:19:56,584           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,585           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,585           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,586           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,587           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,588           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-08-19T18:19:56,589           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-08-19T18:19:56,589           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,590           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,590           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,591           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,592           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,594           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,594                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,595                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,595                 directory, all directories are treated like packages.
2024-08-19T18:19:56,596           ********************************************************************************

2024-08-19T18:19:56,597   !!
2024-08-19T18:19:56,598     check.warn(importable)
2024-08-19T18:19:56,598   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-08-19T18:19:56,599   !!

2024-08-19T18:19:56,600           ********************************************************************************
2024-08-19T18:19:56,601           ############################
2024-08-19T18:19:56,602           # Package would be ignored #
2024-08-19T18:19:56,603           ############################
2024-08-19T18:19:56,603           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-08-19T18:19:56,604           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,607           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,607           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-08-19T18:19:56,608           to the `packages` configuration field.

2024-08-19T18:19:56,609           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,610           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,611           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,612           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,613           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,614           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-08-19T18:19:56,615           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-08-19T18:19:56,615           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,616           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,616           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,618           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,619           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,621           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,622                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,622                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,623                 directory, all directories are treated like packages.
2024-08-19T18:19:56,623           ********************************************************************************

2024-08-19T18:19:56,624   !!
2024-08-19T18:19:56,625     check.warn(importable)
2024-08-19T18:19:56,625   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-08-19T18:19:56,626   !!

2024-08-19T18:19:56,627           ********************************************************************************
2024-08-19T18:19:56,627           ############################
2024-08-19T18:19:56,628           # Package would be ignored #
2024-08-19T18:19:56,628           ############################
2024-08-19T18:19:56,629           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-08-19T18:19:56,629           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,630           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,631           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-08-19T18:19:56,631           to the `packages` configuration field.

2024-08-19T18:19:56,632           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,633           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,634           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,635           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,636           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,637           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-08-19T18:19:56,638           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-08-19T18:19:56,638           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,639           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,639           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,640           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,641           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,643           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,643                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,644                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,644                 directory, all directories are treated like packages.
2024-08-19T18:19:56,644           ********************************************************************************

2024-08-19T18:19:56,645   !!
2024-08-19T18:19:56,646     check.warn(importable)
2024-08-19T18:19:56,646   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-08-19T18:19:56,647   !!

2024-08-19T18:19:56,648           ********************************************************************************
2024-08-19T18:19:56,648           ############################
2024-08-19T18:19:56,648           # Package would be ignored #
2024-08-19T18:19:56,649           ############################
2024-08-19T18:19:56,649           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-08-19T18:19:56,650           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,651           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,651           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-08-19T18:19:56,652           to the `packages` configuration field.

2024-08-19T18:19:56,653           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,653           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,654           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,655           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,656           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,657           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-08-19T18:19:56,657           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-08-19T18:19:56,658           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,658           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,659           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,660           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,661           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,663           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,663                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,664                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,664                 directory, all directories are treated like packages.
2024-08-19T18:19:56,665           ********************************************************************************

2024-08-19T18:19:56,666   !!
2024-08-19T18:19:56,666     check.warn(importable)
2024-08-19T18:19:56,667   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-08-19T18:19:56,667   !!

2024-08-19T18:19:56,669           ********************************************************************************
2024-08-19T18:19:56,669           ############################
2024-08-19T18:19:56,670           # Package would be ignored #
2024-08-19T18:19:56,670           ############################
2024-08-19T18:19:56,670           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-08-19T18:19:56,671           but it is absent from setuptools' `packages` configuration.

2024-08-19T18:19:56,672           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T18:19:56,672           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-08-19T18:19:56,673           to the `packages` configuration field.

2024-08-19T18:19:56,674           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T18:19:56,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T18:19:56,674           instead of `find_packages(...)`/`find:`).

2024-08-19T18:19:56,675           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T18:19:56,676           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T18:19:56,677           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-08-19T18:19:56,678           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-08-19T18:19:56,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T18:19:56,679           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T18:19:56,679           combination with a more fine grained `package-data` configuration.

2024-08-19T18:19:56,681           You can read more about "package data files" on setuptools documentation page:

2024-08-19T18:19:56,682           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T18:19:56,683           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T18:19:56,684                 even if it does not contain any `.py` files.
2024-08-19T18:19:56,684                 On the other hand, currently there is no concept of package data
2024-08-19T18:19:56,685                 directory, all directories are treated like packages.
2024-08-19T18:19:56,685           ********************************************************************************

2024-08-19T18:19:56,686   !!
2024-08-19T18:19:56,687     check.warn(importable)
2024-08-19T18:19:56,687   creating build/lib/alpaca_eval/evaluators_configs
2024-08-19T18:19:56,688   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-08-19T18:19:56,689   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:56,689   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:56,690   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:56,690   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:56,691   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:56,691   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:56,692   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:56,692   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:56,693   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:56,695   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:56,696   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:56,696   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:56,697   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-08-19T18:19:56,697   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-08-19T18:19:56,698   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-08-19T18:19:56,698   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-08-19T18:19:56,699   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:56,699   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:56,700   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:56,700   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:56,701   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:56,701   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:56,702   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:56,702   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:56,703   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:56,703   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:56,704   copying src/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:56,704   copying src/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:56,705   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,705   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,706   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,706   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,707   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,707   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,708   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,709   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,709   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,710   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,710   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,710   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,711   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,711   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:56,712   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:56,712   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:56,713   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:56,713   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:56,714   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:56,714   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:56,715   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-08-19T18:19:56,715   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-08-19T18:19:56,716   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-08-19T18:19:56,716   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-08-19T18:19:56,717   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:56,717   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:56,718   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:56,718   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:56,719   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:56,719   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:56,720   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:56,720   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:56,721   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:56,721   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-08-19T18:19:56,722   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-08-19T18:19:56,722   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:56,723   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:56,723   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:56,724   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:56,724   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:56,725   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:56,725   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-08-19T18:19:56,726   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-08-19T18:19:56,726   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:56,726   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:56,727   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:56,727   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-08-19T18:19:56,728   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-08-19T18:19:56,728   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-08-19T18:19:56,729   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-08-19T18:19:56,730   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-08-19T18:19:56,730   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-08-19T18:19:56,731   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:56,731   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:56,731   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:56,732   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:56,733   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:56,733   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:56,734   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-08-19T18:19:56,734   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-08-19T18:19:56,735   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-08-19T18:19:56,735   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-08-19T18:19:56,736   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:56,736   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:56,737   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:56,737   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-08-19T18:19:56,738   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-08-19T18:19:56,739   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-08-19T18:19:56,739   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-08-19T18:19:56,740   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:56,740   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:56,740   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:56,741   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-08-19T18:19:56,742   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-08-19T18:19:56,742   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:56,742   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:56,743   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:56,743   creating build/lib/alpaca_eval/evaluators_configs/test
2024-08-19T18:19:56,744   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-08-19T18:19:56,744   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:56,745   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:56,745   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:56,746   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-08-19T18:19:56,746   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-08-19T18:19:56,747   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-08-19T18:19:56,747   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-08-19T18:19:56,748   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-08-19T18:19:56,748   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-08-19T18:19:56,749   creating build/lib/alpaca_eval/leaderboards
2024-08-19T18:19:56,750   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:56,750   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:56,751   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:56,751   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:56,752   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:56,752   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,753   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,753   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,754   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,754   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,755   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:56,755   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-08-19T18:19:56,756   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-08-19T18:19:56,756   creating build/lib/alpaca_eval/models_configs
2024-08-19T18:19:56,756   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:56,757   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:56,758   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:56,758   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:56,759   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:56,759   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:56,760   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:56,760   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:56,761   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:56,761   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:56,762   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:56,762   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:56,763   creating build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-08-19T18:19:56,763   copying src/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-08-19T18:19:56,764   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:56,764   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:56,765   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:56,765   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:56,766   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:56,766   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:56,767   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:56,768   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:56,768   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:56,768   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:56,769   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:56,770   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:56,770   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:56,771   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:56,771   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:56,771   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:56,772   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:56,772   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:56,773   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:56,773   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:56,774   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:56,774   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:56,775   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:56,775   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:56,776   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:56,776   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:56,777   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:56,778   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:56,778   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:56,779   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:56,779   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:56,780   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:56,780   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:56,781   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:56,782   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:56,782   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:56,783   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-08-19T18:19:56,783   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-08-19T18:19:56,783   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-08-19T18:19:56,784   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-08-19T18:19:56,784   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-08-19T18:19:56,785   copying src/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-08-19T18:19:56,785   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-08-19T18:19:56,786   copying src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-08-19T18:19:56,786   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-08-19T18:19:56,787   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-08-19T18:19:56,787   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-08-19T18:19:56,788   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-08-19T18:19:56,788   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-08-19T18:19:56,789   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-08-19T18:19:56,790   creating build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:56,790   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:56,791   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:56,791   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-08-19T18:19:56,792   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-08-19T18:19:56,792   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-08-19T18:19:56,793   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-08-19T18:19:56,793   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:56,794   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:56,794   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:56,795   creating build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-08-19T18:19:56,795   copying src/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-08-19T18:19:56,796   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:56,797   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:56,797   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:56,798   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:56,798   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:56,798   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:56,799   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:56,799   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:56,800   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:56,801   creating build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:56,802   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:56,804   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:56,806   creating build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:56,807   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:56,809   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:56,811   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:56,812   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:56,814   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:56,816   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:56,817   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:56,819   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:56,821   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:56,822   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:56,824   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:56,826   creating build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-08-19T18:19:56,827   copying src/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-08-19T18:19:56,829   creating build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:56,830   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:56,833   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:56,835   creating build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-08-19T18:19:56,836   copying src/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-08-19T18:19:56,838   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:56,839   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:56,841   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:56,843   creating build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-08-19T18:19:56,844   copying src/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-08-19T18:19:56,846   creating build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:56,847   copying src/alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:56,849   copying src/alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:56,851   creating build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:56,852   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:56,854   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:56,857   creating build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:56,858   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:56,861   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:56,864   creating build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:56,865   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:56,867   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:56,869   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:56,871   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:56,874   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:56,876   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-08-19T18:19:56,877   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-08-19T18:19:56,880   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:56,882   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:56,884   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:56,886   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-08-19T18:19:56,887   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-08-19T18:19:56,890   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-08-19T18:19:56,891   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-08-19T18:19:56,893   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:56,894   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:56,896   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:56,898   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:56,899   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:56,900   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:56,902   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:56,903   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:56,905   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:56,907   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-08-19T18:19:56,908   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-08-19T18:19:56,910   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-08-19T18:19:56,911   copying src/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-08-19T18:19:56,913   creating build/lib/alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:56,914   copying src/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:56,916   copying src/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:56,918   creating build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-08-19T18:19:56,918   copying src/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-08-19T18:19:56,920   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-08-19T18:19:56,921   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-08-19T18:19:56,923   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:56,924   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:56,926   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:56,928   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:56,929   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:56,931   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:56,933   creating build/lib/alpaca_eval/models_configs/Together-MoA
2024-08-19T18:19:56,934   copying src/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA
2024-08-19T18:19:56,936   creating build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-08-19T18:19:56,938   copying src/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-08-19T18:19:56,939   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:56,940   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:56,942   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:56,944   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:56,945   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:56,947   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:56,948   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:56,949   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:56,951   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:56,953   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-08-19T18:19:56,954   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-08-19T18:19:56,956   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:56,956   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:56,959   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:56,960   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:56,962   creating build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:56,963   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:56,965   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:56,967   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:56,969   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:56,970   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:56,972   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:56,974   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:56,976   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:56,977   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:56,979   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:56,981   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:56,982   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:56,984   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:56,986   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-08-19T18:19:56,987   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-08-19T18:19:56,989   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-08-19T18:19:56,990   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-08-19T18:19:56,992   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-08-19T18:19:56,992   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-08-19T18:19:56,994   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-08-19T18:19:56,995   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-08-19T18:19:56,997   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:56,998   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:57,000   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:57,002   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:57,003   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:57,005   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:57,007   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-08-19T18:19:57,008   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-08-19T18:19:57,010   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-08-19T18:19:57,011   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-08-19T18:19:57,013   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-08-19T18:19:57,013   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-08-19T18:19:57,015   creating build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-08-19T18:19:57,016   copying src/alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml -> build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-08-19T18:19:57,019   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:57,019   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:57,022   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:57,024   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:57,025   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:57,027   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:57,029   creating build/lib/alpaca_eval/models_configs/claude
2024-08-19T18:19:57,030   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-08-19T18:19:57,032   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-08-19T18:19:57,034   creating build/lib/alpaca_eval/models_configs/claude-2
2024-08-19T18:19:57,035   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-08-19T18:19:57,037   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-08-19T18:19:57,038   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-08-19T18:19:57,040   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:57,040   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:57,042   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:57,044   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:57,045   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:57,047   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:57,049   creating build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:57,050   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:57,052   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:57,053   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-08-19T18:19:57,054   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-08-19T18:19:57,056   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:57,057   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:57,059   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:57,061   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-08-19T18:19:57,062   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-08-19T18:19:57,064   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-08-19T18:19:57,065   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-08-19T18:19:57,067   creating build/lib/alpaca_eval/models_configs/cohere
2024-08-19T18:19:57,067   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-08-19T18:19:57,070   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-08-19T18:19:57,071   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:57,072   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:57,074   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:57,076   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-08-19T18:19:57,077   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-08-19T18:19:57,079   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:57,080   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:57,082   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:57,084   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-08-19T18:19:57,085   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-08-19T18:19:57,087   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-08-19T18:19:57,088   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-08-19T18:19:57,090   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-08-19T18:19:57,090   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-08-19T18:19:57,092   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-08-19T18:19:57,093   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-08-19T18:19:57,095   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-08-19T18:19:57,096   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-08-19T18:19:57,098   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-08-19T18:19:57,099   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-08-19T18:19:57,101   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:57,102   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:57,104   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:57,105   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:57,106   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:57,108   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:57,110   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-08-19T18:19:57,111   copying src/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-08-19T18:19:57,113   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-08-19T18:19:57,113   copying src/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-08-19T18:19:57,115   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-08-19T18:19:57,116   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-08-19T18:19:57,118   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-08-19T18:19:57,119   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-08-19T18:19:57,122   creating build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:57,123   copying src/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:57,125   copying src/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:57,127   creating build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:57,128   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:57,130   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:57,132   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-08-19T18:19:57,133   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-08-19T18:19:57,135   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-08-19T18:19:57,135   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-08-19T18:19:57,138   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-08-19T18:19:57,138   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-08-19T18:19:57,140   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-08-19T18:19:57,141   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-08-19T18:19:57,143   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-08-19T18:19:57,144   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-08-19T18:19:57,146   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-08-19T18:19:57,147   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-08-19T18:19:57,149   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-08-19T18:19:57,150   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-08-19T18:19:57,152   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-08-19T18:19:57,152   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-08-19T18:19:57,155   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-08-19T18:19:57,155   copying src/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-08-19T18:19:57,158   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-08-19T18:19:57,159   copying src/alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-08-19T18:19:57,161   creating build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-08-19T18:19:57,162   copying src/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-08-19T18:19:57,164   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-08-19T18:19:57,164   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-08-19T18:19:57,166   creating build/lib/alpaca_eval/models_configs/gpt4
2024-08-19T18:19:57,167   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-08-19T18:19:57,170   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-08-19T18:19:57,172   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-08-19T18:19:57,173   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-08-19T18:19:57,175   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-08-19T18:19:57,176   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-08-19T18:19:57,179   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-08-19T18:19:57,180   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-08-19T18:19:57,182   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-08-19T18:19:57,183   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-08-19T18:19:57,185   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:57,186   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:57,187   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:57,189   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:57,190   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:57,192   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:57,194   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:57,195   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:57,197   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:57,199   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-08-19T18:19:57,200   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-08-19T18:19:57,202   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-08-19T18:19:57,203   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-08-19T18:19:57,205   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-08-19T18:19:57,206   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-08-19T18:19:57,209   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-08-19T18:19:57,210   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-08-19T18:19:57,212   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-08-19T18:19:57,213   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-08-19T18:19:57,216   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:57,217   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:57,220   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:57,222   creating build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-08-19T18:19:57,223   copying src/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-08-19T18:19:57,226   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:57,227   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:57,230   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:57,232   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-08-19T18:19:57,233   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-08-19T18:19:57,236   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-08-19T18:19:57,237   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-08-19T18:19:57,239   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:57,241   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:57,243   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:57,245   creating build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-08-19T18:19:57,246   copying src/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-08-19T18:19:57,249   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:57,250   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:57,252   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:57,254   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-08-19T18:19:57,255   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-08-19T18:19:57,257   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:57,259   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:57,261   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:57,263   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:57,264   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:57,267   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:57,269   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:57,270   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:57,272   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:57,274   creating build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:57,275   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:57,278   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:57,280   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-08-19T18:19:57,281   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-08-19T18:19:57,283   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:57,284   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:57,286   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:57,289   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:57,290   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:57,292   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:57,294   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-08-19T18:19:57,295   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-08-19T18:19:57,298   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:57,299   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:57,301   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:57,303   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:57,304   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:57,307   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:57,309   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:57,310   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:57,312   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:57,314   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-08-19T18:19:57,315   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-08-19T18:19:57,317   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:57,319   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:57,321   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:57,323   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:57,324   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:57,326   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:57,328   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:57,329   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:57,331   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:57,334   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:57,335   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:57,337   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:57,339   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:57,340   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:57,342   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:57,344   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:57,346   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:57,348   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:57,350   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:57,352   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:57,354   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:57,356   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:57,357   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:57,360   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:57,362   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:57,363   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:57,365   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:57,367   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-08-19T18:19:57,368   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-08-19T18:19:57,370   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-08-19T18:19:57,371   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-08-19T18:19:57,374   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-08-19T18:19:57,375   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-08-19T18:19:57,377   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-08-19T18:19:57,379   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-08-19T18:19:57,381   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-08-19T18:19:57,382   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-08-19T18:19:57,384   creating build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-08-19T18:19:57,385   copying src/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-08-19T18:19:57,387   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-08-19T18:19:57,388   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-08-19T18:19:57,391   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-08-19T18:19:57,391   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-08-19T18:19:57,394   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:57,395   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:57,397   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:57,399   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-08-19T18:19:57,400   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-08-19T18:19:57,402   creating build/lib/alpaca_eval/models_configs/phi-2
2024-08-19T18:19:57,403   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-08-19T18:19:57,404   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-08-19T18:19:57,407   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:57,407   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:57,409   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:57,411   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:57,412   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:57,414   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:57,416   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:57,417   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:57,419   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:57,421   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-08-19T18:19:57,422   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-08-19T18:19:57,424   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-08-19T18:19:57,424   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-08-19T18:19:57,426   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-08-19T18:19:57,427   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-08-19T18:19:57,429   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-08-19T18:19:57,430   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-08-19T18:19:57,432   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:57,433   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:57,435   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:57,437   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-08-19T18:19:57,438   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-08-19T18:19:57,440   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-08-19T18:19:57,441   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-08-19T18:19:57,443   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:57,444   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:57,446   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:57,448   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-08-19T18:19:57,449   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-08-19T18:19:57,451   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-08-19T18:19:57,452   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-08-19T18:19:57,454   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-08-19T18:19:57,455   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-08-19T18:19:57,457   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:57,458   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:57,460   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:57,461   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:57,462   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:57,464   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:57,466   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:57,467   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:57,469   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:57,471   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:57,471   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:57,474   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:57,475   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-08-19T18:19:57,476   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-08-19T18:19:57,479   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-08-19T18:19:57,479   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-08-19T18:19:57,482   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-08-19T18:19:57,483   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-08-19T18:19:57,484   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-08-19T18:19:57,485   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-08-19T18:19:57,487   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-08-19T18:19:57,488   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-08-19T18:19:57,490   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:57,491   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:57,493   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:57,495   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-08-19T18:19:57,496   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-08-19T18:19:57,498   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-08-19T18:19:57,499   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-08-19T18:19:57,501   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:57,502   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:57,504   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:57,507   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-08-19T18:19:57,508   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-08-19T18:19:57,510   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-08-19T18:19:57,510   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-08-19T18:19:57,512   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-08-19T18:19:57,513   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-08-19T18:19:57,515   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-08-19T18:19:57,516   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-08-19T18:19:57,518   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-08-19T18:19:57,519   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-08-19T18:19:57,521   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-08-19T18:19:57,522   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-08-19T18:19:57,524   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:57,524   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:57,526   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:57,528   creating build/lib/alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:57,529   copying src/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:57,531   copying src/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:57,534   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:57,535   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:57,538   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:57,540   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:57,541   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:57,544   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:57,546   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-08-19T18:19:57,547   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-08-19T18:19:57,550   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-08-19T18:19:57,551   copying src/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-08-19T18:19:57,594   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-08-19T18:19:57,595   !!

2024-08-19T18:19:57,597           ********************************************************************************
2024-08-19T18:19:57,597           Please avoid running ``setup.py`` directly.
2024-08-19T18:19:57,598           Instead, use pypa/build, pypa/installer or other
2024-08-19T18:19:57,599           standards-based tools.

2024-08-19T18:19:57,601           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-08-19T18:19:57,601           ********************************************************************************

2024-08-19T18:19:57,602   !!
2024-08-19T18:19:57,603     self.initialize_options()
2024-08-19T18:19:57,632   installing to build/bdist.linux-armv7l/wheel
2024-08-19T18:19:57,633   running install
2024-08-19T18:19:57,657   running install_lib
2024-08-19T18:19:57,683   creating build/bdist.linux-armv7l
2024-08-19T18:19:57,684   creating build/bdist.linux-armv7l/wheel
2024-08-19T18:19:57,687   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-08-19T18:19:57,688   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,692   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-08-19T18:19:57,694   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:57,695   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:57,697   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-08-19T18:19:57,699   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:57,699   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:57,701   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-08-19T18:19:57,703   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-08-19T18:19:57,704   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-08-19T18:19:57,706   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:57,707   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:57,709   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-08-19T18:19:57,711   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:57,712   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:57,714   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/aviary_gpt4
2024-08-19T18:19:57,716   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-08-19T18:19:57,717   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/test
2024-08-19T18:19:57,720   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:57,721   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:57,723   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-08-19T18:19:57,725   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-08-19T18:19:57,726   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4
2024-08-19T18:19:57,728   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:57,728   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:57,731   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-08-19T18:19:57,733   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:57,734   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:57,735   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/text_davinci_003
2024-08-19T18:19:57,737   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-08-19T18:19:57,738   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-08-19T18:19:57,740   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-08-19T18:19:57,741   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/bedrock_claude_2
2024-08-19T18:19:57,744   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-08-19T18:19:57,745   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-08-19T18:19:57,747   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:57,748   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:57,750   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/guanaco_33b
2024-08-19T18:19:57,752   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-08-19T18:19:57,754   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-08-19T18:19:57,756   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-08-19T18:19:57,757   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/cohere
2024-08-19T18:19:57,760   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-08-19T18:19:57,761   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-08-19T18:19:57,763   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:57,764   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:57,767   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt_fn
2024-08-19T18:19:57,769   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-08-19T18:19:57,770   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-08-19T18:19:57,772   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:57,773   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:57,775   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_ranking
2024-08-19T18:19:57,777   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:57,778   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:57,780   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-08-19T18:19:57,782   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:57,783   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:57,785   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-08-19T18:19:57,787   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:57,788   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:57,790   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/lmsys_gpt4
2024-08-19T18:19:57,794   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-08-19T18:19:57,796   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-08-19T18:19:57,799   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-08-19T18:19:57,800   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/bedrock_claude
2024-08-19T18:19:57,803   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-08-19T18:19:57,804   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-08-19T18:19:57,816   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:57,818   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:57,829   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-08-19T18:19:57,831   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-08-19T18:19:57,832   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_2
2024-08-19T18:19:57,834   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:57,835   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:57,837   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-08-19T18:19:57,840   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:57,841   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:57,843   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-08-19T18:19:57,845   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:57,846   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:57,849   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-08-19T18:19:57,851   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,852   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,855   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,858   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,860   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,862   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,864   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,866   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,868   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,870   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,873   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,875   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,878   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,880   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-08-19T18:19:57,883   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-08-19T18:19:57,884   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo
2024-08-19T18:19:57,890   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:57,891   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:57,893   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-08-19T18:19:57,895   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:57,896   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:57,898   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt
2024-08-19T18:19:57,900   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs
2024-08-19T18:19:57,903   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-08-19T18:19:57,904   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-08-19T18:19:57,906   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-08-19T18:19:57,907   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-08-19T18:19:57,910   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:57,911   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:57,912   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-08-19T18:19:57,914   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:57,915   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:57,917   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-08-19T18:19:57,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-08-19T18:19:57,921   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-08-19T18:19:57,923   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:57,924   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:57,926   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude
2024-08-19T18:19:57,929   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-08-19T18:19:57,930   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-08-19T18:19:57,931   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/evaluators
2024-08-19T18:19:57,934   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:57,935   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:57,937   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:57,939   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:57,941   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-08-19T18:19:57,944   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,945   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,947   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,948   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,950   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,952   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-08-19T18:19:57,955   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,957   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,959   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,962   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,964   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,966   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,969   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:57,971   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-08-19T18:19:57,972   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-08-19T18:19:57,974   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-08-19T18:19:57,976   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-08-19T18:19:57,978   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-08-19T18:19:57,981   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-08-19T18:19:57,982   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-08-19T18:19:57,985   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-08-19T18:19:57,986   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-08-19T18:19:57,993   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-08-19T18:19:57,994   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:57,995   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:57,997   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-08-19T18:19:57,999   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:58,000   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:58,002   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-08-19T18:19:58,004   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:58,005   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:58,007   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-08-19T18:19:58,009   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-08-19T18:19:58,010   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-08-19T18:19:58,012   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:58,013   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:58,015   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-08-19T18:19:58,017   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-08-19T18:19:58,018   copying build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-08-19T18:19:58,021   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-08-19T18:19:58,022   copying build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B-best-of-64
2024-08-19T18:19:58,024   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-08-19T18:19:58,025   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-08-19T18:19:58,027   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:58,028   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:58,030   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-08-19T18:19:58,032   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:58,033   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:58,035   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-08-19T18:19:58,037   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-08-19T18:19:58,038   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-08-19T18:19:58,040   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:58,041   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:58,043   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-08-19T18:19:58,045   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-08-19T18:19:58,046   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-08-19T18:19:58,049   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-08-19T18:19:58,050   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_gamed
2024-08-19T18:19:58,052   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-08-19T18:19:58,053   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b
2024-08-19T18:19:58,055   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-08-19T18:19:58,056   copying build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-08-19T18:19:58,059   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:58,059   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:58,061   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cut-13b
2024-08-19T18:19:58,063   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-08-19T18:19:58,064   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-08-19T18:19:58,067   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-08-19T18:19:58,068   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-33b-api
2024-08-19T18:19:58,070   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-08-19T18:19:58,071   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-65b
2024-08-19T18:19:58,074   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-08-19T18:19:58,075   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-08-19T18:19:58,077   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-08-19T18:19:58,078   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1
2024-08-19T18:19:58,081   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:58,082   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:58,083   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-orpo-beta
2024-08-19T18:19:58,085   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-08-19T18:19:58,086   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-08-19T18:19:58,089   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:58,090   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:58,091   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-08-19T18:19:58,094   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:58,095   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:58,096   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-08-19T18:19:58,099   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-08-19T18:19:58,100   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-08-19T18:19:58,102   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:58,103   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:58,105   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/jina-chat
2024-08-19T18:19:58,107   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-08-19T18:19:58,108   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4
2024-08-19T18:19:58,110   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4
2024-08-19T18:19:58,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-08-19T18:19:58,113   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-08-19T18:19:58,116   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:58,117   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:58,119   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_concise
2024-08-19T18:19:58,121   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:58,122   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:58,124   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-08-19T18:19:58,126   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:58,127   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:58,129   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-08-19T18:19:58,131   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:58,132   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:58,133   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-3b
2024-08-19T18:19:58,136   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-08-19T18:19:58,137   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat8192-13b
2024-08-19T18:19:58,139   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:58,140   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:58,142   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-08-19T18:19:58,144   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-08-19T18:19:58,145   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-08-19T18:19:58,147   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-08-19T18:19:58,148   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-08-19T18:19:58,151   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:58,152   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:58,154   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_003
2024-08-19T18:19:58,156   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:58,157   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:58,159   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minotaur-13b
2024-08-19T18:19:58,162   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:58,163   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:58,165   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-08-19T18:19:58,167   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-08-19T18:19:58,168   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-08-19T18:19:58,170   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-08-19T18:19:58,171   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-08-19T18:19:58,173   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:58,174   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:58,176   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-08-19T18:19:58,178   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-08-19T18:19:58,179   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-7b-it
2024-08-19T18:19:58,181   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-08-19T18:19:58,182   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/bedrock_claude_2
2024-08-19T18:19:58,185   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-08-19T18:19:58,186   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-08-19T18:19:58,189   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:58,189   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:58,191   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-08-19T18:19:58,194   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-08-19T18:19:58,195   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-08-19T18:19:58,198   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-08-19T18:19:58,198   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/evo-7b
2024-08-19T18:19:58,201   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:58,202   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:58,204   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-08-19T18:19:58,207   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-08-19T18:19:58,208   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-13b
2024-08-19T18:19:58,210   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:58,211   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:58,213   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b
2024-08-19T18:19:58,215   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,216   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,218   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-08-19T18:19:58,219   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-08-19T18:19:58,222   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-08-19T18:19:58,223   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-08-19T18:19:58,227   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:58,228   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:58,231   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-08-19T18:19:58,234   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-08-19T18:19:58,236   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-08-19T18:19:58,241   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-08-19T18:19:58,406   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-08-19T18:19:58,410   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-08-19T18:19:58,412   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-08-19T18:19:58,415   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:58,417   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:58,420   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-08-19T18:19:58,423   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-08-19T18:19:58,425   copying build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-08-19T18:19:58,429   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-08-19T18:19:58,431   copying build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-08-19T18:19:58,434   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-08-19T18:19:58,436   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_001
2024-08-19T18:19:58,440   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-08-19T18:19:58,442   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b_concise
2024-08-19T18:19:58,445   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:58,447   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:58,450   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b
2024-08-19T18:19:58,453   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:58,455   copying build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:58,458   copying build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-08-19T18:19:58,461   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:58,463   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:58,466   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-08-19T18:19:58,470   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-08-19T18:19:58,472   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cohere
2024-08-19T18:19:58,475   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cohere
2024-08-19T18:19:58,478   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-08-19T18:19:58,480   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pythia-12b-mix-sft
2024-08-19T18:19:58,483   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:58,485   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:58,488   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-08-19T18:19:58,491   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:58,493   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:58,496   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-08-19T18:19:58,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:58,502   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:58,505   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-08-19T18:19:58,508   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-08-19T18:19:58,510   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-08-19T18:19:58,514   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:58,516   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:58,519   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b
2024-08-19T18:19:58,522   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-08-19T18:19:58,524   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-08-19T18:19:58,528   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-08-19T18:19:58,530   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v2-13b
2024-08-19T18:19:58,533   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-08-19T18:19:58,535   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude2-alpaca-13b
2024-08-19T18:19:58,539   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:58,540   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:58,543   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-08-19T18:19:58,545   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-08-19T18:19:58,546   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/opencoderplus-15b
2024-08-19T18:19:58,548   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:58,550   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:58,551   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-08-19T18:19:58,554   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:58,555   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:58,557   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen-14B-Chat
2024-08-19T18:19:58,559   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:58,561   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:58,563   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-08-19T18:19:58,565   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:58,566   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:58,568   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-08-19T18:19:58,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-08-19T18:19:58,572   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deita-7b-v1.0
2024-08-19T18:19:58,574   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:58,575   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:58,577   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-08-19T18:19:58,580   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-08-19T18:19:58,581   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-08-19T18:19:58,583   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:58,584   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:58,586   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-08-19T18:19:58,588   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:58,590   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:58,592   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-08-19T18:19:58,594   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-08-19T18:19:58,595   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613
2024-08-19T18:19:58,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-08-19T18:19:58,599   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-08-19T18:19:58,602   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:58,603   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:58,606   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemini-pro
2024-08-19T18:19:58,608   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:58,609   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:58,611   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-08-19T18:19:58,614   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:58,615   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:58,617   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/causallm-14b
2024-08-19T18:19:58,619   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:58,620   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:58,622   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0
2024-08-19T18:19:58,625   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-08-19T18:19:58,626   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt35_turbo_instruct
2024-08-19T18:19:58,628   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:58,629   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:58,631   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Ein-70B-v0.1
2024-08-19T18:19:58,634   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-08-19T18:19:58,635   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-7b
2024-08-19T18:19:58,638   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-08-19T18:19:58,639   copying build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-08-19T18:19:58,642   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-08-19T18:19:58,643   copying build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-08-19T18:19:58,645   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:58,646   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:58,648   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview
2024-08-19T18:19:58,651   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-08-19T18:19:58,652   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-70b
2024-08-19T18:19:58,654   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-08-19T18:19:58,655   copying build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-08-19T18:19:58,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:58,659   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:58,661   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-7b
2024-08-19T18:19:58,664   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:58,665   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:58,667   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-08-19T18:19:58,670   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:58,671   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:58,673   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-08-19T18:19:58,675   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-08-19T18:19:58,676   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/bedrock_claude
2024-08-19T18:19:58,678   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-08-19T18:19:58,680   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-08-19T18:19:58,682   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-08-19T18:19:58,683   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-08-19T18:19:58,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-08-19T18:19:58,687   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v3.1-13b
2024-08-19T18:19:58,690   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:58,691   copying build/lib/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:58,693   copying build/lib/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B
2024-08-19T18:19:58,695   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:58,696   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:58,698   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-7b-alpha
2024-08-19T18:19:58,700   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-08-19T18:19:58,701   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2b-it
2024-08-19T18:19:58,704   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-08-19T18:19:58,705   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-instant-1.2
2024-08-19T18:19:58,708   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-08-19T18:19:58,709   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-08-19T18:19:58,712   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:58,713   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:58,715   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-08-19T18:19:58,717   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:58,718   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:58,720   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.1
2024-08-19T18:19:58,722   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:58,723   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:58,724   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/platolm-7b
2024-08-19T18:19:58,727   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-08-19T18:19:58,727   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-08-19T18:19:58,730   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:58,731   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:58,732   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-08-19T18:19:58,734   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:58,735   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:58,737   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-08-19T18:19:58,739   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-08-19T18:19:58,740   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-13b
2024-08-19T18:19:58,743   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:58,744   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:58,746   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-08-19T18:19:58,748   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:58,749   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:58,750   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-13b
2024-08-19T18:19:58,753   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-08-19T18:19:58,754   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-7b
2024-08-19T18:19:58,756   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:58,757   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:58,759   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b
2024-08-19T18:19:58,761   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-08-19T18:19:58,762   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-08-19T18:19:58,764   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-08-19T18:19:58,765   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2
2024-08-19T18:19:58,766   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2
2024-08-19T18:19:58,769   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-08-19T18:19:58,770   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v2-w-13b
2024-08-19T18:19:58,772   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-08-19T18:19:58,773   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-08-19T18:19:58,775   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-08-19T18:19:58,776   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-08-19T18:19:58,778   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-08-19T18:19:58,779   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-08-19T18:19:58,781   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:58,782   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:58,784   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_verbose
2024-08-19T18:19:58,787   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:58,788   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:58,790   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-08-19T18:19:58,792   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-08-19T18:19:58,793   copying build/lib/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Together-MoA-Lite
2024-08-19T18:19:58,795   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-08-19T18:19:58,796   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/falcon-7b-instruct
2024-08-19T18:19:58,798   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-08-19T18:19:58,800   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613_concise
2024-08-19T18:19:58,802   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-08-19T18:19:58,803   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b_verbose
2024-08-19T18:19:58,805   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:58,806   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:58,808   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-08-19T18:19:58,810   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:58,811   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:58,813   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-08-19T18:19:58,815   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-08-19T18:19:58,816   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b-v1.5
2024-08-19T18:19:58,819   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-08-19T18:19:58,820   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-08-19T18:19:58,822   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,823   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,825   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,827   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-08-19T18:19:58,830   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-08-19T18:19:58,830   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-08-19T18:19:58,833   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:58,834   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:58,836   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Conifer-7B-DPO
2024-08-19T18:19:58,838   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:58,839   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:58,841   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama-65b
2024-08-19T18:19:58,843   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:58,844   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:58,846   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b
2024-08-19T18:19:58,848   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-08-19T18:19:58,849   copying build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-08-19T18:19:58,851   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-08-19T18:19:58,852   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-08-19T18:19:58,854   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:58,855   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:58,857   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-08-19T18:19:58,859   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:58,860   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:58,862   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-08-19T18:19:58,864   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:58,865   copying build/lib/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:58,867   copying build/lib/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/yi-large-preview
2024-08-19T18:19:58,869   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-08-19T18:19:58,870   copying build/lib/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Together-MoA
2024-08-19T18:19:58,873   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-08-19T18:19:58,874   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/evo-v2-7b
2024-08-19T18:19:58,876   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-08-19T18:19:58,878   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/dbrx-instruct
2024-08-19T18:19:58,881   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-08-19T18:19:58,882   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-08-19T18:19:58,884   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-08-19T18:19:58,885   copying build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-08-19T18:19:58,888   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:58,889   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:58,890   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-08-19T18:19:58,892   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:58,893   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:58,895   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-08-19T18:19:58,897   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-08-19T18:19:58,898   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-08-19T18:19:58,900   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-08-19T18:19:58,901   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4-0125-preview
2024-08-19T18:19:58,904   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-08-19T18:19:58,904   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-08-19T18:19:58,907   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:58,908   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:58,910   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-08-19T18:19:58,912   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-08-19T18:19:58,913   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b-v1.3
2024-08-19T18:19:58,915   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:58,916   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:58,918   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-08-19T18:19:58,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:58,921   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:58,923   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-08-19T18:19:58,925   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-08-19T18:19:58,926   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-65b
2024-08-19T18:19:58,928   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:58,929   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:58,931   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-08-19T18:19:58,933   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-08-19T18:19:58,934   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-large-2402
2024-08-19T18:19:58,936   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:58,937   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:58,939   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-08-19T18:19:58,941   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-08-19T18:19:58,942   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.5
2024-08-19T18:19:58,944   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-08-19T18:19:58,945   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/falcon-40b-instruct
2024-08-19T18:19:58,947   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:58,948   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:58,950   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat
2024-08-19T18:19:58,953   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:58,953   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:58,955   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-08-19T18:19:58,957   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:58,958   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:58,960   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-13b
2024-08-19T18:19:58,962   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:58,963   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:58,965   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-08-19T18:19:58,967   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:58,968   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:58,970   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:58,972   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-08-19T18:19:58,974   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:58,975   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:58,977   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-08-19T18:19:58,979   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:58,980   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:58,982   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/merlinite-7B-AOT
2024-08-19T18:19:58,984   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-08-19T18:19:58,985   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-08-19T18:19:58,987   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:58,988   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:58,991   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-sft
2024-08-19T18:19:58,994   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-08-19T18:19:58,995   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613_verbose
2024-08-19T18:19:58,998   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-08-19T18:19:58,999   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.2
2024-08-19T18:19:59,002   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:59,004   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:59,007   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-dpo
2024-08-19T18:19:59,010   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:59,011   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:59,014   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-08-19T18:19:59,016   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:59,017   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:59,019   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-medium
2024-08-19T18:19:59,022   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-08-19T18:19:59,022   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-08-19T18:19:59,025   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:59,025   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:59,027   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-08-19T18:19:59,029   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-08-19T18:19:59,030   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.3
2024-08-19T18:19:59,032   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-08-19T18:19:59,033   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-1.5-3b
2024-08-19T18:19:59,035   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-08-19T18:19:59,036   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-08-19T18:19:59,039   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:59,040   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:59,042   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-08-19T18:19:59,044   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-08-19T18:19:59,044   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-08-19T18:19:59,047   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:59,048   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:59,050   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-08-19T18:19:59,052   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:59,053   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:59,055   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-llama-33b
2024-08-19T18:19:59,057   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-08-19T18:19:59,058   copying build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-08-19T18:19:59,060   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-08-19T18:19:59,061   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-beta
2024-08-19T18:19:59,063   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:59,064   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:59,066   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b-neft
2024-08-19T18:19:59,068   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:59,069   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:59,071   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baichuan-13b-chat
2024-08-19T18:19:59,073   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:59,074   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:59,075   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:59,077   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-08-19T18:19:59,079   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-08-19T18:19:59,080   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama2-70b
2024-08-19T18:19:59,082   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-08-19T18:19:59,083   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0314
2024-08-19T18:19:59,086   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:59,086   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:59,088   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-08-19T18:19:59,091   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:59,092   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:59,094   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-08-19T18:19:59,096   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-08-19T18:19:59,097   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-33b
2024-08-19T18:19:59,100   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-08-19T18:19:59,101   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-08-19T18:19:59,103   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-08-19T18:19:59,104   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-33b-v1.3
2024-08-19T18:19:59,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:59,107   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:59,109   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha
2024-08-19T18:19:59,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:59,114   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:59,116   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/nous-hermes-13b
2024-08-19T18:19:59,118   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-08-19T18:19:59,119   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2
2024-08-19T18:19:59,122   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-08-19T18:19:59,122   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-opus-20240229
2024-08-19T18:19:59,125   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:59,126   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:59,127   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-33b
2024-08-19T18:19:59,130   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-08-19T18:19:59,131   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-08-19T18:19:59,133   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:59,134   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:59,136   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/chatglm2-6b
2024-08-19T18:19:59,139   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-08-19T18:19:59,140   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude
2024-08-19T18:19:59,142   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude
2024-08-19T18:19:59,144   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:59,145   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:59,147   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-08-19T18:19:59,149   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-08-19T18:19:59,150   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-08-19T18:19:59,152   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-08-19T18:19:59,154   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-08-19T18:19:59,155   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,158   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,159   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,161   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,163   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,165   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,167   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,169   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,170   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,172   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,174   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-08-19T18:19:59,176   running install_egg_info
2024-08-19T18:19:59,209   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/./alpaca_eval-0.6.5-py3.11.egg-info
2024-08-19T18:19:59,223   running install_scripts
2024-08-19T18:19:59,270   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.5.dist-info/WHEEL
2024-08-19T18:19:59,274   creating '/tmp/pip-wheel-3l8y6nvu/alpaca_eval-0.6.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-08-19T18:19:59,277   adding 'alpaca_eval/__init__.py'
2024-08-19T18:19:59,282   adding 'alpaca_eval/analyze.py'
2024-08-19T18:19:59,285   adding 'alpaca_eval/completion_parsers.py'
2024-08-19T18:19:59,288   adding 'alpaca_eval/constants.py'
2024-08-19T18:19:59,293   adding 'alpaca_eval/main.py'
2024-08-19T18:19:59,299   adding 'alpaca_eval/plotting.py'
2024-08-19T18:19:59,303   adding 'alpaca_eval/processors.py'
2024-08-19T18:19:59,305   adding 'alpaca_eval/types.py'
2024-08-19T18:19:59,309   adding 'alpaca_eval/utils.py'
2024-08-19T18:19:59,312   adding 'alpaca_eval/annotators/__init__.py'
2024-08-19T18:19:59,319   adding 'alpaca_eval/annotators/base.py'
2024-08-19T18:19:59,323   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-08-19T18:19:59,326   adding 'alpaca_eval/decoders/__init__.py'
2024-08-19T18:19:59,328   adding 'alpaca_eval/decoders/anthropic.py'
2024-08-19T18:19:59,330   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-08-19T18:19:59,333   adding 'alpaca_eval/decoders/cohere.py'
2024-08-19T18:19:59,335   adding 'alpaca_eval/decoders/google.py'
2024-08-19T18:19:59,337   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-08-19T18:19:59,339   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-08-19T18:19:59,341   adding 'alpaca_eval/decoders/jinachat.py'
2024-08-19T18:19:59,345   adding 'alpaca_eval/decoders/openai.py'
2024-08-19T18:19:59,347   adding 'alpaca_eval/decoders/replicate.py'
2024-08-19T18:19:59,348   adding 'alpaca_eval/decoders/vllm_local.py'
2024-08-19T18:19:59,351   adding 'alpaca_eval/evaluators_configs/README.md'
2024-08-19T18:19:59,353   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-08-19T18:19:59,354   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-08-19T18:19:59,356   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-08-19T18:19:59,357   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-08-19T18:19:59,358   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-08-19T18:19:59,359   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-08-19T18:19:59,361   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-08-19T18:19:59,362   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-08-19T18:19:59,363   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-08-19T18:19:59,365   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-08-19T18:19:59,366   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-08-19T18:19:59,368   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-08-19T18:19:59,369   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-08-19T18:19:59,370   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-08-19T18:19:59,372   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt'
2024-08-19T18:19:59,373   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml'
2024-08-19T18:19:59,375   adding 'alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt'
2024-08-19T18:19:59,376   adding 'alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml'
2024-08-19T18:19:59,378   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-08-19T18:19:59,379   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-08-19T18:19:59,381   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-08-19T18:19:59,382   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-08-19T18:19:59,383   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-08-19T18:19:59,385   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-08-19T18:19:59,387   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-08-19T18:19:59,388   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-08-19T18:19:59,390   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-08-19T18:19:59,391   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-08-19T18:19:59,392   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-08-19T18:19:59,394   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-08-19T18:19:59,396   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-08-19T18:19:59,398   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-08-19T18:19:59,399   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-08-19T18:19:59,401   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-08-19T18:19:59,402   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-08-19T18:19:59,404   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-08-19T18:19:59,405   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-08-19T18:19:59,407   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-08-19T18:19:59,408   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-08-19T18:19:59,410   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-08-19T18:19:59,411   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-08-19T18:19:59,412   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-08-19T18:19:59,414   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-08-19T18:19:59,415   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-08-19T18:19:59,417   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-08-19T18:19:59,418   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-08-19T18:19:59,420   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-08-19T18:19:59,421   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-08-19T18:19:59,423   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-08-19T18:19:59,424   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-08-19T18:19:59,426   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-08-19T18:19:59,427   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-08-19T18:19:59,429   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-08-19T18:19:59,430   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-08-19T18:19:59,432   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-08-19T18:19:59,433   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-08-19T18:19:59,435   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-08-19T18:19:59,436   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-08-19T18:19:59,438   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-08-19T18:19:59,439   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-08-19T18:19:59,441   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-08-19T18:19:59,442   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-08-19T18:19:59,444   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-08-19T18:19:59,446   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-08-19T18:19:59,447   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-08-19T18:19:59,448   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-08-19T18:19:59,450   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-08-19T18:19:59,452   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-08-19T18:19:59,453   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-08-19T18:19:59,454   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-08-19T18:19:59,456   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-08-19T18:19:59,458   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-08-19T18:19:59,459   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-08-19T18:19:59,461   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-08-19T18:19:59,463   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml'
2024-08-19T18:19:59,465   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-08-19T18:19:59,467   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-08-19T18:19:59,468   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-08-19T18:19:59,470   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-08-19T18:19:59,471   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-08-19T18:19:59,472   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-08-19T18:19:59,474   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-08-19T18:19:59,475   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-08-19T18:19:59,479   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-08-19T18:19:59,481   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-08-19T18:19:59,483   adding 'alpaca_eval/metrics/__init__.py'
2024-08-19T18:19:59,485   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-08-19T18:19:59,487   adding 'alpaca_eval/metrics/helpers.py'
2024-08-19T18:19:59,488   adding 'alpaca_eval/metrics/winrate.py'
2024-08-19T18:19:59,494   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-08-19T18:19:59,495   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-08-19T18:19:59,496   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-08-19T18:19:59,497   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-08-19T18:19:59,499   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-08-19T18:19:59,500   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-08-19T18:19:59,502   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-08-19T18:19:59,503   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-08-19T18:19:59,505   adding 'alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml'
2024-08-19T18:19:59,506   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml'
2024-08-19T18:19:59,507   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt'
2024-08-19T18:19:59,509   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml'
2024-08-19T18:19:59,510   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt'
2024-08-19T18:19:59,512   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml'
2024-08-19T18:19:59,513   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt'
2024-08-19T18:19:59,515   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml'
2024-08-19T18:19:59,516   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt'
2024-08-19T18:19:59,517   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml'
2024-08-19T18:19:59,518   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt'
2024-08-19T18:19:59,520   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml'
2024-08-19T18:19:59,521   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt'
2024-08-19T18:19:59,523   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml'
2024-08-19T18:19:59,524   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt'
2024-08-19T18:19:59,526   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml'
2024-08-19T18:19:59,527   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt'
2024-08-19T18:19:59,529   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml'
2024-08-19T18:19:59,530   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt'
2024-08-19T18:19:59,531   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml'
2024-08-19T18:19:59,533   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt'
2024-08-19T18:19:59,534   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-08-19T18:19:59,535   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-08-19T18:19:59,537   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml'
2024-08-19T18:19:59,538   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt'
2024-08-19T18:19:59,540   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml'
2024-08-19T18:19:59,541   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml'
2024-08-19T18:19:59,543   adding 'alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml'
2024-08-19T18:19:59,545   adding 'alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml'
2024-08-19T18:19:59,546   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml'
2024-08-19T18:19:59,548   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml'
2024-08-19T18:19:59,549   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml'
2024-08-19T18:19:59,551   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml'
2024-08-19T18:19:59,552   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt'
2024-08-19T18:19:59,554   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-08-19T18:19:59,555   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml'
2024-08-19T18:19:59,557   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-08-19T18:19:59,558   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-08-19T18:19:59,559   adding 'alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml'
2024-08-19T18:19:59,561   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-08-19T18:19:59,562   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-08-19T18:19:59,564   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-08-19T18:19:59,565   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-08-19T18:19:59,566   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-08-19T18:19:59,567   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-08-19T18:19:59,569   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml'
2024-08-19T18:19:59,570   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt'
2024-08-19T18:19:59,572   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml'
2024-08-19T18:19:59,573   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt'
2024-08-19T18:19:59,575   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-08-19T18:19:59,576   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-08-19T18:19:59,578   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-08-19T18:19:59,579   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-08-19T18:19:59,581   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-08-19T18:19:59,582   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-08-19T18:19:59,584   adding 'alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml'
2024-08-19T18:19:59,585   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml'
2024-08-19T18:19:59,587   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt'
2024-08-19T18:19:59,588   adding 'alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml'
2024-08-19T18:19:59,590   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-08-19T18:19:59,591   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-08-19T18:19:59,593   adding 'alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml'
2024-08-19T18:19:59,594   adding 'alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml'
2024-08-19T18:19:59,596   adding 'alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt'
2024-08-19T18:19:59,597   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml'
2024-08-19T18:19:59,598   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt'
2024-08-19T18:19:59,600   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml'
2024-08-19T18:19:59,601   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt'
2024-08-19T18:19:59,602   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml'
2024-08-19T18:19:59,603   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt'
2024-08-19T18:19:59,605   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml'
2024-08-19T18:19:59,606   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt'
2024-08-19T18:19:59,608   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml'
2024-08-19T18:19:59,609   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-08-19T18:19:59,610   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-08-19T18:19:59,612   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-08-19T18:19:59,613   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-08-19T18:19:59,615   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-08-19T18:19:59,616   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-08-19T18:19:59,618   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-08-19T18:19:59,619   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-08-19T18:19:59,620   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-08-19T18:19:59,622   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-08-19T18:19:59,623   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml'
2024-08-19T18:19:59,625   adding 'alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml'
2024-08-19T18:19:59,626   adding 'alpaca_eval/models_configs/Storm-7B/configs.yaml'
2024-08-19T18:19:59,627   adding 'alpaca_eval/models_configs/Storm-7B/prompt.txt'
2024-08-19T18:19:59,629   adding 'alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml'
2024-08-19T18:19:59,631   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-08-19T18:19:59,632   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-08-19T18:19:59,634   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-08-19T18:19:59,635   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-08-19T18:19:59,636   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-08-19T18:19:59,638   adding 'alpaca_eval/models_configs/Together-MoA/configs.yaml'
2024-08-19T18:19:59,640   adding 'alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml'
2024-08-19T18:19:59,642   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-08-19T18:19:59,643   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-08-19T18:19:59,644   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-08-19T18:19:59,646   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-08-19T18:19:59,648   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-08-19T18:19:59,649   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-08-19T18:19:59,650   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-08-19T18:19:59,652   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-08-19T18:19:59,653   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-08-19T18:19:59,654   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-08-19T18:19:59,656   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml'
2024-08-19T18:19:59,658   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml'
2024-08-19T18:19:59,659   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt'
2024-08-19T18:19:59,661   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-08-19T18:19:59,662   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-08-19T18:19:59,663   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-08-19T18:19:59,665   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-08-19T18:19:59,666   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-08-19T18:19:59,667   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-08-19T18:19:59,668   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-08-19T18:19:59,670   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-08-19T18:19:59,671   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-08-19T18:19:59,673   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-08-19T18:19:59,675   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-08-19T18:19:59,676   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-08-19T18:19:59,677   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-08-19T18:19:59,679   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-08-19T18:19:59,680   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-08-19T18:19:59,681   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-08-19T18:19:59,683   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-08-19T18:19:59,685   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-08-19T18:19:59,686   adding 'alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml'
2024-08-19T18:19:59,688   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-08-19T18:19:59,689   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-08-19T18:19:59,691   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-08-19T18:19:59,692   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-08-19T18:19:59,693   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-08-19T18:19:59,694   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-08-19T18:19:59,696   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-08-19T18:19:59,697   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-08-19T18:19:59,699   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-08-19T18:19:59,700   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-08-19T18:19:59,702   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-08-19T18:19:59,703   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-08-19T18:19:59,704   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml'
2024-08-19T18:19:59,705   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt'
2024-08-19T18:19:59,707   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-08-19T18:19:59,709   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-08-19T18:19:59,710   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-08-19T18:19:59,711   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-08-19T18:19:59,713   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-08-19T18:19:59,715   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-08-19T18:19:59,716   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-08-19T18:19:59,718   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-08-19T18:19:59,719   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-08-19T18:19:59,720   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-08-19T18:19:59,722   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-08-19T18:19:59,723   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-08-19T18:19:59,725   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-08-19T18:19:59,726   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-08-19T18:19:59,728   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-08-19T18:19:59,729   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-08-19T18:19:59,731   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-08-19T18:19:59,732   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-08-19T18:19:59,734   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-08-19T18:19:59,735   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-08-19T18:19:59,737   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml'
2024-08-19T18:19:59,738   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt'
2024-08-19T18:19:59,739   adding 'alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml'
2024-08-19T18:19:59,741   adding 'alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml'
2024-08-19T18:19:59,742   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-08-19T18:19:59,744   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-08-19T18:19:59,746   adding 'alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml'
2024-08-19T18:19:59,747   adding 'alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt'
2024-08-19T18:19:59,748   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml'
2024-08-19T18:19:59,750   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt'
2024-08-19T18:19:59,751   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-08-19T18:19:59,752   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-08-19T18:19:59,754   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-08-19T18:19:59,755   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-08-19T18:19:59,757   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-08-19T18:19:59,759   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-08-19T18:19:59,760   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-08-19T18:19:59,762   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-08-19T18:19:59,763   adding 'alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml'
2024-08-19T18:19:59,765   adding 'alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml'
2024-08-19T18:19:59,766   adding 'alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml'
2024-08-19T18:19:59,768   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-08-19T18:19:59,770   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-08-19T18:19:59,771   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-08-19T18:19:59,772   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-08-19T18:19:59,774   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-08-19T18:19:59,776   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-08-19T18:19:59,777   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-08-19T18:19:59,779   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-08-19T18:19:59,780   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-08-19T18:19:59,781   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-08-19T18:19:59,783   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-08-19T18:19:59,784   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-08-19T18:19:59,786   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-08-19T18:19:59,787   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-08-19T18:19:59,789   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-08-19T18:19:59,790   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-08-19T18:19:59,792   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-08-19T18:19:59,793   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-08-19T18:19:59,795   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-08-19T18:19:59,796   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-08-19T18:19:59,798   adding 'alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml'
2024-08-19T18:19:59,799   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-08-19T18:19:59,800   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-08-19T18:19:59,802   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-08-19T18:19:59,803   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml'
2024-08-19T18:19:59,805   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-08-19T18:19:59,806   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-08-19T18:19:59,808   adding 'alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml'
2024-08-19T18:19:59,810   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-08-19T18:19:59,811   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-08-19T18:19:59,813   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-08-19T18:19:59,815   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-08-19T18:19:59,816   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-08-19T18:19:59,818   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-08-19T18:19:59,819   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-08-19T18:19:59,820   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-08-19T18:19:59,822   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-08-19T18:19:59,823   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml'
2024-08-19T18:19:59,825   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt'
2024-08-19T18:19:59,826   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-08-19T18:19:59,828   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-08-19T18:19:59,829   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-08-19T18:19:59,831   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-08-19T18:19:59,832   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-08-19T18:19:59,834   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-08-19T18:19:59,835   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-08-19T18:19:59,836   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-08-19T18:19:59,838   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-08-19T18:19:59,839   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-08-19T18:19:59,841   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-08-19T18:19:59,842   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-08-19T18:19:59,844   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-08-19T18:19:59,846   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-08-19T18:19:59,847   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-08-19T18:19:59,849   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-08-19T18:19:59,850   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-08-19T18:19:59,851   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-08-19T18:19:59,853   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-08-19T18:19:59,854   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-08-19T18:19:59,855   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-08-19T18:19:59,857   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-08-19T18:19:59,858   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-08-19T18:19:59,859   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-08-19T18:19:59,861   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-08-19T18:19:59,862   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-08-19T18:19:59,863   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-08-19T18:19:59,865   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-08-19T18:19:59,866   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-08-19T18:19:59,867   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-08-19T18:19:59,868   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-08-19T18:19:59,870   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-08-19T18:19:59,872   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-08-19T18:19:59,873   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-08-19T18:19:59,875   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-08-19T18:19:59,876   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-08-19T18:19:59,878   adding 'alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml'
2024-08-19T18:19:59,880   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-08-19T18:19:59,882   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-08-19T18:19:59,883   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-08-19T18:19:59,884   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-08-19T18:19:59,886   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-08-19T18:19:59,887   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-08-19T18:19:59,888   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-08-19T18:19:59,890   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-08-19T18:19:59,891   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-08-19T18:19:59,893   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-08-19T18:19:59,894   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-08-19T18:19:59,895   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-08-19T18:19:59,897   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-08-19T18:19:59,898   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-08-19T18:19:59,900   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-08-19T18:19:59,902   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-08-19T18:19:59,903   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-08-19T18:19:59,905   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-08-19T18:19:59,906   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-08-19T18:19:59,907   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-08-19T18:19:59,909   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml'
2024-08-19T18:19:59,911   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-08-19T18:19:59,912   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-08-19T18:19:59,914   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml'
2024-08-19T18:19:59,915   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-08-19T18:19:59,917   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml'
2024-08-19T18:19:59,918   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-08-19T18:19:59,919   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-08-19T18:19:59,921   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-08-19T18:19:59,922   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-08-19T18:19:59,924   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-08-19T18:19:59,925   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-08-19T18:19:59,926   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-08-19T18:19:59,927   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-08-19T18:19:59,929   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-08-19T18:19:59,930   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-08-19T18:19:59,932   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-08-19T18:19:59,934   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml'
2024-08-19T18:19:59,935   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-08-19T18:19:59,937   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-08-19T18:19:59,938   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-08-19T18:19:59,940   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-08-19T18:19:59,942   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-08-19T18:19:59,943   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-08-19T18:19:59,944   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-08-19T18:19:59,946   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-08-19T18:19:59,948   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-08-19T18:19:59,950   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-08-19T18:19:59,951   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-08-19T18:19:59,953   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-08-19T18:19:59,954   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-08-19T18:19:59,956   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-08-19T18:19:59,957   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-08-19T18:19:59,958   adding 'alpaca_eval/models_configs/yi-large-preview/configs.yaml'
2024-08-19T18:19:59,959   adding 'alpaca_eval/models_configs/yi-large-preview/prompt.txt'
2024-08-19T18:19:59,961   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-08-19T18:19:59,962   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-08-19T18:19:59,964   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml'
2024-08-19T18:19:59,965   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt'
2024-08-19T18:19:59,966   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-08-19T18:19:59,968   adding 'alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml'
2024-08-19T18:19:59,971   adding 'alpaca_eval-0.6.5.dist-info/LICENSE'
2024-08-19T18:19:59,984   adding 'alpaca_eval-0.6.5.dist-info/METADATA'
2024-08-19T18:19:59,986   adding 'alpaca_eval-0.6.5.dist-info/WHEEL'
2024-08-19T18:19:59,986   adding 'alpaca_eval-0.6.5.dist-info/entry_points.txt'
2024-08-19T18:19:59,987   adding 'alpaca_eval-0.6.5.dist-info/top_level.txt'
2024-08-19T18:19:59,995   adding 'alpaca_eval-0.6.5.dist-info/RECORD'
2024-08-19T18:20:00,004   removing build/bdist.linux-armv7l/wheel
2024-08-19T18:20:00,312   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-08-19T18:20:00,319   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.5-py3-none-any.whl size=343608 sha256=2c2385e6c20ff2cd42f344e3dae30f4980feae549a01546ef4cda76c0397995e
2024-08-19T18:20:00,320   Stored in directory: /tmp/pip-ephem-wheel-cache-pudyoq7s/wheels/1e/19/c4/70b506424561f403f05209da910531b012324668ab649e3bac
2024-08-19T18:20:00,361 Successfully built alpaca-eval
2024-08-19T18:20:00,376 Removed build tracker: '/tmp/pip-build-tracker-hn7a_tix'