2024-07-18T19:10:20,932 Created temporary directory: /tmp/pip-build-tracker-9w0mf9_t
2024-07-18T19:10:20,933 Initialized build tracking at /tmp/pip-build-tracker-9w0mf9_t
2024-07-18T19:10:20,934 Created build tracker: /tmp/pip-build-tracker-9w0mf9_t
2024-07-18T19:10:20,934 Entered build tracker: /tmp/pip-build-tracker-9w0mf9_t
2024-07-18T19:10:20,935 Created temporary directory: /tmp/pip-wheel-n4pxr8lt
2024-07-18T19:10:20,938 Created temporary directory: /tmp/pip-ephem-wheel-cache-0dzsm0e8
2024-07-18T19:10:20,961 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-07-18T19:10:20,964 2 location(s) to search for versions of alpaca-eval:
2024-07-18T19:10:20,964 * https://pypi.org/simple/alpaca-eval/
2024-07-18T19:10:20,964 * https://www.piwheels.org/simple/alpaca-eval/
2024-07-18T19:10:20,965 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-07-18T19:10:20,966 Getting page https://pypi.org/simple/alpaca-eval/
2024-07-18T19:10:20,968 Found index url https://pypi.org/simple/
2024-07-18T19:10:21,189 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-07-18T19:10:21,202   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,203   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-07-18T19:10:21,204   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,205   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-07-18T19:10:21,206   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,207   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-07-18T19:10:21,208   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,209   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-07-18T19:10:21,210   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,211   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-07-18T19:10:21,211   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,212   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-07-18T19:10:21,213   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,214   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-07-18T19:10:21,215   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,216   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-07-18T19:10:21,216   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,217   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-07-18T19:10:21,218   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,219   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-07-18T19:10:21,220   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,221   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-07-18T19:10:21,222   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,223   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-07-18T19:10:21,223   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,224   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-07-18T19:10:21,225   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,226   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-07-18T19:10:21,227   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,228   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-07-18T19:10:21,229   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,229   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-07-18T19:10:21,230   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,231   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-07-18T19:10:21,232   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,233   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-07-18T19:10:21,234   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,235   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-07-18T19:10:21,235   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,236   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-07-18T19:10:21,237   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,238   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-07-18T19:10:21,239   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,240   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-07-18T19:10:21,241   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,241   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-07-18T19:10:21,242   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,243   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-07-18T19:10:21,243   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,244   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-07-18T19:10:21,245   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,246   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-07-18T19:10:21,247   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,248   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-07-18T19:10:21,248   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,249   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-07-18T19:10:21,250   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,251   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-07-18T19:10:21,252   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,253   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-07-18T19:10:21,253   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,254   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-07-18T19:10:21,255   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,256   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-07-18T19:10:21,257   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ea/4d/9b44ccd56c4f7579c9e4b6886096daa1ad6d75019e4a2b03f0b94476a623/alpaca_eval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,258   Found link https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.2
2024-07-18T19:10:21,258   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/94/e2/86131f32b7f7d5b1b400e08393d8b3c490a893e9bb8139313cb93c23369d/alpaca_eval-0.6.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,259   Found link https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.3
2024-07-18T19:10:21,260   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e1/7f/7c7ab03e465637ee08158c9c4dfeb914b7e6549f19f996ae1cd3d19d7a07/alpaca_eval-0.6.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,261   Found link https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.4
2024-07-18T19:10:21,262 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-07-18T19:10:21,263 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-07-18T19:10:21,264 Found index url https://www.piwheels.org/simple/
2024-07-18T19:10:21,439 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-07-18T19:10:21,448   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.3-py3-none-any.whl#sha256=fe5ebfbbbbfd8d774873f20b778cf9b914febe7f116e1a82ac86186a804da4f5 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,449   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.2-py3-none-any.whl#sha256=f93aa4f39f46ac56b280e9c6249815ad57fb21f6f676abcf76640e872d4a1832 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,449   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.1-py3-none-any.whl#sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,450   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,450   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,451   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,451   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,452   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,452   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,453   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,453   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,454   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,454   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,455   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,456   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,456   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,457   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,457   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,458   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,458   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,459   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,460   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,460   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,461   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,461   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,462   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,462   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-07-18T19:10:21,463   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,464   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,465   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-07-18T19:10:21,465 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-07-18T19:10:21,466 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-07-18T19:10:21,490 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-07-18T19:10:21,510 Collecting alpaca-eval==0.6.4
2024-07-18T19:10:21,512   Created temporary directory: /tmp/pip-unpack-qjb2o8dx
2024-07-18T19:10:21,722   Downloading alpaca_eval-0.6.4.tar.gz (380 kB)
2024-07-18T19:10:22,746   Added alpaca-eval==0.6.4 from https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz to build tracker '/tmp/pip-build-tracker-9w0mf9_t'
2024-07-18T19:10:22,748   Running setup.py (path:/tmp/pip-wheel-n4pxr8lt/alpaca-eval_81d5584da14e42728bbd133b3f4e89a2/setup.py) egg_info for package alpaca-eval
2024-07-18T19:10:22,749   Created temporary directory: /tmp/pip-pip-egg-info-38t7_fyv
2024-07-18T19:10:22,749   Preparing metadata (setup.py): started
2024-07-18T19:10:22,751   Running command python setup.py egg_info
2024-07-18T19:10:23,851   running egg_info
2024-07-18T19:10:23,852   creating /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info
2024-07-18T19:10:23,878   writing /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/PKG-INFO
2024-07-18T19:10:23,899   writing dependency_links to /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/dependency_links.txt
2024-07-18T19:10:23,901   writing entry points to /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/entry_points.txt
2024-07-18T19:10:23,911   writing requirements to /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/requires.txt
2024-07-18T19:10:23,912   writing top-level names to /tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/top_level.txt
2024-07-18T19:10:23,914   writing manifest file '/tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/SOURCES.txt'
2024-07-18T19:10:24,001   reading manifest file '/tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/SOURCES.txt'
2024-07-18T19:10:24,003   reading manifest template 'MANIFEST.in'
2024-07-18T19:10:24,292   adding license file 'LICENSE'
2024-07-18T19:10:24,307   writing manifest file '/tmp/pip-pip-egg-info-38t7_fyv/alpaca_eval.egg-info/SOURCES.txt'
2024-07-18T19:10:24,427   Preparing metadata (setup.py): finished with status 'done'
2024-07-18T19:10:24,436   Source in /tmp/pip-wheel-n4pxr8lt/alpaca-eval_81d5584da14e42728bbd133b3f4e89a2 has version 0.6.4, which satisfies requirement alpaca-eval==0.6.4 from https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz
2024-07-18T19:10:24,437   Removed alpaca-eval==0.6.4 from https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz from build tracker '/tmp/pip-build-tracker-9w0mf9_t'
2024-07-18T19:10:24,452 Created temporary directory: /tmp/pip-unpack-u8351dhp
2024-07-18T19:10:24,453 Created temporary directory: /tmp/pip-unpack-eawyzc8n
2024-07-18T19:10:24,603 Building wheels for collected packages: alpaca-eval
2024-07-18T19:10:24,607   Created temporary directory: /tmp/pip-wheel-jaiswmx9
2024-07-18T19:10:24,608   Building wheel for alpaca-eval (setup.py): started
2024-07-18T19:10:24,609   Destination directory: /tmp/pip-wheel-jaiswmx9
2024-07-18T19:10:24,609   Running command python setup.py bdist_wheel
2024-07-18T19:10:25,689   running bdist_wheel
2024-07-18T19:10:25,789   running build
2024-07-18T19:10:25,790   running build_py
2024-07-18T19:10:25,818   creating build
2024-07-18T19:10:25,818   creating build/lib
2024-07-18T19:10:25,819   creating build/lib/alpaca_eval
2024-07-18T19:10:25,821   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,823   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,826   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,828   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,830   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,833   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,835   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,838   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,840   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-07-18T19:10:25,842   creating build/lib/alpaca_eval/metrics
2024-07-18T19:10:25,843   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-07-18T19:10:25,846   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-07-18T19:10:25,848   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-07-18T19:10:25,850   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-07-18T19:10:25,853   creating build/lib/alpaca_eval/annotators
2024-07-18T19:10:25,854   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-07-18T19:10:25,857   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-07-18T19:10:25,859   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-07-18T19:10:25,863   creating build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,864   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,867   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,869   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,871   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,873   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,876   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,878   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,880   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,883   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,886   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,888   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-07-18T19:10:25,890   running egg_info
2024-07-18T19:10:25,952   writing src/alpaca_eval.egg-info/PKG-INFO
2024-07-18T19:10:25,976   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-07-18T19:10:25,978   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-07-18T19:10:25,988   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-07-18T19:10:25,990   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-07-18T19:10:26,023   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-07-18T19:10:26,034   reading manifest template 'MANIFEST.in'
2024-07-18T19:10:26,267   adding license file 'LICENSE'
2024-07-18T19:10:26,287   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-07-18T19:10:26,291   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-07-18T19:10:26,292   !!

2024-07-18T19:10:26,293           ********************************************************************************
2024-07-18T19:10:26,293           ############################
2024-07-18T19:10:26,294           # Package would be ignored #
2024-07-18T19:10:26,294           ############################
2024-07-18T19:10:26,295           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-07-18T19:10:26,295           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,296           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,297           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-07-18T19:10:26,297           to the `packages` configuration field.

2024-07-18T19:10:26,298           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,298           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,299           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,300           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,301           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,302           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-07-18T19:10:26,303           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-07-18T19:10:26,303           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,304           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,305           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,306           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,308           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,310           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,310                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,311                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,311                 directory, all directories are treated like packages.
2024-07-18T19:10:26,312           ********************************************************************************

2024-07-18T19:10:26,313   !!
2024-07-18T19:10:26,313     check.warn(importable)
2024-07-18T19:10:26,314   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-07-18T19:10:26,315   !!

2024-07-18T19:10:26,316           ********************************************************************************
2024-07-18T19:10:26,316           ############################
2024-07-18T19:10:26,317           # Package would be ignored #
2024-07-18T19:10:26,317           ############################
2024-07-18T19:10:26,318           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-07-18T19:10:26,319           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,320           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,320           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-07-18T19:10:26,321           to the `packages` configuration field.

2024-07-18T19:10:26,322           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,322           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,323           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,323           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,324           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,325           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-07-18T19:10:26,326           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-07-18T19:10:26,326           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,326           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,327           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,328           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,328           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,330           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,330                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,330                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,331                 directory, all directories are treated like packages.
2024-07-18T19:10:26,332           ********************************************************************************

2024-07-18T19:10:26,333   !!
2024-07-18T19:10:26,334     check.warn(importable)
2024-07-18T19:10:26,334   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-07-18T19:10:26,335   !!

2024-07-18T19:10:26,336           ********************************************************************************
2024-07-18T19:10:26,336           ############################
2024-07-18T19:10:26,337           # Package would be ignored #
2024-07-18T19:10:26,338           ############################
2024-07-18T19:10:26,338           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-07-18T19:10:26,339           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,340           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,340           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-07-18T19:10:26,341           to the `packages` configuration field.

2024-07-18T19:10:26,342           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,342           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,343           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,344           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,345           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,346           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-07-18T19:10:26,347           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-07-18T19:10:26,347           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,348           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,349           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,349           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,350           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,351           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,351                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,352                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,352                 directory, all directories are treated like packages.
2024-07-18T19:10:26,353           ********************************************************************************

2024-07-18T19:10:26,353   !!
2024-07-18T19:10:26,354     check.warn(importable)
2024-07-18T19:10:26,354   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-07-18T19:10:26,355   !!

2024-07-18T19:10:26,355           ********************************************************************************
2024-07-18T19:10:26,356           ############################
2024-07-18T19:10:26,356           # Package would be ignored #
2024-07-18T19:10:26,357           ############################
2024-07-18T19:10:26,357           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-07-18T19:10:26,358           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,359           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,359           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-07-18T19:10:26,360           to the `packages` configuration field.

2024-07-18T19:10:26,361           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,362           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,362           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,363           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,364           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,366           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-07-18T19:10:26,366           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-07-18T19:10:26,367           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,367           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,368           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,369           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,370           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,372           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,372                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,373                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,373                 directory, all directories are treated like packages.
2024-07-18T19:10:26,374           ********************************************************************************

2024-07-18T19:10:26,375   !!
2024-07-18T19:10:26,376     check.warn(importable)
2024-07-18T19:10:26,377   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,377   !!

2024-07-18T19:10:26,378           ********************************************************************************
2024-07-18T19:10:26,378           ############################
2024-07-18T19:10:26,378           # Package would be ignored #
2024-07-18T19:10:26,379           ############################
2024-07-18T19:10:26,379           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-07-18T19:10:26,379           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,380           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,380           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-07-18T19:10:26,381           to the `packages` configuration field.

2024-07-18T19:10:26,382           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,382           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,382           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,383           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,384           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,385           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-07-18T19:10:26,385           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-07-18T19:10:26,386           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,387           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,387           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,389           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,390           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,392           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,392                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,393                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,393                 directory, all directories are treated like packages.
2024-07-18T19:10:26,394           ********************************************************************************

2024-07-18T19:10:26,395   !!
2024-07-18T19:10:26,396     check.warn(importable)
2024-07-18T19:10:26,396   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-07-18T19:10:26,396   !!

2024-07-18T19:10:26,397           ********************************************************************************
2024-07-18T19:10:26,398           ############################
2024-07-18T19:10:26,398           # Package would be ignored #
2024-07-18T19:10:26,399           ############################
2024-07-18T19:10:26,399           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-07-18T19:10:26,400           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,401           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,402           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-07-18T19:10:26,402           to the `packages` configuration field.

2024-07-18T19:10:26,404           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,404           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,404           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,405           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,406           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,407           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-07-18T19:10:26,407           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-07-18T19:10:26,407           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,408           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,408           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,409           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,410           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,411           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,411                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,412                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,412                 directory, all directories are treated like packages.
2024-07-18T19:10:26,413           ********************************************************************************

2024-07-18T19:10:26,414   !!
2024-07-18T19:10:26,414     check.warn(importable)
2024-07-18T19:10:26,415   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-07-18T19:10:26,415   !!

2024-07-18T19:10:26,416           ********************************************************************************
2024-07-18T19:10:26,417           ############################
2024-07-18T19:10:26,417           # Package would be ignored #
2024-07-18T19:10:26,418           ############################
2024-07-18T19:10:26,418           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-07-18T19:10:26,419           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,420           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,421           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-07-18T19:10:26,421           to the `packages` configuration field.

2024-07-18T19:10:26,422           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,423           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,423           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,424           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,426           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-07-18T19:10:26,426           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-07-18T19:10:26,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,428           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,428           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,430           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,430           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,432           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,432                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,432                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,433                 directory, all directories are treated like packages.
2024-07-18T19:10:26,433           ********************************************************************************

2024-07-18T19:10:26,434   !!
2024-07-18T19:10:26,434     check.warn(importable)
2024-07-18T19:10:26,434   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-07-18T19:10:26,435   !!

2024-07-18T19:10:26,436           ********************************************************************************
2024-07-18T19:10:26,436           ############################
2024-07-18T19:10:26,436           # Package would be ignored #
2024-07-18T19:10:26,437           ############################
2024-07-18T19:10:26,437           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-07-18T19:10:26,438           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,438           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,439           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-07-18T19:10:26,439           to the `packages` configuration field.

2024-07-18T19:10:26,440           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,441           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,441           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,443           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,444           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,445           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-07-18T19:10:26,446           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-07-18T19:10:26,446           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,447           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,447           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,448           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,449           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,451           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,451                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,452                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,452                 directory, all directories are treated like packages.
2024-07-18T19:10:26,453           ********************************************************************************

2024-07-18T19:10:26,454   !!
2024-07-18T19:10:26,455     check.warn(importable)
2024-07-18T19:10:26,455   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-07-18T19:10:26,456   !!

2024-07-18T19:10:26,457           ********************************************************************************
2024-07-18T19:10:26,457           ############################
2024-07-18T19:10:26,458           # Package would be ignored #
2024-07-18T19:10:26,459           ############################
2024-07-18T19:10:26,459           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-07-18T19:10:26,459           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,460           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,461           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-07-18T19:10:26,461           to the `packages` configuration field.

2024-07-18T19:10:26,462           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,463           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,463           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,464           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,465           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,465           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-07-18T19:10:26,466           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-07-18T19:10:26,466           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,467           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,467           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,468           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,469           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,471           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,472                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,472                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,473                 directory, all directories are treated like packages.
2024-07-18T19:10:26,473           ********************************************************************************

2024-07-18T19:10:26,475   !!
2024-07-18T19:10:26,475     check.warn(importable)
2024-07-18T19:10:26,476   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is absent from the `packages` configuration.
2024-07-18T19:10:26,477   !!

2024-07-18T19:10:26,478           ********************************************************************************
2024-07-18T19:10:26,478           ############################
2024-07-18T19:10:26,479           # Package would be ignored #
2024-07-18T19:10:26,479           ############################
2024-07-18T19:10:26,480           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' as an importable package[^1],
2024-07-18T19:10:26,480           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,481           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,482           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is explicitly added
2024-07-18T19:10:26,482           to the `packages` configuration field.

2024-07-18T19:10:26,483           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,484           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,484           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,486           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,487           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,487           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' to be distributed and are
2024-07-18T19:10:26,488           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' via
2024-07-18T19:10:26,488           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,489           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,489           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,490           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,491           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,492           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,492                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,493                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,493                 directory, all directories are treated like packages.
2024-07-18T19:10:26,493           ********************************************************************************

2024-07-18T19:10:26,494   !!
2024-07-18T19:10:26,495     check.warn(importable)
2024-07-18T19:10:26,495   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-07-18T19:10:26,496   !!

2024-07-18T19:10:26,497           ********************************************************************************
2024-07-18T19:10:26,497           ############################
2024-07-18T19:10:26,498           # Package would be ignored #
2024-07-18T19:10:26,499           ############################
2024-07-18T19:10:26,499           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-07-18T19:10:26,500           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,501           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,502           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-07-18T19:10:26,502           to the `packages` configuration field.

2024-07-18T19:10:26,503           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,504           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,505           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,506           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,506           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,507           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-07-18T19:10:26,508           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-07-18T19:10:26,508           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,509           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,510           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,511           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,512           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,514           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,514                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,515                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,515                 directory, all directories are treated like packages.
2024-07-18T19:10:26,516           ********************************************************************************

2024-07-18T19:10:26,517   !!
2024-07-18T19:10:26,517     check.warn(importable)
2024-07-18T19:10:26,517   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,518   !!

2024-07-18T19:10:26,518           ********************************************************************************
2024-07-18T19:10:26,519           ############################
2024-07-18T19:10:26,519           # Package would be ignored #
2024-07-18T19:10:26,520           ############################
2024-07-18T19:10:26,520           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-07-18T19:10:26,520           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,522           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-07-18T19:10:26,522           to the `packages` configuration field.

2024-07-18T19:10:26,523           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,524           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,525           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,526           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,527           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-07-18T19:10:26,528           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-07-18T19:10:26,528           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,529           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,529           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,530           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,531           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,533           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,533                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,534                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,534                 directory, all directories are treated like packages.
2024-07-18T19:10:26,535           ********************************************************************************

2024-07-18T19:10:26,536   !!
2024-07-18T19:10:26,536     check.warn(importable)
2024-07-18T19:10:26,537   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,538   !!

2024-07-18T19:10:26,539           ********************************************************************************
2024-07-18T19:10:26,539           ############################
2024-07-18T19:10:26,540           # Package would be ignored #
2024-07-18T19:10:26,541           ############################
2024-07-18T19:10:26,541           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-07-18T19:10:26,542           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,543           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,543           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-07-18T19:10:26,544           to the `packages` configuration field.

2024-07-18T19:10:26,545           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,545           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,546           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,546           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,547           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,548           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-07-18T19:10:26,548           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-07-18T19:10:26,549           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,549           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,549           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,550           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,551           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,552           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,553                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,553                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,554                 directory, all directories are treated like packages.
2024-07-18T19:10:26,554           ********************************************************************************

2024-07-18T19:10:26,555   !!
2024-07-18T19:10:26,556     check.warn(importable)
2024-07-18T19:10:26,556   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-07-18T19:10:26,557   !!

2024-07-18T19:10:26,558           ********************************************************************************
2024-07-18T19:10:26,558           ############################
2024-07-18T19:10:26,559           # Package would be ignored #
2024-07-18T19:10:26,560           ############################
2024-07-18T19:10:26,560           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-07-18T19:10:26,561           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,562           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,562           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-07-18T19:10:26,563           to the `packages` configuration field.

2024-07-18T19:10:26,564           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,564           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,565           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,566           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,567           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,568           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-07-18T19:10:26,569           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-07-18T19:10:26,569           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,570           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,571           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,571           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,572           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,573           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,574                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,574                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,575                 directory, all directories are treated like packages.
2024-07-18T19:10:26,575           ********************************************************************************

2024-07-18T19:10:26,576   !!
2024-07-18T19:10:26,576     check.warn(importable)
2024-07-18T19:10:26,576   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-07-18T19:10:26,577   !!

2024-07-18T19:10:26,578           ********************************************************************************
2024-07-18T19:10:26,578           ############################
2024-07-18T19:10:26,578           # Package would be ignored #
2024-07-18T19:10:26,579           ############################
2024-07-18T19:10:26,579           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-07-18T19:10:26,580           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,581           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,581           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-07-18T19:10:26,582           to the `packages` configuration field.

2024-07-18T19:10:26,583           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,583           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,584           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,585           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,586           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,587           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-07-18T19:10:26,588           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-07-18T19:10:26,588           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,589           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,589           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,590           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,591           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,592           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,593                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,594                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,594                 directory, all directories are treated like packages.
2024-07-18T19:10:26,595           ********************************************************************************

2024-07-18T19:10:26,596   !!
2024-07-18T19:10:26,597     check.warn(importable)
2024-07-18T19:10:26,597   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-07-18T19:10:26,597   !!

2024-07-18T19:10:26,598           ********************************************************************************
2024-07-18T19:10:26,599           ############################
2024-07-18T19:10:26,599           # Package would be ignored #
2024-07-18T19:10:26,599           ############################
2024-07-18T19:10:26,600           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-07-18T19:10:26,600           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,601           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,601           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-07-18T19:10:26,602           to the `packages` configuration field.

2024-07-18T19:10:26,602           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,603           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,603           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,604           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,606           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-07-18T19:10:26,606           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-07-18T19:10:26,607           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,607           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,608           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,609           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,610           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,612           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,612                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,613                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,614                 directory, all directories are treated like packages.
2024-07-18T19:10:26,614           ********************************************************************************

2024-07-18T19:10:26,615   !!
2024-07-18T19:10:26,616     check.warn(importable)
2024-07-18T19:10:26,616   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-07-18T19:10:26,617   !!

2024-07-18T19:10:26,618           ********************************************************************************
2024-07-18T19:10:26,618           ############################
2024-07-18T19:10:26,619           # Package would be ignored #
2024-07-18T19:10:26,619           ############################
2024-07-18T19:10:26,620           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-07-18T19:10:26,620           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,621           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,622           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-07-18T19:10:26,622           to the `packages` configuration field.

2024-07-18T19:10:26,624           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,624           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,625           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,625           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,626           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,627           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-07-18T19:10:26,627           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-07-18T19:10:26,628           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,628           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,629           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,630           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,630           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,631           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,632                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,632                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,633                 directory, all directories are treated like packages.
2024-07-18T19:10:26,633           ********************************************************************************

2024-07-18T19:10:26,634   !!
2024-07-18T19:10:26,635     check.warn(importable)
2024-07-18T19:10:26,635   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-07-18T19:10:26,636   !!

2024-07-18T19:10:26,637           ********************************************************************************
2024-07-18T19:10:26,637           ############################
2024-07-18T19:10:26,638           # Package would be ignored #
2024-07-18T19:10:26,638           ############################
2024-07-18T19:10:26,639           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-07-18T19:10:26,639           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,640           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,641           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-07-18T19:10:26,641           to the `packages` configuration field.

2024-07-18T19:10:26,642           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,643           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,643           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,644           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,645           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,646           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-07-18T19:10:26,647           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-07-18T19:10:26,647           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,648           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,649           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,650           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,651           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,652           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,653                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,653                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,654                 directory, all directories are treated like packages.
2024-07-18T19:10:26,654           ********************************************************************************

2024-07-18T19:10:26,655   !!
2024-07-18T19:10:26,655     check.warn(importable)
2024-07-18T19:10:26,656   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-07-18T19:10:26,656   !!

2024-07-18T19:10:26,657           ********************************************************************************
2024-07-18T19:10:26,657           ############################
2024-07-18T19:10:26,657           # Package would be ignored #
2024-07-18T19:10:26,658           ############################
2024-07-18T19:10:26,658           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-07-18T19:10:26,659           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,659           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,660           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-07-18T19:10:26,660           to the `packages` configuration field.

2024-07-18T19:10:26,661           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,662           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,662           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,663           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,664           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,665           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-07-18T19:10:26,666           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-07-18T19:10:26,666           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,667           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,667           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,669           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,670           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,671           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,671                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,672                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,672                 directory, all directories are treated like packages.
2024-07-18T19:10:26,673           ********************************************************************************

2024-07-18T19:10:26,674   !!
2024-07-18T19:10:26,674     check.warn(importable)
2024-07-18T19:10:26,675   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-07-18T19:10:26,676   !!

2024-07-18T19:10:26,677           ********************************************************************************
2024-07-18T19:10:26,677           ############################
2024-07-18T19:10:26,678           # Package would be ignored #
2024-07-18T19:10:26,679           ############################
2024-07-18T19:10:26,680           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-07-18T19:10:26,680           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,681           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,681           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-07-18T19:10:26,681           to the `packages` configuration field.

2024-07-18T19:10:26,682           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,683           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,683           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,684           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,685           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,686           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-07-18T19:10:26,686           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-07-18T19:10:26,687           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,687           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,688           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,688           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,690           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,691           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,692                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,693                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,693                 directory, all directories are treated like packages.
2024-07-18T19:10:26,694           ********************************************************************************

2024-07-18T19:10:26,695   !!
2024-07-18T19:10:26,696     check.warn(importable)
2024-07-18T19:10:26,696   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-07-18T19:10:26,697   !!

2024-07-18T19:10:26,698           ********************************************************************************
2024-07-18T19:10:26,698           ############################
2024-07-18T19:10:26,699           # Package would be ignored #
2024-07-18T19:10:26,699           ############################
2024-07-18T19:10:26,700           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-07-18T19:10:26,700           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,701           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,702           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-07-18T19:10:26,702           to the `packages` configuration field.

2024-07-18T19:10:26,704           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,704           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,705           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,706           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,707           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,709           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-07-18T19:10:26,709           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-07-18T19:10:26,709           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,710           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,711           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,713           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,713                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,714                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,714                 directory, all directories are treated like packages.
2024-07-18T19:10:26,714           ********************************************************************************

2024-07-18T19:10:26,715   !!
2024-07-18T19:10:26,716     check.warn(importable)
2024-07-18T19:10:26,716   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-07-18T19:10:26,717   !!

2024-07-18T19:10:26,718           ********************************************************************************
2024-07-18T19:10:26,718           ############################
2024-07-18T19:10:26,719           # Package would be ignored #
2024-07-18T19:10:26,719           ############################
2024-07-18T19:10:26,719           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-07-18T19:10:26,720           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,721           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,721           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-07-18T19:10:26,722           to the `packages` configuration field.

2024-07-18T19:10:26,723           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,724           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,724           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,725           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,726           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,727           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-07-18T19:10:26,728           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-07-18T19:10:26,728           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,729           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,729           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,730           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,731           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,733           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,734                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,734                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,735                 directory, all directories are treated like packages.
2024-07-18T19:10:26,735           ********************************************************************************

2024-07-18T19:10:26,737   !!
2024-07-18T19:10:26,737     check.warn(importable)
2024-07-18T19:10:26,737   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-07-18T19:10:26,738   !!

2024-07-18T19:10:26,738           ********************************************************************************
2024-07-18T19:10:26,739           ############################
2024-07-18T19:10:26,739           # Package would be ignored #
2024-07-18T19:10:26,739           ############################
2024-07-18T19:10:26,740           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-07-18T19:10:26,740           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,741           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,741           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-07-18T19:10:26,742           to the `packages` configuration field.

2024-07-18T19:10:26,742           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,743           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,744           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,745           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,746           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-07-18T19:10:26,746           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-07-18T19:10:26,747           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,747           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,748           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,749           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,750           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,752           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,752                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,753                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,753                 directory, all directories are treated like packages.
2024-07-18T19:10:26,754           ********************************************************************************

2024-07-18T19:10:26,755   !!
2024-07-18T19:10:26,755     check.warn(importable)
2024-07-18T19:10:26,756   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,756   !!

2024-07-18T19:10:26,757           ********************************************************************************
2024-07-18T19:10:26,758           ############################
2024-07-18T19:10:26,758           # Package would be ignored #
2024-07-18T19:10:26,759           ############################
2024-07-18T19:10:26,759           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-07-18T19:10:26,760           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,761           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,762           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-07-18T19:10:26,762           to the `packages` configuration field.

2024-07-18T19:10:26,763           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,764           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,764           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,765           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,766           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,767           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-07-18T19:10:26,767           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-07-18T19:10:26,768           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,768           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,769           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,770           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,771           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,772           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,773                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,773                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,773                 directory, all directories are treated like packages.
2024-07-18T19:10:26,774           ********************************************************************************

2024-07-18T19:10:26,775   !!
2024-07-18T19:10:26,775     check.warn(importable)
2024-07-18T19:10:26,776   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-07-18T19:10:26,776   !!

2024-07-18T19:10:26,777           ********************************************************************************
2024-07-18T19:10:26,778           ############################
2024-07-18T19:10:26,779           # Package would be ignored #
2024-07-18T19:10:26,779           ############################
2024-07-18T19:10:26,780           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-07-18T19:10:26,780           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,781           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,782           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-07-18T19:10:26,782           to the `packages` configuration field.

2024-07-18T19:10:26,783           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,784           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,784           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,785           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,787           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,788           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-07-18T19:10:26,788           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-07-18T19:10:26,789           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,789           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,790           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,791           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,792           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,793           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,794                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,794                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,794                 directory, all directories are treated like packages.
2024-07-18T19:10:26,795           ********************************************************************************

2024-07-18T19:10:26,795   !!
2024-07-18T19:10:26,796     check.warn(importable)
2024-07-18T19:10:26,796   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-07-18T19:10:26,797   !!

2024-07-18T19:10:26,798           ********************************************************************************
2024-07-18T19:10:26,798           ############################
2024-07-18T19:10:26,798           # Package would be ignored #
2024-07-18T19:10:26,799           ############################
2024-07-18T19:10:26,799           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-07-18T19:10:26,800           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,801           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,801           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-07-18T19:10:26,802           to the `packages` configuration field.

2024-07-18T19:10:26,802           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,803           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,804           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,805           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,806           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,807           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-07-18T19:10:26,807           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-07-18T19:10:26,808           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,809           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,810           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,819           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,820                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,820                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,821                 directory, all directories are treated like packages.
2024-07-18T19:10:26,821           ********************************************************************************

2024-07-18T19:10:26,823   !!
2024-07-18T19:10:26,823     check.warn(importable)
2024-07-18T19:10:26,824   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-07-18T19:10:26,824   !!

2024-07-18T19:10:26,826           ********************************************************************************
2024-07-18T19:10:26,826           ############################
2024-07-18T19:10:26,827           # Package would be ignored #
2024-07-18T19:10:26,827           ############################
2024-07-18T19:10:26,828           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-07-18T19:10:26,828           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,829           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,829           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-07-18T19:10:26,830           to the `packages` configuration field.

2024-07-18T19:10:26,830           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,831           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,831           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,832           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,833           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,834           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-07-18T19:10:26,834           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-07-18T19:10:26,835           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,835           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,835           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,836           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,837           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,839           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,839                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,840                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,840                 directory, all directories are treated like packages.
2024-07-18T19:10:26,841           ********************************************************************************

2024-07-18T19:10:26,842   !!
2024-07-18T19:10:26,842     check.warn(importable)
2024-07-18T19:10:26,843   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-07-18T19:10:26,844   !!

2024-07-18T19:10:26,845           ********************************************************************************
2024-07-18T19:10:26,845           ############################
2024-07-18T19:10:26,846           # Package would be ignored #
2024-07-18T19:10:26,846           ############################
2024-07-18T19:10:26,847           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-07-18T19:10:26,848           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,849           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,850           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-07-18T19:10:26,850           to the `packages` configuration field.

2024-07-18T19:10:26,851           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,852           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,853           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,854           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,855           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,856           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-07-18T19:10:26,856           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-07-18T19:10:26,856           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,857           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,857           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,858           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,859           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,860           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,861                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,861                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,861                 directory, all directories are treated like packages.
2024-07-18T19:10:26,862           ********************************************************************************

2024-07-18T19:10:26,863   !!
2024-07-18T19:10:26,863     check.warn(importable)
2024-07-18T19:10:26,864   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-07-18T19:10:26,864   !!

2024-07-18T19:10:26,865           ********************************************************************************
2024-07-18T19:10:26,866           ############################
2024-07-18T19:10:26,866           # Package would be ignored #
2024-07-18T19:10:26,867           ############################
2024-07-18T19:10:26,867           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-07-18T19:10:26,868           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,869           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,869           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-07-18T19:10:26,870           to the `packages` configuration field.

2024-07-18T19:10:26,871           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,871           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,872           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,873           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,874           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,875           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-07-18T19:10:26,875           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-07-18T19:10:26,876           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,876           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,877           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,878           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,879           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,881           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,882                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,883                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,883                 directory, all directories are treated like packages.
2024-07-18T19:10:26,883           ********************************************************************************

2024-07-18T19:10:26,884   !!
2024-07-18T19:10:26,884     check.warn(importable)
2024-07-18T19:10:26,885   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-07-18T19:10:26,885   !!

2024-07-18T19:10:26,886           ********************************************************************************
2024-07-18T19:10:26,886           ############################
2024-07-18T19:10:26,887           # Package would be ignored #
2024-07-18T19:10:26,887           ############################
2024-07-18T19:10:26,887           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-07-18T19:10:26,888           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,888           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,889           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-07-18T19:10:26,889           to the `packages` configuration field.

2024-07-18T19:10:26,890           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,890           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,891           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,892           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,893           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,894           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-07-18T19:10:26,895           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-07-18T19:10:26,895           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,896           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,896           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,897           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,898           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,899           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,900                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,900                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,901                 directory, all directories are treated like packages.
2024-07-18T19:10:26,901           ********************************************************************************

2024-07-18T19:10:26,902   !!
2024-07-18T19:10:26,903     check.warn(importable)
2024-07-18T19:10:26,903   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,904   !!

2024-07-18T19:10:26,905           ********************************************************************************
2024-07-18T19:10:26,905           ############################
2024-07-18T19:10:26,906           # Package would be ignored #
2024-07-18T19:10:26,907           ############################
2024-07-18T19:10:26,907           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-07-18T19:10:26,908           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,909           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,909           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-07-18T19:10:26,910           to the `packages` configuration field.

2024-07-18T19:10:26,910           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,911           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,911           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,912           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,913           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,914           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-07-18T19:10:26,914           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-07-18T19:10:26,914           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,915           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,915           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,916           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,917           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,918           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,918                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,919                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,920                 directory, all directories are treated like packages.
2024-07-18T19:10:26,920           ********************************************************************************

2024-07-18T19:10:26,921   !!
2024-07-18T19:10:26,922     check.warn(importable)
2024-07-18T19:10:26,923   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,923   !!

2024-07-18T19:10:26,924           ********************************************************************************
2024-07-18T19:10:26,925           ############################
2024-07-18T19:10:26,925           # Package would be ignored #
2024-07-18T19:10:26,926           ############################
2024-07-18T19:10:26,926           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-07-18T19:10:26,927           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,928           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,928           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-07-18T19:10:26,929           to the `packages` configuration field.

2024-07-18T19:10:26,930           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,930           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,931           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,932           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,933           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,934           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-07-18T19:10:26,935           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-07-18T19:10:26,935           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,936           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,936           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,937           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,938           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,939           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,939                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,940                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,940                 directory, all directories are treated like packages.
2024-07-18T19:10:26,940           ********************************************************************************

2024-07-18T19:10:26,941   !!
2024-07-18T19:10:26,942     check.warn(importable)
2024-07-18T19:10:26,942   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:26,942   !!

2024-07-18T19:10:26,943           ********************************************************************************
2024-07-18T19:10:26,944           ############################
2024-07-18T19:10:26,944           # Package would be ignored #
2024-07-18T19:10:26,944           ############################
2024-07-18T19:10:26,945           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-07-18T19:10:26,946           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,946           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,947           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-07-18T19:10:26,947           to the `packages` configuration field.

2024-07-18T19:10:26,948           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,949           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,949           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,950           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,951           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,952           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-07-18T19:10:26,953           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-07-18T19:10:26,953           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,953           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,954           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,955           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,956           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,957           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,958                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,959                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,959                 directory, all directories are treated like packages.
2024-07-18T19:10:26,960           ********************************************************************************

2024-07-18T19:10:26,961   !!
2024-07-18T19:10:26,962     check.warn(importable)
2024-07-18T19:10:26,962   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-07-18T19:10:26,962   !!

2024-07-18T19:10:26,963           ********************************************************************************
2024-07-18T19:10:26,963           ############################
2024-07-18T19:10:26,964           # Package would be ignored #
2024-07-18T19:10:26,964           ############################
2024-07-18T19:10:26,964           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-07-18T19:10:26,965           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,966           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,966           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-07-18T19:10:26,966           to the `packages` configuration field.

2024-07-18T19:10:26,967           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,967           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,968           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,969           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,970           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,970           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-07-18T19:10:26,971           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-07-18T19:10:26,971           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,972           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,972           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,973           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,974           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,976           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,976                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,977                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,977                 directory, all directories are treated like packages.
2024-07-18T19:10:26,978           ********************************************************************************

2024-07-18T19:10:26,979   !!
2024-07-18T19:10:26,979     check.warn(importable)
2024-07-18T19:10:26,980   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-07-18T19:10:26,980   !!

2024-07-18T19:10:26,981           ********************************************************************************
2024-07-18T19:10:26,982           ############################
2024-07-18T19:10:26,983           # Package would be ignored #
2024-07-18T19:10:26,983           ############################
2024-07-18T19:10:26,983           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-07-18T19:10:26,984           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:26,985           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:26,986           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-07-18T19:10:26,987           to the `packages` configuration field.

2024-07-18T19:10:26,988           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:26,988           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:26,989           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:26,989           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:26,990           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:26,991           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-07-18T19:10:26,991           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-07-18T19:10:26,992           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:26,992           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:26,993           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:26,994           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:26,994           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:26,996           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:26,996                 even if it does not contain any `.py` files.
2024-07-18T19:10:26,996                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:26,997                 directory, all directories are treated like packages.
2024-07-18T19:10:26,997           ********************************************************************************

2024-07-18T19:10:26,998   !!
2024-07-18T19:10:26,999     check.warn(importable)
2024-07-18T19:10:26,999   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-07-18T19:10:27,000   !!

2024-07-18T19:10:27,001           ********************************************************************************
2024-07-18T19:10:27,001           ############################
2024-07-18T19:10:27,002           # Package would be ignored #
2024-07-18T19:10:27,003           ############################
2024-07-18T19:10:27,003           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-07-18T19:10:27,004           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,005           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,006           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-07-18T19:10:27,006           to the `packages` configuration field.

2024-07-18T19:10:27,007           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,008           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,008           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,009           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,010           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,011           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-07-18T19:10:27,012           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-07-18T19:10:27,013           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,013           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,014           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,015           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,016           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,017           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,018                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,018                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,018                 directory, all directories are treated like packages.
2024-07-18T19:10:27,019           ********************************************************************************

2024-07-18T19:10:27,019   !!
2024-07-18T19:10:27,020     check.warn(importable)
2024-07-18T19:10:27,020   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-07-18T19:10:27,021   !!

2024-07-18T19:10:27,022           ********************************************************************************
2024-07-18T19:10:27,022           ############################
2024-07-18T19:10:27,022           # Package would be ignored #
2024-07-18T19:10:27,023           ############################
2024-07-18T19:10:27,023           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-07-18T19:10:27,023           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,024           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,025           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-07-18T19:10:27,025           to the `packages` configuration field.

2024-07-18T19:10:27,026           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,027           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,027           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,029           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,030           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,031           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-07-18T19:10:27,032           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-07-18T19:10:27,032           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,033           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,034           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,035           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,036           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,037           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,038                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,038                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,038                 directory, all directories are treated like packages.
2024-07-18T19:10:27,039           ********************************************************************************

2024-07-18T19:10:27,040   !!
2024-07-18T19:10:27,041     check.warn(importable)
2024-07-18T19:10:27,041   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-07-18T19:10:27,042   !!

2024-07-18T19:10:27,043           ********************************************************************************
2024-07-18T19:10:27,043           ############################
2024-07-18T19:10:27,044           # Package would be ignored #
2024-07-18T19:10:27,045           ############################
2024-07-18T19:10:27,045           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-07-18T19:10:27,045           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,046           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,047           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-07-18T19:10:27,047           to the `packages` configuration field.

2024-07-18T19:10:27,048           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,048           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,048           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,049           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,050           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,051           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-07-18T19:10:27,051           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-07-18T19:10:27,052           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,052           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,053           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,054           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,055           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,056           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,057                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,058                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,058                 directory, all directories are treated like packages.
2024-07-18T19:10:27,059           ********************************************************************************

2024-07-18T19:10:27,060   !!
2024-07-18T19:10:27,060     check.warn(importable)
2024-07-18T19:10:27,061   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is absent from the `packages` configuration.
2024-07-18T19:10:27,062   !!

2024-07-18T19:10:27,063           ********************************************************************************
2024-07-18T19:10:27,063           ############################
2024-07-18T19:10:27,064           # Package would be ignored #
2024-07-18T19:10:27,064           ############################
2024-07-18T19:10:27,065           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' as an importable package[^1],
2024-07-18T19:10:27,065           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,066           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,067           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is explicitly added
2024-07-18T19:10:27,068           to the `packages` configuration field.

2024-07-18T19:10:27,069           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,070           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,070           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,072           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,072           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,073           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' to be distributed and are
2024-07-18T19:10:27,074           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' via
2024-07-18T19:10:27,074           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,074           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,075           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,076           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,076           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,078           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,078                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,078                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,079                 directory, all directories are treated like packages.
2024-07-18T19:10:27,079           ********************************************************************************

2024-07-18T19:10:27,080   !!
2024-07-18T19:10:27,080     check.warn(importable)
2024-07-18T19:10:27,081   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-07-18T19:10:27,081   !!

2024-07-18T19:10:27,082           ********************************************************************************
2024-07-18T19:10:27,083           ############################
2024-07-18T19:10:27,083           # Package would be ignored #
2024-07-18T19:10:27,084           ############################
2024-07-18T19:10:27,084           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-07-18T19:10:27,085           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,086           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,087           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-07-18T19:10:27,087           to the `packages` configuration field.

2024-07-18T19:10:27,088           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,089           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,089           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,090           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,091           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,092           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-07-18T19:10:27,093           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-07-18T19:10:27,093           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,094           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,094           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,096           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,097           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,099           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,099                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,100                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,101                 directory, all directories are treated like packages.
2024-07-18T19:10:27,101           ********************************************************************************

2024-07-18T19:10:27,102   !!
2024-07-18T19:10:27,102     check.warn(importable)
2024-07-18T19:10:27,102   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-07-18T19:10:27,103   !!

2024-07-18T19:10:27,104           ********************************************************************************
2024-07-18T19:10:27,104           ############################
2024-07-18T19:10:27,104           # Package would be ignored #
2024-07-18T19:10:27,105           ############################
2024-07-18T19:10:27,105           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-07-18T19:10:27,106           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,106           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,107           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-07-18T19:10:27,107           to the `packages` configuration field.

2024-07-18T19:10:27,108           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,108           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,109           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,110           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,111           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,112           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-07-18T19:10:27,112           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-07-18T19:10:27,113           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,113           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,114           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,115           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,116           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,118           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,118                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,118                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,119                 directory, all directories are treated like packages.
2024-07-18T19:10:27,119           ********************************************************************************

2024-07-18T19:10:27,120   !!
2024-07-18T19:10:27,121     check.warn(importable)
2024-07-18T19:10:27,121   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-07-18T19:10:27,122   !!

2024-07-18T19:10:27,123           ********************************************************************************
2024-07-18T19:10:27,124           ############################
2024-07-18T19:10:27,124           # Package would be ignored #
2024-07-18T19:10:27,125           ############################
2024-07-18T19:10:27,125           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-07-18T19:10:27,126           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,127           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,128           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-07-18T19:10:27,128           to the `packages` configuration field.

2024-07-18T19:10:27,129           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,129           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,130           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,130           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,131           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,132           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-07-18T19:10:27,132           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-07-18T19:10:27,133           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,133           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,134           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,134           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,135           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,137           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,137                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,138                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,138                 directory, all directories are treated like packages.
2024-07-18T19:10:27,139           ********************************************************************************

2024-07-18T19:10:27,140   !!
2024-07-18T19:10:27,140     check.warn(importable)
2024-07-18T19:10:27,141   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-07-18T19:10:27,142   !!

2024-07-18T19:10:27,143           ********************************************************************************
2024-07-18T19:10:27,144           ############################
2024-07-18T19:10:27,145           # Package would be ignored #
2024-07-18T19:10:27,145           ############################
2024-07-18T19:10:27,146           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-07-18T19:10:27,146           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,147           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,148           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-07-18T19:10:27,148           to the `packages` configuration field.

2024-07-18T19:10:27,149           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,150           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,151           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,152           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,153           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,154           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-07-18T19:10:27,155           already explicitly excluding 'alpaca_eval.models_configs' via
2024-07-18T19:10:27,155           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,156           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,157           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,157           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,158           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,159           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,160                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,160                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,161                 directory, all directories are treated like packages.
2024-07-18T19:10:27,161           ********************************************************************************

2024-07-18T19:10:27,162   !!
2024-07-18T19:10:27,162     check.warn(importable)
2024-07-18T19:10:27,162   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-07-18T19:10:27,163   !!

2024-07-18T19:10:27,164           ********************************************************************************
2024-07-18T19:10:27,164           ############################
2024-07-18T19:10:27,165           # Package would be ignored #
2024-07-18T19:10:27,165           ############################
2024-07-18T19:10:27,166           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-07-18T19:10:27,166           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,168           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,168           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-07-18T19:10:27,169           to the `packages` configuration field.

2024-07-18T19:10:27,170           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,171           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,171           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,172           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,173           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,175           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-07-18T19:10:27,175           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-07-18T19:10:27,176           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,176           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,177           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,178           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,179           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,181           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,182                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,182                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,183                 directory, all directories are treated like packages.
2024-07-18T19:10:27,184           ********************************************************************************

2024-07-18T19:10:27,185   !!
2024-07-18T19:10:27,186     check.warn(importable)
2024-07-18T19:10:27,186   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-07-18T19:10:27,187   !!

2024-07-18T19:10:27,188           ********************************************************************************
2024-07-18T19:10:27,189           ############################
2024-07-18T19:10:27,189           # Package would be ignored #
2024-07-18T19:10:27,190           ############################
2024-07-18T19:10:27,190           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-07-18T19:10:27,191           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,192           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,192           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-07-18T19:10:27,193           to the `packages` configuration field.

2024-07-18T19:10:27,194           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,194           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,195           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,196           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,197           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,198           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-07-18T19:10:27,198           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-07-18T19:10:27,199           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,200           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,200           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,201           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,202           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,204           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,204                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,205                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,206                 directory, all directories are treated like packages.
2024-07-18T19:10:27,206           ********************************************************************************

2024-07-18T19:10:27,208   !!
2024-07-18T19:10:27,208     check.warn(importable)
2024-07-18T19:10:27,209   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-07-18T19:10:27,209   !!

2024-07-18T19:10:27,210           ********************************************************************************
2024-07-18T19:10:27,211           ############################
2024-07-18T19:10:27,212           # Package would be ignored #
2024-07-18T19:10:27,212           ############################
2024-07-18T19:10:27,213           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-07-18T19:10:27,213           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,214           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,215           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-07-18T19:10:27,216           to the `packages` configuration field.

2024-07-18T19:10:27,217           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,218           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,219           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,220           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,221           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,222           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-07-18T19:10:27,222           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-07-18T19:10:27,223           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,223           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,224           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,225           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,226           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,228           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,228                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,229                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,230                 directory, all directories are treated like packages.
2024-07-18T19:10:27,230           ********************************************************************************

2024-07-18T19:10:27,231   !!
2024-07-18T19:10:27,232     check.warn(importable)
2024-07-18T19:10:27,233   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-07-18T19:10:27,233   !!

2024-07-18T19:10:27,234           ********************************************************************************
2024-07-18T19:10:27,235           ############################
2024-07-18T19:10:27,235           # Package would be ignored #
2024-07-18T19:10:27,236           ############################
2024-07-18T19:10:27,236           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-07-18T19:10:27,237           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,238           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,238           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-07-18T19:10:27,239           to the `packages` configuration field.

2024-07-18T19:10:27,240           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,240           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,241           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,242           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,243           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,244           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-07-18T19:10:27,245           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-07-18T19:10:27,245           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,246           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,246           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,247           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,248           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,250           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,251                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,251                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,252                 directory, all directories are treated like packages.
2024-07-18T19:10:27,252           ********************************************************************************

2024-07-18T19:10:27,253   !!
2024-07-18T19:10:27,254     check.warn(importable)
2024-07-18T19:10:27,254   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-07-18T19:10:27,255   !!

2024-07-18T19:10:27,256           ********************************************************************************
2024-07-18T19:10:27,256           ############################
2024-07-18T19:10:27,257           # Package would be ignored #
2024-07-18T19:10:27,257           ############################
2024-07-18T19:10:27,258           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-07-18T19:10:27,258           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,259           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,260           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-07-18T19:10:27,260           to the `packages` configuration field.

2024-07-18T19:10:27,261           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,261           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,262           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,263           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,264           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,265           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-07-18T19:10:27,265           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-07-18T19:10:27,266           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,266           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,267           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,268           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,269           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,270           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,271                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,272                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,272                 directory, all directories are treated like packages.
2024-07-18T19:10:27,273           ********************************************************************************

2024-07-18T19:10:27,274   !!
2024-07-18T19:10:27,274     check.warn(importable)
2024-07-18T19:10:27,275   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-07-18T19:10:27,275   !!

2024-07-18T19:10:27,276           ********************************************************************************
2024-07-18T19:10:27,277           ############################
2024-07-18T19:10:27,277           # Package would be ignored #
2024-07-18T19:10:27,278           ############################
2024-07-18T19:10:27,278           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-07-18T19:10:27,279           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,280           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,280           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-07-18T19:10:27,281           to the `packages` configuration field.

2024-07-18T19:10:27,282           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,282           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,283           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,284           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,284           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,285           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-07-18T19:10:27,286           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-07-18T19:10:27,286           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,287           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,287           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,288           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,289           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,291           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,291                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,292                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,292                 directory, all directories are treated like packages.
2024-07-18T19:10:27,293           ********************************************************************************

2024-07-18T19:10:27,294   !!
2024-07-18T19:10:27,294     check.warn(importable)
2024-07-18T19:10:27,295   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-07-18T19:10:27,295   !!

2024-07-18T19:10:27,296           ********************************************************************************
2024-07-18T19:10:27,297           ############################
2024-07-18T19:10:27,297           # Package would be ignored #
2024-07-18T19:10:27,298           ############################
2024-07-18T19:10:27,298           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-07-18T19:10:27,299           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,300           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,301           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-07-18T19:10:27,301           to the `packages` configuration field.

2024-07-18T19:10:27,302           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,303           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,303           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,304           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,305           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,307           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-07-18T19:10:27,307           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-07-18T19:10:27,308           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,309           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,310           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,311           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,312           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,313                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,313                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,314                 directory, all directories are treated like packages.
2024-07-18T19:10:27,314           ********************************************************************************

2024-07-18T19:10:27,315   !!
2024-07-18T19:10:27,315     check.warn(importable)
2024-07-18T19:10:27,316   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-07-18T19:10:27,316   !!

2024-07-18T19:10:27,317           ********************************************************************************
2024-07-18T19:10:27,318           ############################
2024-07-18T19:10:27,318           # Package would be ignored #
2024-07-18T19:10:27,318           ############################
2024-07-18T19:10:27,319           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-07-18T19:10:27,319           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,320           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,321           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-07-18T19:10:27,321           to the `packages` configuration field.

2024-07-18T19:10:27,322           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,323           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,323           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,324           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,325           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,326           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-07-18T19:10:27,327           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-07-18T19:10:27,327           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,328           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,328           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,329           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,330           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,332           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,333                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,333                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,333                 directory, all directories are treated like packages.
2024-07-18T19:10:27,334           ********************************************************************************

2024-07-18T19:10:27,335   !!
2024-07-18T19:10:27,336     check.warn(importable)
2024-07-18T19:10:27,336   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-07-18T19:10:27,337   !!

2024-07-18T19:10:27,338           ********************************************************************************
2024-07-18T19:10:27,338           ############################
2024-07-18T19:10:27,339           # Package would be ignored #
2024-07-18T19:10:27,339           ############################
2024-07-18T19:10:27,339           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-07-18T19:10:27,340           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,340           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,341           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-07-18T19:10:27,341           to the `packages` configuration field.

2024-07-18T19:10:27,342           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,343           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,343           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,344           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,345           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,346           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-07-18T19:10:27,346           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-07-18T19:10:27,347           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,347           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,348           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,349           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,350           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,351           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,352                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,352                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,353                 directory, all directories are treated like packages.
2024-07-18T19:10:27,353           ********************************************************************************

2024-07-18T19:10:27,354   !!
2024-07-18T19:10:27,355     check.warn(importable)
2024-07-18T19:10:27,355   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-07-18T19:10:27,356   !!

2024-07-18T19:10:27,357           ********************************************************************************
2024-07-18T19:10:27,357           ############################
2024-07-18T19:10:27,358           # Package would be ignored #
2024-07-18T19:10:27,358           ############################
2024-07-18T19:10:27,359           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-07-18T19:10:27,360           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,360           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,361           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-07-18T19:10:27,361           to the `packages` configuration field.

2024-07-18T19:10:27,362           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,363           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,363           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,365           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,366           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,366           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-07-18T19:10:27,367           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-07-18T19:10:27,367           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,368           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,369           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,369           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,370           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,372           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,372                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,373                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,373                 directory, all directories are treated like packages.
2024-07-18T19:10:27,374           ********************************************************************************

2024-07-18T19:10:27,375   !!
2024-07-18T19:10:27,375     check.warn(importable)
2024-07-18T19:10:27,376   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-07-18T19:10:27,376   !!

2024-07-18T19:10:27,377           ********************************************************************************
2024-07-18T19:10:27,378           ############################
2024-07-18T19:10:27,378           # Package would be ignored #
2024-07-18T19:10:27,379           ############################
2024-07-18T19:10:27,379           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-07-18T19:10:27,380           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,380           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,381           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-07-18T19:10:27,381           to the `packages` configuration field.

2024-07-18T19:10:27,383           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,383           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,383           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,384           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,386           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,387           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-07-18T19:10:27,387           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-07-18T19:10:27,388           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,388           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,389           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,390           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,391           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,393           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,394                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,394                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,394                 directory, all directories are treated like packages.
2024-07-18T19:10:27,395           ********************************************************************************

2024-07-18T19:10:27,396   !!
2024-07-18T19:10:27,396     check.warn(importable)
2024-07-18T19:10:27,397   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-07-18T19:10:27,397   !!

2024-07-18T19:10:27,398           ********************************************************************************
2024-07-18T19:10:27,399           ############################
2024-07-18T19:10:27,399           # Package would be ignored #
2024-07-18T19:10:27,400           ############################
2024-07-18T19:10:27,400           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-07-18T19:10:27,401           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,402           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,403           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-07-18T19:10:27,404           to the `packages` configuration field.

2024-07-18T19:10:27,405           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,406           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,407           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,408           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,409           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,411           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-07-18T19:10:27,412           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-07-18T19:10:27,412           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,413           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,414           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,415           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,417           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,419           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,419                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,420                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,421                 directory, all directories are treated like packages.
2024-07-18T19:10:27,422           ********************************************************************************

2024-07-18T19:10:27,423   !!
2024-07-18T19:10:27,424     check.warn(importable)
2024-07-18T19:10:27,424   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-07-18T19:10:27,425   !!

2024-07-18T19:10:27,427           ********************************************************************************
2024-07-18T19:10:27,428           ############################
2024-07-18T19:10:27,429           # Package would be ignored #
2024-07-18T19:10:27,429           ############################
2024-07-18T19:10:27,430           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-07-18T19:10:27,431           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,433           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,433           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-07-18T19:10:27,434           to the `packages` configuration field.

2024-07-18T19:10:27,435           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,435           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,436           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,437           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,438           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,440           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-07-18T19:10:27,440           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-07-18T19:10:27,441           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,442           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,443           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,445           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,446           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,447                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,448                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,448                 directory, all directories are treated like packages.
2024-07-18T19:10:27,449           ********************************************************************************

2024-07-18T19:10:27,450   !!
2024-07-18T19:10:27,451     check.warn(importable)
2024-07-18T19:10:27,452   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-07-18T19:10:27,452   !!

2024-07-18T19:10:27,454           ********************************************************************************
2024-07-18T19:10:27,454           ############################
2024-07-18T19:10:27,455           # Package would be ignored #
2024-07-18T19:10:27,456           ############################
2024-07-18T19:10:27,457           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-07-18T19:10:27,457           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,459           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,459           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-07-18T19:10:27,460           to the `packages` configuration field.

2024-07-18T19:10:27,461           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,462           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,462           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,464           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,465           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,467           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-07-18T19:10:27,467           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-07-18T19:10:27,468           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,469           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,469           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,470           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,472           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,473           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,474                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,474                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,475                 directory, all directories are treated like packages.
2024-07-18T19:10:27,476           ********************************************************************************

2024-07-18T19:10:27,477   !!
2024-07-18T19:10:27,478     check.warn(importable)
2024-07-18T19:10:27,478   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-07-18T19:10:27,479   !!

2024-07-18T19:10:27,480           ********************************************************************************
2024-07-18T19:10:27,481           ############################
2024-07-18T19:10:27,481           # Package would be ignored #
2024-07-18T19:10:27,482           ############################
2024-07-18T19:10:27,482           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-07-18T19:10:27,483           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,485           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,485           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-07-18T19:10:27,486           to the `packages` configuration field.

2024-07-18T19:10:27,487           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,488           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,489           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,490           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,493           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-07-18T19:10:27,493           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-07-18T19:10:27,494           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,495           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,496           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,497           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,498           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,500           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,501                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,502                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,502                 directory, all directories are treated like packages.
2024-07-18T19:10:27,503           ********************************************************************************

2024-07-18T19:10:27,504   !!
2024-07-18T19:10:27,504     check.warn(importable)
2024-07-18T19:10:27,505   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-07-18T19:10:27,505   !!

2024-07-18T19:10:27,506           ********************************************************************************
2024-07-18T19:10:27,506           ############################
2024-07-18T19:10:27,507           # Package would be ignored #
2024-07-18T19:10:27,507           ############################
2024-07-18T19:10:27,508           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-07-18T19:10:27,508           but it is absent from setuptools' `packages` configuration.

2024-07-18T19:10:27,509           This leads to an ambiguous overall configuration. If you want to distribute this
2024-07-18T19:10:27,510           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-07-18T19:10:27,510           to the `packages` configuration field.

2024-07-18T19:10:27,511           Alternatively, you can also rely on setuptools' discovery methods
2024-07-18T19:10:27,511           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-07-18T19:10:27,512           instead of `find_packages(...)`/`find:`).

2024-07-18T19:10:27,513           You can read more about "package discovery" on setuptools documentation page:

2024-07-18T19:10:27,514           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-07-18T19:10:27,515           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-07-18T19:10:27,515           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-07-18T19:10:27,516           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-07-18T19:10:27,516           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-07-18T19:10:27,517           combination with a more fine grained `package-data` configuration.

2024-07-18T19:10:27,518           You can read more about "package data files" on setuptools documentation page:

2024-07-18T19:10:27,519           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-07-18T19:10:27,520           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-07-18T19:10:27,521                 even if it does not contain any `.py` files.
2024-07-18T19:10:27,521                 On the other hand, currently there is no concept of package data
2024-07-18T19:10:27,522                 directory, all directories are treated like packages.
2024-07-18T19:10:27,522           ********************************************************************************

2024-07-18T19:10:27,523   !!
2024-07-18T19:10:27,524     check.warn(importable)
2024-07-18T19:10:27,525   creating build/lib/alpaca_eval/evaluators_configs
2024-07-18T19:10:27,525   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-07-18T19:10:27,526   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:27,526   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:27,527   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:27,527   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:27,528   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:27,528   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:27,529   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:27,529   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:27,530   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:27,530   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:27,531   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:27,531   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:27,532   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-07-18T19:10:27,532   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-07-18T19:10:27,532   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-07-18T19:10:27,533   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-07-18T19:10:27,533   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:27,534   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:27,534   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:27,535   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:27,535   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:27,536   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:27,536   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:27,537   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:27,537   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:27,538   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,538   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,538   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,539   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,539   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,540   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,541   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,541   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,542   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,543   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,543   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,543   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,544   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,544   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:27,545   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:27,545   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:27,546   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:27,546   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:27,547   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:27,547   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:27,548   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-07-18T19:10:27,548   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-07-18T19:10:27,549   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-07-18T19:10:27,549   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-07-18T19:10:27,549   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:27,550   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:27,551   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:27,551   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:27,552   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:27,552   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:27,552   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:27,553   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:27,554   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:27,554   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-07-18T19:10:27,555   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-07-18T19:10:27,555   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:27,556   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:27,556   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:27,557   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:27,557   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:27,558   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:27,558   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-07-18T19:10:27,559   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-07-18T19:10:27,559   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:27,560   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:27,560   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:27,561   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-07-18T19:10:27,561   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-07-18T19:10:27,562   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-07-18T19:10:27,562   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-07-18T19:10:27,563   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-07-18T19:10:27,563   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-07-18T19:10:27,564   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:27,564   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:27,565   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:27,565   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:27,566   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:27,566   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:27,567   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-07-18T19:10:27,567   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-07-18T19:10:27,568   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-07-18T19:10:27,568   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-07-18T19:10:27,569   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:27,569   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:27,570   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:27,570   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-07-18T19:10:27,571   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-07-18T19:10:27,571   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-07-18T19:10:27,572   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-07-18T19:10:27,573   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:27,573   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:27,573   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:27,574   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-07-18T19:10:27,574   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-07-18T19:10:27,575   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:27,575   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:27,575   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:27,576   creating build/lib/alpaca_eval/evaluators_configs/test
2024-07-18T19:10:27,577   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-07-18T19:10:27,577   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:27,577   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:27,578   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:27,578   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-07-18T19:10:27,579   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-07-18T19:10:27,579   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-07-18T19:10:27,580   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-07-18T19:10:27,580   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-07-18T19:10:27,581   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-07-18T19:10:27,581   creating build/lib/alpaca_eval/leaderboards
2024-07-18T19:10:27,582   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:27,582   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:27,583   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:27,584   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:27,584   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:27,585   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,585   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,586   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,586   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,587   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,587   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:27,588   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-07-18T19:10:27,588   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-07-18T19:10:27,589   creating build/lib/alpaca_eval/models_configs
2024-07-18T19:10:27,589   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:27,589   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:27,590   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:27,590   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:27,591   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:27,591   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:27,591   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:27,592   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:27,592   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:27,593   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:27,593   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:27,594   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:27,594   creating build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-07-18T19:10:27,595   copying src/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-07-18T19:10:27,595   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:27,596   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:27,596   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:27,597   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:27,598   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:27,598   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:27,599   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:27,599   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:27,600   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:27,601   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:27,601   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:27,601   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:27,602   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:27,602   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:27,603   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:27,603   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:27,604   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:27,604   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:27,604   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:27,605   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:27,605   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:27,606   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:27,607   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:27,607   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:27,607   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:27,608   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:27,608   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:27,609   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-07-18T19:10:27,609   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-07-18T19:10:27,610   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-07-18T19:10:27,611   copying src/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-07-18T19:10:27,611   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-07-18T19:10:27,612   copying src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-07-18T19:10:27,612   creating build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:27,613   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:27,613   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:27,614   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-07-18T19:10:27,614   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-07-18T19:10:27,615   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:27,615   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:27,616   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:27,617   creating build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-07-18T19:10:27,617   copying src/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-07-18T19:10:27,618   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:27,618   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:27,619   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:27,619   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:27,620   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:27,620   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:27,621   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:27,621   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:27,622   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:27,622   creating build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:27,623   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:27,623   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:27,624   creating build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:27,624   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:27,625   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:27,626   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:27,626   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:27,627   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:27,627   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:27,628   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:27,628   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:27,629   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:27,630   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:27,630   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:27,630   creating build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-07-18T19:10:27,631   copying src/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-07-18T19:10:27,631   creating build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:27,632   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:27,632   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:27,633   creating build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-07-18T19:10:27,633   copying src/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-07-18T19:10:27,634   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:27,634   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:27,635   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:27,635   creating build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-07-18T19:10:27,636   copying src/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-07-18T19:10:27,636   creating build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:27,637   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:27,637   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:27,639   creating build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:27,640   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:27,642   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:27,644   creating build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:27,645   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:27,647   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:27,650   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:27,651   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:27,653   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:27,656   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-07-18T19:10:27,657   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-07-18T19:10:27,659   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:27,660   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:27,662   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:27,664   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-07-18T19:10:27,665   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-07-18T19:10:27,667   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-07-18T19:10:27,668   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-07-18T19:10:27,670   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:27,671   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:27,673   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:27,675   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:27,676   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:27,678   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:27,680   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:27,681   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:27,683   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:27,685   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-07-18T19:10:27,686   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-07-18T19:10:27,688   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-07-18T19:10:27,689   copying src/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-07-18T19:10:27,692   creating build/lib/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:27,692   copying src/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:27,694   copying src/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:27,697   creating build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-07-18T19:10:27,698   copying src/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-07-18T19:10:27,700   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-07-18T19:10:27,701   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-07-18T19:10:27,703   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:27,704   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:27,706   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:27,709   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:27,710   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:27,712   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:27,714   creating build/lib/alpaca_eval/models_configs/Together-MoA
2024-07-18T19:10:27,715   copying src/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA
2024-07-18T19:10:27,717   creating build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-07-18T19:10:27,718   copying src/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-07-18T19:10:27,720   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:27,721   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:27,723   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:27,725   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:27,726   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:27,728   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:27,729   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:27,730   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:27,732   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:27,734   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-07-18T19:10:27,735   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-07-18T19:10:27,737   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:27,738   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:27,741   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:27,743   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:27,745   creating build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,746   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,748   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,750   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,752   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:27,753   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:27,755   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:27,757   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:27,759   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:27,760   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:27,762   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:27,764   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:27,765   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:27,767   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:27,769   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-07-18T19:10:27,770   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-07-18T19:10:27,772   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-07-18T19:10:27,773   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-07-18T19:10:27,775   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-07-18T19:10:27,776   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-07-18T19:10:27,778   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-07-18T19:10:27,779   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-07-18T19:10:27,781   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:27,782   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:27,784   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:27,786   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:27,787   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:27,790   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:27,791   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-07-18T19:10:27,792   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-07-18T19:10:27,794   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-07-18T19:10:27,795   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-07-18T19:10:27,798   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-07-18T19:10:27,799   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-07-18T19:10:27,801   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:27,802   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:27,805   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:27,806   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:27,807   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:27,810   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:27,812   creating build/lib/alpaca_eval/models_configs/claude
2024-07-18T19:10:27,813   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-07-18T19:10:27,815   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-07-18T19:10:27,817   creating build/lib/alpaca_eval/models_configs/claude-2
2024-07-18T19:10:27,817   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-07-18T19:10:27,819   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-07-18T19:10:27,820   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-07-18T19:10:27,822   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:27,823   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:27,825   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:27,827   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:27,828   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:27,830   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:27,832   creating build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:27,833   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:27,834   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:27,837   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-07-18T19:10:27,838   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-07-18T19:10:27,840   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:27,841   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:27,843   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:27,846   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-07-18T19:10:27,847   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-07-18T19:10:27,849   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-07-18T19:10:27,850   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-07-18T19:10:27,852   creating build/lib/alpaca_eval/models_configs/cohere
2024-07-18T19:10:27,853   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-07-18T19:10:27,855   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-07-18T19:10:27,857   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:27,858   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:27,860   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:27,862   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-07-18T19:10:27,863   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-07-18T19:10:27,865   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:27,866   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:27,868   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:27,870   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-07-18T19:10:27,871   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-07-18T19:10:27,873   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-07-18T19:10:27,874   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-07-18T19:10:27,876   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-07-18T19:10:27,876   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-07-18T19:10:27,879   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-07-18T19:10:27,879   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-07-18T19:10:27,882   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-07-18T19:10:27,883   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-07-18T19:10:27,885   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-07-18T19:10:27,886   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-07-18T19:10:27,888   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:27,889   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:27,892   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:27,894   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:27,895   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:27,897   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:27,899   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-07-18T19:10:27,900   copying src/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-07-18T19:10:27,902   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-07-18T19:10:27,903   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-07-18T19:10:27,905   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-07-18T19:10:27,906   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-07-18T19:10:27,908   creating build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:27,909   copying src/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:27,912   copying src/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:27,913   creating build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:27,914   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:27,917   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:27,919   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-07-18T19:10:27,920   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-07-18T19:10:27,922   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-07-18T19:10:27,923   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-07-18T19:10:27,925   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-07-18T19:10:27,926   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-07-18T19:10:27,928   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-07-18T19:10:27,929   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-07-18T19:10:27,931   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-07-18T19:10:27,932   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-07-18T19:10:27,934   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-07-18T19:10:27,935   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-07-18T19:10:27,937   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-07-18T19:10:27,938   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-07-18T19:10:27,940   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,941   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-07-18T19:10:27,943   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-07-18T19:10:27,944   copying src/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-07-18T19:10:27,946   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-07-18T19:10:27,947   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-07-18T19:10:27,949   creating build/lib/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:27,950   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:27,952   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:27,954   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-07-18T19:10:27,955   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-07-18T19:10:27,957   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-07-18T19:10:27,958   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-07-18T19:10:27,960   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-07-18T19:10:27,961   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-07-18T19:10:27,963   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-07-18T19:10:27,964   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-07-18T19:10:27,966   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:27,967   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:27,970   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:27,972   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:27,973   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:27,975   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:27,977   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:27,978   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:27,980   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:27,982   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-07-18T19:10:27,983   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-07-18T19:10:27,985   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-07-18T19:10:27,985   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-07-18T19:10:27,987   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-07-18T19:10:27,988   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-07-18T19:10:27,990   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-07-18T19:10:27,991   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-07-18T19:10:27,993   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-07-18T19:10:27,994   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-07-18T19:10:27,996   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:27,997   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:27,999   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:28,001   creating build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-07-18T19:10:28,002   copying src/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-07-18T19:10:28,004   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,005   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,007   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,009   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-07-18T19:10:28,010   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-07-18T19:10:28,012   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-07-18T19:10:28,013   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-07-18T19:10:28,015   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,016   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,019   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,021   creating build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-07-18T19:10:28,022   copying src/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-07-18T19:10:28,024   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:28,025   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:28,027   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:28,029   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-07-18T19:10:28,030   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-07-18T19:10:28,032   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,033   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,035   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,037   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,038   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,040   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,042   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,043   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,045   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,047   creating build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:28,048   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:28,050   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:28,052   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-07-18T19:10:28,053   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-07-18T19:10:28,055   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,056   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,058   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,060   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,061   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,063   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,065   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-07-18T19:10:28,066   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-07-18T19:10:28,069   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,070   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,072   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,074   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:28,075   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:28,077   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:28,079   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:28,080   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:28,082   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:28,084   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-07-18T19:10:28,085   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-07-18T19:10:28,087   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,088   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,090   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,092   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,092   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,094   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,096   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:28,097   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:28,099   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:28,102   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:28,102   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:28,105   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:28,107   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,108   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,110   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,112   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:28,113   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:28,116   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:28,118   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:28,119   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:28,121   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:28,123   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,124   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,127   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,129   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:28,130   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:28,132   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:28,135   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-07-18T19:10:28,136   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-07-18T19:10:28,138   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-07-18T19:10:28,139   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-07-18T19:10:28,142   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-07-18T19:10:28,143   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-07-18T19:10:28,146   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-07-18T19:10:28,147   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-07-18T19:10:28,150   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-07-18T19:10:28,151   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-07-18T19:10:28,153   creating build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-07-18T19:10:28,154   copying src/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-07-18T19:10:28,157   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-07-18T19:10:28,158   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-07-18T19:10:28,161   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-07-18T19:10:28,162   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-07-18T19:10:28,164   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:28,166   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:28,168   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:28,170   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-07-18T19:10:28,172   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-07-18T19:10:28,174   creating build/lib/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:28,175   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:28,178   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:28,180   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:28,181   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:28,184   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:28,186   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:28,187   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:28,190   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:28,192   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:28,193   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:28,195   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:28,198   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-07-18T19:10:28,199   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-07-18T19:10:28,201   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-07-18T19:10:28,203   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-07-18T19:10:28,205   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-07-18T19:10:28,207   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-07-18T19:10:28,210   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-07-18T19:10:28,211   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-07-18T19:10:28,214   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:28,216   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:28,219   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:28,222   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-07-18T19:10:28,223   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-07-18T19:10:28,227   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-07-18T19:10:28,228   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-07-18T19:10:28,231   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,233   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,236   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,239   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-07-18T19:10:28,240   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-07-18T19:10:28,243   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-07-18T19:10:28,245   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-07-18T19:10:28,248   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-07-18T19:10:28,249   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-07-18T19:10:28,252   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,254   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,257   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,260   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,262   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,265   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,268   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,270   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,273   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,276   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:28,277   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:28,281   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:28,283   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-07-18T19:10:28,285   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-07-18T19:10:28,288   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-07-18T19:10:28,289   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-07-18T19:10:28,292   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-07-18T19:10:28,294   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-07-18T19:10:28,297   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-07-18T19:10:28,298   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-07-18T19:10:28,301   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-07-18T19:10:28,303   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-07-18T19:10:28,306   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:28,307   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:28,310   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:28,312   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-07-18T19:10:28,313   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-07-18T19:10:28,315   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-07-18T19:10:28,317   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-07-18T19:10:28,319   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,320   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,323   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,325   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-07-18T19:10:28,326   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-07-18T19:10:28,329   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-07-18T19:10:28,330   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-07-18T19:10:28,333   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-07-18T19:10:28,334   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-07-18T19:10:28,336   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-07-18T19:10:28,338   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-07-18T19:10:28,340   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-07-18T19:10:28,341   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-07-18T19:10:28,343   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-07-18T19:10:28,345   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-07-18T19:10:28,347   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:28,348   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:28,351   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:28,353   creating build/lib/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:28,354   copying src/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:28,357   copying src/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:28,359   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:28,360   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:28,362   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:28,365   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:28,366   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:28,369   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:28,371   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-07-18T19:10:28,372   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-07-18T19:10:28,375   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-07-18T19:10:28,376   copying src/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-07-18T19:10:28,407   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-07-18T19:10:28,408   !!

2024-07-18T19:10:28,409           ********************************************************************************
2024-07-18T19:10:28,410           Please avoid running ``setup.py`` directly.
2024-07-18T19:10:28,410           Instead, use pypa/build, pypa/installer or other
2024-07-18T19:10:28,411           standards-based tools.

2024-07-18T19:10:28,412           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-07-18T19:10:28,413           ********************************************************************************

2024-07-18T19:10:28,414   !!
2024-07-18T19:10:28,415     self.initialize_options()
2024-07-18T19:10:28,437   installing to build/bdist.linux-armv7l/wheel
2024-07-18T19:10:28,438   running install
2024-07-18T19:10:28,463   running install_lib
2024-07-18T19:10:28,489   creating build/bdist.linux-armv7l
2024-07-18T19:10:28,490   creating build/bdist.linux-armv7l/wheel
2024-07-18T19:10:28,493   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,494   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,496   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-07-18T19:10:28,501   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-07-18T19:10:28,503   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-07-18T19:10:28,506   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-07-18T19:10:28,508   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-07-18T19:10:28,510   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,513   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,516   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,519   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:28,526   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-07-18T19:10:28,527   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-07-18T19:10:28,529   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-07-18T19:10:28,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-07-18T19:10:28,533   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-07-18T19:10:28,535   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,537   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,541   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-07-18T19:10:28,544   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:28,545   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:28,547   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-07-18T19:10:28,550   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-07-18T19:10:28,551   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-07-18T19:10:28,553   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,555   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,557   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-07-18T19:10:28,559   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-07-18T19:10:28,561   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-07-18T19:10:28,563   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-07-18T19:10:28,565   copying build/lib/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-07-18T19:10:28,567   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-07-18T19:10:28,568   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-07-18T19:10:28,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:28,572   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:28,575   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-07-18T19:10:28,577   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-07-18T19:10:28,578   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-07-18T19:10:28,581   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-07-18T19:10:28,582   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-07-18T19:10:28,585   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-07-18T19:10:28,586   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-07-18T19:10:28,589   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:28,590   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:28,592   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-07-18T19:10:28,595   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-07-18T19:10:28,596   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-07-18T19:10:28,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:28,600   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:28,602   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-07-18T19:10:28,604   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-07-18T19:10:28,606   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-07-18T19:10:28,608   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-07-18T19:10:28,610   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-07-18T19:10:28,612   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,613   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,616   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-07-18T19:10:28,618   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-07-18T19:10:28,620   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-07-18T19:10:28,622   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-07-18T19:10:28,623   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-07-18T19:10:28,626   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-07-18T19:10:28,627   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-07-18T19:10:28,629   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:28,631   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:28,633   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-07-18T19:10:28,636   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-07-18T19:10:28,637   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-07-18T19:10:28,639   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:28,641   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:28,643   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-07-18T19:10:28,646   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,647   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,649   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-07-18T19:10:28,652   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:28,653   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:28,656   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-07-18T19:10:28,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-07-18T19:10:28,659   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-07-18T19:10:28,662   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-07-18T19:10:28,663   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-07-18T19:10:28,666   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:28,667   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:28,670   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-07-18T19:10:28,672   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-07-18T19:10:28,673   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-07-18T19:10:28,676   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-07-18T19:10:28,677   copying build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-07-18T19:10:28,680   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,681   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,683   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-07-18T19:10:28,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-07-18T19:10:28,687   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-07-18T19:10:28,689   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:28,691   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:28,693   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-07-18T19:10:28,695   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-07-18T19:10:28,697   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-07-18T19:10:28,699   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:28,700   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:28,703   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-07-18T19:10:28,705   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:28,707   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:28,709   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-07-18T19:10:28,712   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-07-18T19:10:28,713   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-07-18T19:10:28,715   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,717   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,719   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-07-18T19:10:28,722   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:28,723   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:28,725   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-07-18T19:10:28,727   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,729   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,731   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-07-18T19:10:28,733   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-07-18T19:10:28,734   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-07-18T19:10:28,737   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-07-18T19:10:28,739   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-07-18T19:10:28,741   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-07-18T19:10:28,742   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-07-18T19:10:28,745   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:28,746   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:28,749   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:28,751   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-07-18T19:10:28,753   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:28,754   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:28,757   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-07-18T19:10:28,759   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-07-18T19:10:28,760   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-07-18T19:10:28,763   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-07-18T19:10:28,764   copying build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-07-18T19:10:28,767   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,768   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,770   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-07-18T19:10:28,772   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-07-18T19:10:28,773   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-07-18T19:10:28,775   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-07-18T19:10:28,776   copying build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-07-18T19:10:28,778   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:28,779   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:28,781   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-07-18T19:10:28,783   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-07-18T19:10:28,784   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-07-18T19:10:28,787   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-07-18T19:10:28,788   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-07-18T19:10:28,790   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-07-18T19:10:28,791   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-07-18T19:10:28,793   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-07-18T19:10:28,795   copying build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-07-18T19:10:28,797   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-07-18T19:10:28,798   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-07-18T19:10:28,801   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-07-18T19:10:28,802   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-07-18T19:10:28,804   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:28,805   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:28,807   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-07-18T19:10:28,810   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:28,811   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:28,813   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-07-18T19:10:28,815   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:28,816   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:28,818   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-07-18T19:10:28,820   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-07-18T19:10:28,821   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-07-18T19:10:28,823   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:28,824   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:28,826   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-07-18T19:10:28,829   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:28,829   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:28,831   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-07-18T19:10:28,834   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-07-18T19:10:28,835   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-07-18T19:10:28,837   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-07-18T19:10:28,838   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-07-18T19:10:28,841   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-07-18T19:10:28,842   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-07-18T19:10:28,844   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-07-18T19:10:28,845   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-07-18T19:10:28,848   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:28,849   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:28,851   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-07-18T19:10:28,853   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,854   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,856   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-07-18T19:10:28,859   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,859   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,861   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-07-18T19:10:28,864   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,865   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,867   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-07-18T19:10:28,869   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:28,870   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:28,872   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-07-18T19:10:28,874   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-07-18T19:10:28,875   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-07-18T19:10:28,878   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,878   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,880   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-07-18T19:10:28,883   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-07-18T19:10:28,884   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-07-18T19:10:28,885   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-07-18T19:10:28,888   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-07-18T19:10:28,889   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-07-18T19:10:28,891   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-07-18T19:10:28,892   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-07-18T19:10:28,894   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,895   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,898   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-07-18T19:10:28,900   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-07-18T19:10:28,901   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-07-18T19:10:28,903   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:28,905   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:28,906   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-07-18T19:10:28,909   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-07-18T19:10:28,909   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-07-18T19:10:28,912   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,913   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,914   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-07-18T19:10:28,917   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-07-18T19:10:28,918   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-07-18T19:10:28,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:28,921   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:28,923   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-07-18T19:10:28,926   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,927   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,929   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-07-18T19:10:28,931   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:28,932   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:28,934   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-07-18T19:10:28,936   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:28,937   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:28,939   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-07-18T19:10:28,942   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:28,943   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:28,945   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-07-18T19:10:28,947   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-07-18T19:10:28,949   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-07-18T19:10:28,951   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-07-18T19:10:28,952   copying build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-07-18T19:10:28,954   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,955   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,957   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-07-18T19:10:28,960   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:28,960   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:28,962   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-07-18T19:10:28,964   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:28,966   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:28,968   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:28,969   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-07-18T19:10:28,972   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:28,973   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:28,975   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-07-18T19:10:28,977   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:28,978   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:28,980   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-07-18T19:10:28,982   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-07-18T19:10:28,983   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-07-18T19:10:28,985   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-07-18T19:10:28,986   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-07-18T19:10:28,988   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-07-18T19:10:28,989   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-07-18T19:10:28,992   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,993   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,995   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-07-18T19:10:28,997   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:28,998   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:28,999   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-07-18T19:10:29,001   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:29,002   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:29,004   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-07-18T19:10:29,006   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-07-18T19:10:29,007   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-07-18T19:10:29,010   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:29,011   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:29,013   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-07-18T19:10:29,015   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-07-18T19:10:29,016   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-07-18T19:10:29,019   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-07-18T19:10:29,020   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-07-18T19:10:29,023   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-07-18T19:10:29,024   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-07-18T19:10:29,026   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:29,027   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:29,029   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-07-18T19:10:29,031   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:29,032   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:29,035   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-07-18T19:10:29,037   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-07-18T19:10:29,038   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-07-18T19:10:29,040   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-07-18T19:10:29,041   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-07-18T19:10:29,044   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-07-18T19:10:29,045   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-07-18T19:10:29,047   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:29,048   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:29,050   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-07-18T19:10:29,052   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-07-18T19:10:29,053   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-07-18T19:10:29,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:29,057   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:29,059   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-07-18T19:10:29,061   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-07-18T19:10:29,062   copying build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-07-18T19:10:29,064   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:29,065   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:29,067   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-07-18T19:10:29,069   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:29,070   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:29,072   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-07-18T19:10:29,075   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-07-18T19:10:29,076   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-07-18T19:10:29,078   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-07-18T19:10:29,079   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-07-18T19:10:29,081   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:29,082   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:29,084   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-07-18T19:10:29,087   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-07-18T19:10:29,088   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-07-18T19:10:29,090   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:29,091   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:29,093   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-07-18T19:10:29,095   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:29,096   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:29,098   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-07-18T19:10:29,101   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:29,102   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:29,104   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-07-18T19:10:29,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-07-18T19:10:29,107   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-07-18T19:10:29,109   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-07-18T19:10:29,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-07-18T19:10:29,113   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-07-18T19:10:29,115   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:29,116   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:29,118   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-07-18T19:10:29,120   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-07-18T19:10:29,121   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-07-18T19:10:29,124   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:29,125   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:29,127   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-07-18T19:10:29,129   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:29,130   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:29,132   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-07-18T19:10:29,134   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:29,135   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:29,137   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-07-18T19:10:29,139   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-07-18T19:10:29,140   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-07-18T19:10:29,142   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:29,143   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:29,145   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-07-18T19:10:29,147   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:29,148   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:29,150   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-07-18T19:10:29,153   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-07-18T19:10:29,154   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-07-18T19:10:29,156   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:29,157   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:29,159   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-07-18T19:10:29,161   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-07-18T19:10:29,162   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-07-18T19:10:29,165   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-07-18T19:10:29,166   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-07-18T19:10:29,169   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:29,170   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:29,172   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-07-18T19:10:29,174   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-07-18T19:10:29,175   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-07-18T19:10:29,177   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-07-18T19:10:29,178   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-07-18T19:10:29,181   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:29,181   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:29,183   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-07-18T19:10:29,186   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:29,186   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:29,188   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-07-18T19:10:29,191   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-07-18T19:10:29,191   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-07-18T19:10:29,194   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:29,195   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:29,197   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-07-18T19:10:29,199   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-07-18T19:10:29,200   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-07-18T19:10:29,203   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-07-18T19:10:29,204   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-07-18T19:10:29,206   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:29,207   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:29,209   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-07-18T19:10:29,212   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:29,213   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:29,215   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-07-18T19:10:29,217   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-07-18T19:10:29,218   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-07-18T19:10:29,221   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:29,222   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:29,224   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-07-18T19:10:29,226   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-07-18T19:10:29,227   copying build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-07-18T19:10:29,230   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:29,230   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:29,233   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-07-18T19:10:29,235   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-07-18T19:10:29,236   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-07-18T19:10:29,238   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:29,239   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:29,241   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-07-18T19:10:29,243   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:29,245   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:29,246   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-07-18T19:10:29,249   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-07-18T19:10:29,250   copying build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-07-18T19:10:29,252   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:29,253   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:29,255   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-07-18T19:10:29,258   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:29,259   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:29,261   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-07-18T19:10:29,263   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:29,264   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:29,266   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:29,268   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-07-18T19:10:29,270   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:29,271   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:29,273   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-07-18T19:10:29,275   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:29,276   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:29,278   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-07-18T19:10:29,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-07-18T19:10:29,281   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-07-18T19:10:29,283   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-07-18T19:10:29,284   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-07-18T19:10:29,287   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-07-18T19:10:29,288   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-07-18T19:10:29,290   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-07-18T19:10:29,291   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-07-18T19:10:29,293   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:29,294   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:29,296   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-07-18T19:10:29,299   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-07-18T19:10:29,300   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-07-18T19:10:29,302   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:29,303   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:29,305   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-07-18T19:10:29,307   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:29,308   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:29,310   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-07-18T19:10:29,312   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-07-18T19:10:29,313   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-07-18T19:10:29,315   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-07-18T19:10:29,316   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-07-18T19:10:29,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-07-18T19:10:29,319   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-07-18T19:10:29,321   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:29,322   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:29,324   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-07-18T19:10:29,327   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-07-18T19:10:29,327   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-07-18T19:10:29,330   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-07-18T19:10:29,331   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-07-18T19:10:29,333   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:29,334   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:29,336   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-07-18T19:10:29,338   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-07-18T19:10:29,339   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-07-18T19:10:29,341   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-07-18T19:10:29,342   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-07-18T19:10:29,345   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:29,346   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:29,348   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-07-18T19:10:29,350   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-07-18T19:10:29,351   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-07-18T19:10:29,354   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-07-18T19:10:29,355   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-07-18T19:10:29,357   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-07-18T19:10:29,358   copying build/lib/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-07-18T19:10:29,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-07-18T19:10:29,361   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-07-18T19:10:29,364   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:29,365   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:29,367   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-07-18T19:10:29,369   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:29,370   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:29,372   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-07-18T19:10:29,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-07-18T19:10:29,375   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-07-18T19:10:29,377   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:29,378   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:29,380   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-07-18T19:10:29,382   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-07-18T19:10:29,383   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-07-18T19:10:29,386   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-07-18T19:10:29,387   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-07-18T19:10:29,389   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:29,390   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:29,392   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-07-18T19:10:29,394   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:29,395   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:29,397   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-07-18T19:10:29,400   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:29,401   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:29,403   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-07-18T19:10:29,405   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:29,406   copying build/lib/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:29,408   copying build/lib/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-07-18T19:10:29,410   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-07-18T19:10:29,411   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-07-18T19:10:29,413   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:29,414   copying build/lib/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:29,416   copying build/lib/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-07-18T19:10:29,418   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-07-18T19:10:29,419   copying build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-07-18T19:10:29,421   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:29,422   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:29,424   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-07-18T19:10:29,427   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:29,428   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:29,430   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-07-18T19:10:29,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-07-18T19:10:29,433   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-07-18T19:10:29,435   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:29,436   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:29,438   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-07-18T19:10:29,440   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:29,441   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:29,443   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-07-18T19:10:29,445   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:29,448   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:29,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-07-18T19:10:29,451   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-07-18T19:10:29,452   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-07-18T19:10:29,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:29,456   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:29,458   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:29,460   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:29,462   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-07-18T19:10:29,464   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,465   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,467   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,470   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,472   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,474   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-07-18T19:10:29,477   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-07-18T19:10:29,478   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:29,479   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:29,481   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-07-18T19:10:29,483   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-07-18T19:10:29,484   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-07-18T19:10:29,487   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-07-18T19:10:29,488   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-07-18T19:10:29,490   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:29,491   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:29,494   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-07-18T19:10:29,496   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-07-18T19:10:29,497   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-07-18T19:10:29,499   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-07-18T19:10:29,500   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-07-18T19:10:29,502   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-07-18T19:10:29,503   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-07-18T19:10:29,505   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:29,506   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:29,508   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-07-18T19:10:29,510   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-07-18T19:10:29,511   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-07-18T19:10:29,514   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-07-18T19:10:29,515   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-07-18T19:10:29,517   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:29,518   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:29,520   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-07-18T19:10:29,522   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:29,523   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:29,525   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-07-18T19:10:29,528   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-07-18T19:10:29,529   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-07-18T19:10:29,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:29,532   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:29,534   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-07-18T19:10:29,536   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-07-18T19:10:29,537   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-07-18T19:10:29,539   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:29,540   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:29,542   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-07-18T19:10:29,544   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,546   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,548   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,550   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,552   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,554   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,556   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,558   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,560   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,562   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,564   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,566   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,568   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,571   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-07-18T19:10:29,573   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-07-18T19:10:29,574   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-07-18T19:10:29,577   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-07-18T19:10:29,578   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-07-18T19:10:29,580   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:29,581   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:29,583   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-07-18T19:10:29,585   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-07-18T19:10:29,588   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:29,589   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:29,591   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-07-18T19:10:29,593   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-07-18T19:10:29,594   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-07-18T19:10:29,596   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:29,597   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:29,599   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-07-18T19:10:29,602   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-07-18T19:10:29,603   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-07-18T19:10:29,605   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-07-18T19:10:29,606   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-07-18T19:10:29,608   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:29,609   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:29,611   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-07-18T19:10:29,614   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-07-18T19:10:29,615   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-07-18T19:10:29,617   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:29,618   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:29,620   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-07-18T19:10:29,623   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:29,624   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:29,626   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-07-18T19:10:29,628   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:29,629   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:29,631   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-07-18T19:10:29,633   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:29,634   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:29,636   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-07-18T19:10:29,638   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:29,639   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:29,641   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-07-18T19:10:29,643   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:29,644   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:29,647   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-07-18T19:10:29,649   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:29,650   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:29,652   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-07-18T19:10:29,654   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-07-18T19:10:29,655   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-07-18T19:10:29,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-07-18T19:10:29,659   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-07-18T19:10:29,661   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-07-18T19:10:29,662   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-07-18T19:10:29,664   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:29,665   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:29,667   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-07-18T19:10:29,669   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:29,670   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:29,672   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-07-18T19:10:29,674   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:29,675   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:29,677   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-07-18T19:10:29,679   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-07-18T19:10:29,680   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-07-18T19:10:29,683   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-07-18T19:10:29,685   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-07-18T19:10:29,688   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,689   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,691   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,693   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,695   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,698   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,700   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,702   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,704   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,706   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,709   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,711   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-07-18T19:10:29,712   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-07-18T19:10:29,715   running install_egg_info
2024-07-18T19:10:29,745   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.4-py3.11.egg-info
2024-07-18T19:10:29,761   running install_scripts
2024-07-18T19:10:29,803   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.4.dist-info/WHEEL
2024-07-18T19:10:29,806   creating '/tmp/pip-wheel-jaiswmx9/alpaca_eval-0.6.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-07-18T19:10:29,808   adding 'alpaca_eval/__init__.py'
2024-07-18T19:10:29,811   adding 'alpaca_eval/analyze.py'
2024-07-18T19:10:29,814   adding 'alpaca_eval/completion_parsers.py'
2024-07-18T19:10:29,816   adding 'alpaca_eval/constants.py'
2024-07-18T19:10:29,819   adding 'alpaca_eval/main.py'
2024-07-18T19:10:29,823   adding 'alpaca_eval/plotting.py'
2024-07-18T19:10:29,826   adding 'alpaca_eval/processors.py'
2024-07-18T19:10:29,827   adding 'alpaca_eval/types.py'
2024-07-18T19:10:29,830   adding 'alpaca_eval/utils.py'
2024-07-18T19:10:29,832   adding 'alpaca_eval/annotators/__init__.py'
2024-07-18T19:10:29,837   adding 'alpaca_eval/annotators/base.py'
2024-07-18T19:10:29,839   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-07-18T19:10:29,841   adding 'alpaca_eval/decoders/__init__.py'
2024-07-18T19:10:29,843   adding 'alpaca_eval/decoders/anthropic.py'
2024-07-18T19:10:29,844   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-07-18T19:10:29,846   adding 'alpaca_eval/decoders/cohere.py'
2024-07-18T19:10:29,847   adding 'alpaca_eval/decoders/google.py'
2024-07-18T19:10:29,849   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-07-18T19:10:29,851   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-07-18T19:10:29,852   adding 'alpaca_eval/decoders/jinachat.py'
2024-07-18T19:10:29,854   adding 'alpaca_eval/decoders/openai.py'
2024-07-18T19:10:29,856   adding 'alpaca_eval/decoders/replicate.py'
2024-07-18T19:10:29,857   adding 'alpaca_eval/decoders/vllm_local.py'
2024-07-18T19:10:29,860   adding 'alpaca_eval/evaluators_configs/README.md'
2024-07-18T19:10:29,862   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-07-18T19:10:29,863   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-07-18T19:10:29,865   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-07-18T19:10:29,866   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-07-18T19:10:29,868   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-07-18T19:10:29,869   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-07-18T19:10:29,871   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-07-18T19:10:29,872   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-07-18T19:10:29,874   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-07-18T19:10:29,876   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-07-18T19:10:29,877   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-07-18T19:10:29,879   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-07-18T19:10:29,880   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-07-18T19:10:29,882   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-07-18T19:10:29,883   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt'
2024-07-18T19:10:29,885   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml'
2024-07-18T19:10:29,887   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-07-18T19:10:29,888   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-07-18T19:10:29,890   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-07-18T19:10:29,891   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-07-18T19:10:29,892   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-07-18T19:10:29,894   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-07-18T19:10:29,896   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-07-18T19:10:29,897   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-07-18T19:10:29,899   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-07-18T19:10:29,900   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-07-18T19:10:29,902   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-07-18T19:10:29,903   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-07-18T19:10:29,905   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-07-18T19:10:29,907   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-07-18T19:10:29,908   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-07-18T19:10:29,910   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-07-18T19:10:29,911   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-07-18T19:10:29,913   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-07-18T19:10:29,915   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-07-18T19:10:29,916   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-07-18T19:10:29,918   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-07-18T19:10:29,919   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-07-18T19:10:29,920   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-07-18T19:10:29,922   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-07-18T19:10:29,923   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-07-18T19:10:29,925   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-07-18T19:10:29,927   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-07-18T19:10:29,928   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-07-18T19:10:29,930   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-07-18T19:10:29,931   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-07-18T19:10:29,932   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-07-18T19:10:29,934   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-07-18T19:10:29,936   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-07-18T19:10:29,938   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-07-18T19:10:29,939   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-07-18T19:10:29,941   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-07-18T19:10:29,943   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-07-18T19:10:29,945   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-07-18T19:10:29,946   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-07-18T19:10:29,948   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-07-18T19:10:29,950   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-07-18T19:10:29,952   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-07-18T19:10:29,953   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-07-18T19:10:29,955   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-07-18T19:10:29,956   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-07-18T19:10:29,958   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-07-18T19:10:29,960   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-07-18T19:10:29,961   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-07-18T19:10:29,963   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-07-18T19:10:29,965   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-07-18T19:10:29,966   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-07-18T19:10:29,968   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-07-18T19:10:29,970   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-07-18T19:10:29,971   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-07-18T19:10:29,973   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-07-18T19:10:29,974   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-07-18T19:10:29,976   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml'
2024-07-18T19:10:29,979   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-07-18T19:10:29,980   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-07-18T19:10:29,982   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-07-18T19:10:29,983   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-07-18T19:10:29,985   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-07-18T19:10:29,986   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-07-18T19:10:29,987   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-07-18T19:10:29,988   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-07-18T19:10:29,992   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-07-18T19:10:29,994   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-07-18T19:10:29,996   adding 'alpaca_eval/metrics/__init__.py'
2024-07-18T19:10:29,998   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-07-18T19:10:30,000   adding 'alpaca_eval/metrics/helpers.py'
2024-07-18T19:10:30,001   adding 'alpaca_eval/metrics/winrate.py'
2024-07-18T19:10:30,007   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-07-18T19:10:30,009   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-07-18T19:10:30,011   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-07-18T19:10:30,012   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-07-18T19:10:30,013   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-07-18T19:10:30,015   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-07-18T19:10:30,016   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-07-18T19:10:30,017   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-07-18T19:10:30,019   adding 'alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml'
2024-07-18T19:10:30,021   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml'
2024-07-18T19:10:30,022   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt'
2024-07-18T19:10:30,024   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml'
2024-07-18T19:10:30,025   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt'
2024-07-18T19:10:30,027   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml'
2024-07-18T19:10:30,028   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt'
2024-07-18T19:10:30,030   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml'
2024-07-18T19:10:30,031   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt'
2024-07-18T19:10:30,033   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml'
2024-07-18T19:10:30,034   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt'
2024-07-18T19:10:30,036   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml'
2024-07-18T19:10:30,037   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt'
2024-07-18T19:10:30,039   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml'
2024-07-18T19:10:30,040   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt'
2024-07-18T19:10:30,042   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-07-18T19:10:30,043   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-07-18T19:10:30,044   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml'
2024-07-18T19:10:30,045   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt'
2024-07-18T19:10:30,047   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml'
2024-07-18T19:10:30,049   adding 'alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml'
2024-07-18T19:10:30,050   adding 'alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml'
2024-07-18T19:10:30,052   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml'
2024-07-18T19:10:30,053   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt'
2024-07-18T19:10:30,055   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-07-18T19:10:30,056   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-07-18T19:10:30,057   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-07-18T19:10:30,059   adding 'alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml'
2024-07-18T19:10:30,061   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-07-18T19:10:30,062   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-07-18T19:10:30,063   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-07-18T19:10:30,065   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-07-18T19:10:30,067   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-07-18T19:10:30,068   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-07-18T19:10:30,070   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml'
2024-07-18T19:10:30,071   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt'
2024-07-18T19:10:30,073   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml'
2024-07-18T19:10:30,074   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt'
2024-07-18T19:10:30,076   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-07-18T19:10:30,077   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-07-18T19:10:30,079   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-07-18T19:10:30,080   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-07-18T19:10:30,082   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-07-18T19:10:30,083   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-07-18T19:10:30,085   adding 'alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml'
2024-07-18T19:10:30,086   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml'
2024-07-18T19:10:30,087   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt'
2024-07-18T19:10:30,089   adding 'alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml'
2024-07-18T19:10:30,091   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-07-18T19:10:30,092   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-07-18T19:10:30,094   adding 'alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml'
2024-07-18T19:10:30,096   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml'
2024-07-18T19:10:30,097   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt'
2024-07-18T19:10:30,099   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml'
2024-07-18T19:10:30,100   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt'
2024-07-18T19:10:30,102   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml'
2024-07-18T19:10:30,103   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt'
2024-07-18T19:10:30,104   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml'
2024-07-18T19:10:30,105   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt'
2024-07-18T19:10:30,107   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml'
2024-07-18T19:10:30,109   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-07-18T19:10:30,110   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-07-18T19:10:30,112   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-07-18T19:10:30,113   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-07-18T19:10:30,115   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-07-18T19:10:30,116   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-07-18T19:10:30,118   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-07-18T19:10:30,119   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-07-18T19:10:30,120   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-07-18T19:10:30,121   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-07-18T19:10:30,123   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml'
2024-07-18T19:10:30,125   adding 'alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml'
2024-07-18T19:10:30,126   adding 'alpaca_eval/models_configs/Storm-7B/configs.yaml'
2024-07-18T19:10:30,127   adding 'alpaca_eval/models_configs/Storm-7B/prompt.txt'
2024-07-18T19:10:30,129   adding 'alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml'
2024-07-18T19:10:30,131   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-07-18T19:10:30,132   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-07-18T19:10:30,134   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-07-18T19:10:30,135   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-07-18T19:10:30,137   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-07-18T19:10:30,138   adding 'alpaca_eval/models_configs/Together-MoA/configs.yaml'
2024-07-18T19:10:30,140   adding 'alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml'
2024-07-18T19:10:30,141   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-07-18T19:10:30,142   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-07-18T19:10:30,144   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-07-18T19:10:30,145   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-07-18T19:10:30,147   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-07-18T19:10:30,148   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-07-18T19:10:30,150   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-07-18T19:10:30,152   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-07-18T19:10:30,153   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-07-18T19:10:30,154   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-07-18T19:10:30,156   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml'
2024-07-18T19:10:30,157   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml'
2024-07-18T19:10:30,158   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt'
2024-07-18T19:10:30,160   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-07-18T19:10:30,161   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-07-18T19:10:30,162   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-07-18T19:10:30,164   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-07-18T19:10:30,165   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-07-18T19:10:30,167   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-07-18T19:10:30,168   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-07-18T19:10:30,169   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-07-18T19:10:30,171   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-07-18T19:10:30,173   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-07-18T19:10:30,174   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-07-18T19:10:30,176   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-07-18T19:10:30,177   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-07-18T19:10:30,179   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-07-18T19:10:30,180   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-07-18T19:10:30,182   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-07-18T19:10:30,183   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-07-18T19:10:30,185   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-07-18T19:10:30,186   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-07-18T19:10:30,188   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-07-18T19:10:30,189   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-07-18T19:10:30,190   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-07-18T19:10:30,192   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-07-18T19:10:30,193   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-07-18T19:10:30,195   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-07-18T19:10:30,197   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-07-18T19:10:30,198   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-07-18T19:10:30,199   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-07-18T19:10:30,201   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-07-18T19:10:30,202   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-07-18T19:10:30,204   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml'
2024-07-18T19:10:30,205   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt'
2024-07-18T19:10:30,207   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-07-18T19:10:30,209   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-07-18T19:10:30,210   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-07-18T19:10:30,212   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-07-18T19:10:30,214   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-07-18T19:10:30,215   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-07-18T19:10:30,217   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-07-18T19:10:30,218   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-07-18T19:10:30,220   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-07-18T19:10:30,221   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-07-18T19:10:30,223   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-07-18T19:10:30,224   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-07-18T19:10:30,226   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-07-18T19:10:30,228   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-07-18T19:10:30,229   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-07-18T19:10:30,231   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-07-18T19:10:30,232   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-07-18T19:10:30,234   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-07-18T19:10:30,236   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-07-18T19:10:30,237   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-07-18T19:10:30,239   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml'
2024-07-18T19:10:30,240   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt'
2024-07-18T19:10:30,241   adding 'alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml'
2024-07-18T19:10:30,243   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-07-18T19:10:30,244   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-07-18T19:10:30,246   adding 'alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml'
2024-07-18T19:10:30,247   adding 'alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt'
2024-07-18T19:10:30,249   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml'
2024-07-18T19:10:30,250   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt'
2024-07-18T19:10:30,252   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-07-18T19:10:30,254   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-07-18T19:10:30,256   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-07-18T19:10:30,257   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-07-18T19:10:30,259   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-07-18T19:10:30,261   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-07-18T19:10:30,262   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-07-18T19:10:30,264   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-07-18T19:10:30,266   adding 'alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml'
2024-07-18T19:10:30,267   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-07-18T19:10:30,269   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-07-18T19:10:30,270   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-07-18T19:10:30,272   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-07-18T19:10:30,273   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-07-18T19:10:30,275   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-07-18T19:10:30,277   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-07-18T19:10:30,278   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-07-18T19:10:30,280   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-07-18T19:10:30,281   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-07-18T19:10:30,282   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-07-18T19:10:30,284   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-07-18T19:10:30,285   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-07-18T19:10:30,287   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-07-18T19:10:30,289   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-07-18T19:10:30,291   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-07-18T19:10:30,293   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-07-18T19:10:30,295   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-07-18T19:10:30,297   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-07-18T19:10:30,298   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-07-18T19:10:30,300   adding 'alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml'
2024-07-18T19:10:30,302   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-07-18T19:10:30,303   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-07-18T19:10:30,304   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-07-18T19:10:30,306   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml'
2024-07-18T19:10:30,308   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-07-18T19:10:30,309   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-07-18T19:10:30,310   adding 'alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml'
2024-07-18T19:10:30,312   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-07-18T19:10:30,313   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-07-18T19:10:30,314   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-07-18T19:10:30,316   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-07-18T19:10:30,317   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-07-18T19:10:30,319   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-07-18T19:10:30,320   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-07-18T19:10:30,322   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-07-18T19:10:30,323   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-07-18T19:10:30,324   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml'
2024-07-18T19:10:30,326   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt'
2024-07-18T19:10:30,327   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-07-18T19:10:30,329   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-07-18T19:10:30,330   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-07-18T19:10:30,332   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-07-18T19:10:30,333   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-07-18T19:10:30,335   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-07-18T19:10:30,336   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-07-18T19:10:30,337   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-07-18T19:10:30,339   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-07-18T19:10:30,340   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-07-18T19:10:30,342   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-07-18T19:10:30,344   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-07-18T19:10:30,345   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-07-18T19:10:30,347   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-07-18T19:10:30,348   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-07-18T19:10:30,350   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-07-18T19:10:30,351   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-07-18T19:10:30,353   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-07-18T19:10:30,354   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-07-18T19:10:30,356   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-07-18T19:10:30,357   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-07-18T19:10:30,359   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-07-18T19:10:30,360   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-07-18T19:10:30,362   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-07-18T19:10:30,363   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-07-18T19:10:30,365   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-07-18T19:10:30,366   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-07-18T19:10:30,368   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-07-18T19:10:30,369   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-07-18T19:10:30,370   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-07-18T19:10:30,371   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-07-18T19:10:30,373   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-07-18T19:10:30,374   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-07-18T19:10:30,376   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-07-18T19:10:30,378   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-07-18T19:10:30,379   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-07-18T19:10:30,381   adding 'alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml'
2024-07-18T19:10:30,383   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-07-18T19:10:30,384   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-07-18T19:10:30,386   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-07-18T19:10:30,387   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-07-18T19:10:30,389   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-07-18T19:10:30,390   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-07-18T19:10:30,391   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-07-18T19:10:30,393   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-07-18T19:10:30,394   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-07-18T19:10:30,396   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-07-18T19:10:30,397   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-07-18T19:10:30,398   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-07-18T19:10:30,400   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-07-18T19:10:30,401   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-07-18T19:10:30,403   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-07-18T19:10:30,404   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-07-18T19:10:30,406   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-07-18T19:10:30,408   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-07-18T19:10:30,409   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-07-18T19:10:30,411   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-07-18T19:10:30,412   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml'
2024-07-18T19:10:30,414   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-07-18T19:10:30,415   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-07-18T19:10:30,417   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml'
2024-07-18T19:10:30,419   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-07-18T19:10:30,421   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml'
2024-07-18T19:10:30,422   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-07-18T19:10:30,423   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-07-18T19:10:30,425   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-07-18T19:10:30,427   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-07-18T19:10:30,428   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-07-18T19:10:30,430   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-07-18T19:10:30,431   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-07-18T19:10:30,432   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-07-18T19:10:30,434   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-07-18T19:10:30,436   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-07-18T19:10:30,437   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-07-18T19:10:30,439   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml'
2024-07-18T19:10:30,441   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-07-18T19:10:30,442   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-07-18T19:10:30,443   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-07-18T19:10:30,445   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-07-18T19:10:30,447   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-07-18T19:10:30,448   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-07-18T19:10:30,449   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-07-18T19:10:30,451   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-07-18T19:10:30,453   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-07-18T19:10:30,454   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-07-18T19:10:30,456   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-07-18T19:10:30,457   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-07-18T19:10:30,459   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-07-18T19:10:30,460   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-07-18T19:10:30,462   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-07-18T19:10:30,463   adding 'alpaca_eval/models_configs/yi-large-preview/configs.yaml'
2024-07-18T19:10:30,464   adding 'alpaca_eval/models_configs/yi-large-preview/prompt.txt'
2024-07-18T19:10:30,466   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-07-18T19:10:30,467   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-07-18T19:10:30,469   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml'
2024-07-18T19:10:30,470   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt'
2024-07-18T19:10:30,472   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-07-18T19:10:30,473   adding 'alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml'
2024-07-18T19:10:30,477   adding 'alpaca_eval-0.6.4.dist-info/LICENSE'
2024-07-18T19:10:30,488   adding 'alpaca_eval-0.6.4.dist-info/METADATA'
2024-07-18T19:10:30,490   adding 'alpaca_eval-0.6.4.dist-info/WHEEL'
2024-07-18T19:10:30,491   adding 'alpaca_eval-0.6.4.dist-info/entry_points.txt'
2024-07-18T19:10:30,492   adding 'alpaca_eval-0.6.4.dist-info/top_level.txt'
2024-07-18T19:10:30,499   adding 'alpaca_eval-0.6.4.dist-info/RECORD'
2024-07-18T19:10:30,509   removing build/bdist.linux-armv7l/wheel
2024-07-18T19:10:30,827   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-07-18T19:10:30,833   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.4-py3-none-any.whl size=332888 sha256=fb2f9d67dd37cc01f579c0718b8eaedb9245543919e550264a403fec3bac13e0
2024-07-18T19:10:30,834   Stored in directory: /tmp/pip-ephem-wheel-cache-0dzsm0e8/wheels/a2/e5/e4/ee466ac33d71acc3043236f5d849d10120fb859be552fc017a
2024-07-18T19:10:30,873 Successfully built alpaca-eval
2024-07-18T19:10:30,885 Removed build tracker: '/tmp/pip-build-tracker-9w0mf9_t'