2024-12-29T01:59:26,479 Created temporary directory: /tmp/pip-build-tracker-tsfmhksf
2024-12-29T01:59:26,481 Initialized build tracking at /tmp/pip-build-tracker-tsfmhksf
2024-12-29T01:59:26,481 Created build tracker: /tmp/pip-build-tracker-tsfmhksf
2024-12-29T01:59:26,482 Entered build tracker: /tmp/pip-build-tracker-tsfmhksf
2024-12-29T01:59:26,482 Created temporary directory: /tmp/pip-wheel-f2x6ql_q
2024-12-29T01:59:26,486 Created temporary directory: /tmp/pip-ephem-wheel-cache-d77leqv5
2024-12-29T01:59:26,530 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-12-29T01:59:26,533 2 location(s) to search for versions of alpaca-eval:
2024-12-29T01:59:26,533 * https://pypi.org/simple/alpaca-eval/
2024-12-29T01:59:26,533 * https://www.piwheels.org/simple/alpaca-eval/
2024-12-29T01:59:26,534 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-12-29T01:59:26,534 Getting page https://pypi.org/simple/alpaca-eval/
2024-12-29T01:59:26,536 Found index url https://pypi.org/simple/
2024-12-29T01:59:26,682 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-12-29T01:59:26,696   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,697   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-12-29T01:59:26,698   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,699   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-12-29T01:59:26,700   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,701   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-12-29T01:59:26,702   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,703   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-12-29T01:59:26,704   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,705   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-12-29T01:59:26,706   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,707   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-12-29T01:59:26,708   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,709   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-12-29T01:59:26,709   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,710   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-12-29T01:59:26,711   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,712   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-12-29T01:59:26,712   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,713   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-12-29T01:59:26,714   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,715   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-12-29T01:59:26,716   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,717   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-12-29T01:59:26,718   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,719   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-12-29T01:59:26,720   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,721   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-12-29T01:59:26,722   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,723   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-12-29T01:59:26,723   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,724   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-12-29T01:59:26,725   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,725   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-12-29T01:59:26,726   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,727   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-12-29T01:59:26,728   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,729   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-12-29T01:59:26,730   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,731   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-12-29T01:59:26,731   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,732   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-12-29T01:59:26,733   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,734   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-12-29T01:59:26,735   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,735   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-12-29T01:59:26,736   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,737   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-12-29T01:59:26,738   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,739   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-12-29T01:59:26,739   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,741   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-12-29T01:59:26,741   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,742   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-12-29T01:59:26,743   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,744   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-12-29T01:59:26,745   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,746   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-12-29T01:59:26,747   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,747   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-12-29T01:59:26,748   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,749   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-12-29T01:59:26,750   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,750   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-12-29T01:59:26,751   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ea/4d/9b44ccd56c4f7579c9e4b6886096daa1ad6d75019e4a2b03f0b94476a623/alpaca_eval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,752   Found link https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.2
2024-12-29T01:59:26,753   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/94/e2/86131f32b7f7d5b1b400e08393d8b3c490a893e9bb8139313cb93c23369d/alpaca_eval-0.6.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,754   Found link https://files.pythonhosted.org/packages/ec/5e/c4031470661fbf1c84d1efece8a8ff6c1ec5ef91a5054f0da0bc59f9157e/alpaca_eval-0.6.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.3
2024-12-29T01:59:26,755   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e1/7f/7c7ab03e465637ee08158c9c4dfeb914b7e6549f19f996ae1cd3d19d7a07/alpaca_eval-0.6.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,756   Found link https://files.pythonhosted.org/packages/44/55/e334186757b0335b7c928e2bf73080e0400622eefb41964eb845462b1517/alpaca_eval-0.6.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.4
2024-12-29T01:59:26,757   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/9d/44/6e0c171949a1b42858c7bb1eee7023494ec058db73b581401b4ddf7d3195/alpaca_eval-0.6.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,758   Found link https://files.pythonhosted.org/packages/a1/98/d2944a0c07a0700c13e22b4fd39f7bac8131e35436669ae16111c964465e/alpaca_eval-0.6.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.5
2024-12-29T01:59:26,758   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/6c/c2/aa7b54eaca10603efdcac7092c43889e7316db6e5781d300fde57a5ec95e/alpaca_eval-0.6.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,759   Found link https://files.pythonhosted.org/packages/10/62/3013b6f0357260c06d3965c20060714abcb27752240ff9f9b630fe2a48dd/alpaca_eval-0.6.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.6
2024-12-29T01:59:26,760 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-12-29T01:59:26,761 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-12-29T01:59:26,762 Found index url https://www.piwheels.org/simple/
2024-12-29T01:59:26,928 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-12-29T01:59:26,938   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.5-py3-none-any.whl#sha256=2c2385e6c20ff2cd42f344e3dae30f4980feae549a01546ef4cda76c0397995e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,938   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.4-py3-none-any.whl#sha256=fb2f9d67dd37cc01f579c0718b8eaedb9245543919e550264a403fec3bac13e0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,939   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.3-py3-none-any.whl#sha256=fe5ebfbbbbfd8d774873f20b778cf9b914febe7f116e1a82ac86186a804da4f5 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,939   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.2-py3-none-any.whl#sha256=f93aa4f39f46ac56b280e9c6249815ad57fb21f6f676abcf76640e872d4a1832 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,940   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.1-py3-none-any.whl#sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,941   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,942   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,942   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,943   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,943   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,944   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,945   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,945   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,946   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,946   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,947   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,947   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,947   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,948   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,949   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,950   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,950   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,951   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,951   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,952   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,953   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,953   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,953   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,954   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-12-29T01:59:26,954   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,955   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,955   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-12-29T01:59:26,956 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-12-29T01:59:26,957 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-12-29T01:59:26,980 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-12-29T01:59:26,982 Collecting alpaca-eval==0.6.6
2024-12-29T01:59:26,985   Created temporary directory: /tmp/pip-unpack-p99rjlx0
2024-12-29T01:59:27,124   Downloading alpaca_eval-0.6.6.tar.gz (391 kB)
2024-12-29T01:59:28,216   Added alpaca-eval==0.6.6 from https://files.pythonhosted.org/packages/10/62/3013b6f0357260c06d3965c20060714abcb27752240ff9f9b630fe2a48dd/alpaca_eval-0.6.6.tar.gz to build tracker '/tmp/pip-build-tracker-tsfmhksf'
2024-12-29T01:59:28,219   Running setup.py (path:/tmp/pip-wheel-f2x6ql_q/alpaca-eval_739d3d776da9417aa6fc9a07e94503e1/setup.py) egg_info for package alpaca-eval
2024-12-29T01:59:28,219   Created temporary directory: /tmp/pip-pip-egg-info-lco789bm
2024-12-29T01:59:28,220   Preparing metadata (setup.py): started
2024-12-29T01:59:28,222   Running command python setup.py egg_info
2024-12-29T01:59:29,308   running egg_info
2024-12-29T01:59:29,335   creating /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info
2024-12-29T01:59:29,336   writing /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/PKG-INFO
2024-12-29T01:59:29,355   writing dependency_links to /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/dependency_links.txt
2024-12-29T01:59:29,357   writing entry points to /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/entry_points.txt
2024-12-29T01:59:29,366   writing requirements to /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/requires.txt
2024-12-29T01:59:29,367   writing top-level names to /tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/top_level.txt
2024-12-29T01:59:29,368   writing manifest file '/tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/SOURCES.txt'
2024-12-29T01:59:29,457   reading manifest file '/tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/SOURCES.txt'
2024-12-29T01:59:29,459   reading manifest template 'MANIFEST.in'
2024-12-29T01:59:29,755   adding license file 'LICENSE'
2024-12-29T01:59:29,773   writing manifest file '/tmp/pip-pip-egg-info-lco789bm/alpaca_eval.egg-info/SOURCES.txt'
2024-12-29T01:59:29,883   Preparing metadata (setup.py): finished with status 'done'
2024-12-29T01:59:29,891   Source in /tmp/pip-wheel-f2x6ql_q/alpaca-eval_739d3d776da9417aa6fc9a07e94503e1 has version 0.6.6, which satisfies requirement alpaca-eval==0.6.6 from https://files.pythonhosted.org/packages/10/62/3013b6f0357260c06d3965c20060714abcb27752240ff9f9b630fe2a48dd/alpaca_eval-0.6.6.tar.gz
2024-12-29T01:59:29,892   Removed alpaca-eval==0.6.6 from https://files.pythonhosted.org/packages/10/62/3013b6f0357260c06d3965c20060714abcb27752240ff9f9b630fe2a48dd/alpaca_eval-0.6.6.tar.gz from build tracker '/tmp/pip-build-tracker-tsfmhksf'
2024-12-29T01:59:29,930 Created temporary directory: /tmp/pip-unpack-790o7_7e
2024-12-29T01:59:29,931 Created temporary directory: /tmp/pip-unpack-3poex9i5
2024-12-29T01:59:29,932 Building wheels for collected packages: alpaca-eval
2024-12-29T01:59:29,936   Created temporary directory: /tmp/pip-wheel-8ys5pya9
2024-12-29T01:59:29,937   Building wheel for alpaca-eval (setup.py): started
2024-12-29T01:59:29,938   Destination directory: /tmp/pip-wheel-8ys5pya9
2024-12-29T01:59:29,938   Running command python setup.py bdist_wheel
2024-12-29T01:59:31,169   running bdist_wheel
2024-12-29T01:59:31,298   running build
2024-12-29T01:59:31,299   running build_py
2024-12-29T01:59:31,328   creating build/lib/alpaca_eval
2024-12-29T01:59:31,331   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,334   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,336   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,339   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,340   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,343   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,346   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,348   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,350   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-12-29T01:59:31,354   creating build/lib/alpaca_eval/metrics
2024-12-29T01:59:31,355   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-12-29T01:59:31,357   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-12-29T01:59:31,359   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-12-29T01:59:31,361   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-12-29T01:59:31,364   creating build/lib/alpaca_eval/annotators
2024-12-29T01:59:31,365   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-12-29T01:59:31,367   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-12-29T01:59:31,369   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-12-29T01:59:31,373   creating build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,374   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,376   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,378   copying src/alpaca_eval/decoders/cache.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,379   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,381   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,383   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,385   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,387   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,389   copying src/alpaca_eval/decoders/test.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,391   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,394   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,396   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,398   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-12-29T01:59:31,400   running egg_info
2024-12-29T01:59:31,426   writing src/alpaca_eval.egg-info/PKG-INFO
2024-12-29T01:59:31,449   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-12-29T01:59:31,450   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-12-29T01:59:31,460   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-12-29T01:59:31,461   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-12-29T01:59:31,494   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-12-29T01:59:31,524   reading manifest template 'MANIFEST.in'
2024-12-29T01:59:31,763   adding license file 'LICENSE'
2024-12-29T01:59:31,789   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-12-29T01:59:31,793   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-12-29T01:59:31,794   !!

2024-12-29T01:59:31,795           ********************************************************************************
2024-12-29T01:59:31,796           ############################
2024-12-29T01:59:31,796           # Package would be ignored #
2024-12-29T01:59:31,797           ############################
2024-12-29T01:59:31,797           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-12-29T01:59:31,798           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,799           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,800           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-12-29T01:59:31,801           to the `packages` configuration field.

2024-12-29T01:59:31,802           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,802           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,803           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,804           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,805           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,806           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-12-29T01:59:31,807           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-12-29T01:59:31,808           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,809           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,811           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,812           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,813           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,813                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,814                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,814                 directory, all directories are treated like packages.
2024-12-29T01:59:31,814           ********************************************************************************

2024-12-29T01:59:31,815   !!
2024-12-29T01:59:31,816     check.warn(importable)
2024-12-29T01:59:31,816   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-12-29T01:59:31,817   !!

2024-12-29T01:59:31,818           ********************************************************************************
2024-12-29T01:59:31,818           ############################
2024-12-29T01:59:31,819           # Package would be ignored #
2024-12-29T01:59:31,819           ############################
2024-12-29T01:59:31,819           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-12-29T01:59:31,820           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,821           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,821           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-12-29T01:59:31,822           to the `packages` configuration field.

2024-12-29T01:59:31,823           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,823           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,824           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,825           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,826           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,827           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-12-29T01:59:31,828           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-12-29T01:59:31,828           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,829           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,829           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,830           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,831           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,833           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,833                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,834                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,834                 directory, all directories are treated like packages.
2024-12-29T01:59:31,835           ********************************************************************************

2024-12-29T01:59:31,836   !!
2024-12-29T01:59:31,836     check.warn(importable)
2024-12-29T01:59:31,837   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-12-29T01:59:31,838   !!

2024-12-29T01:59:31,839           ********************************************************************************
2024-12-29T01:59:31,839           ############################
2024-12-29T01:59:31,839           # Package would be ignored #
2024-12-29T01:59:31,840           ############################
2024-12-29T01:59:31,840           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-12-29T01:59:31,841           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,841           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,842           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-12-29T01:59:31,842           to the `packages` configuration field.

2024-12-29T01:59:31,843           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,843           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,843           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,844           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,845           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,846           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-12-29T01:59:31,846           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-12-29T01:59:31,846           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,847           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,848           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,849           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,851           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,852                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,852                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,853                 directory, all directories are treated like packages.
2024-12-29T01:59:31,853           ********************************************************************************

2024-12-29T01:59:31,855   !!
2024-12-29T01:59:31,855     check.warn(importable)
2024-12-29T01:59:31,856   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-12-29T01:59:31,856   !!

2024-12-29T01:59:31,857           ********************************************************************************
2024-12-29T01:59:31,858           ############################
2024-12-29T01:59:31,858           # Package would be ignored #
2024-12-29T01:59:31,859           ############################
2024-12-29T01:59:31,859           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-12-29T01:59:31,859           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,861           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,861           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-12-29T01:59:31,862           to the `packages` configuration field.

2024-12-29T01:59:31,863           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,864           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,864           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,865           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,866           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,866           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-12-29T01:59:31,867           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-12-29T01:59:31,867           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,867           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,868           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,869           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,869           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,870           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,871                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,871                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,871                 directory, all directories are treated like packages.
2024-12-29T01:59:31,872           ********************************************************************************

2024-12-29T01:59:31,873   !!
2024-12-29T01:59:31,873     check.warn(importable)
2024-12-29T01:59:31,874   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:31,874   !!

2024-12-29T01:59:31,875           ********************************************************************************
2024-12-29T01:59:31,876           ############################
2024-12-29T01:59:31,877           # Package would be ignored #
2024-12-29T01:59:31,877           ############################
2024-12-29T01:59:31,878           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-12-29T01:59:31,879           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,880           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,880           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-12-29T01:59:31,881           to the `packages` configuration field.

2024-12-29T01:59:31,882           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,882           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,883           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,884           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,885           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,886           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-12-29T01:59:31,886           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-12-29T01:59:31,888           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,889           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,889           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,890           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,892           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,893           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,894                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,894                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,894                 directory, all directories are treated like packages.
2024-12-29T01:59:31,895           ********************************************************************************

2024-12-29T01:59:31,895   !!
2024-12-29T01:59:31,896     check.warn(importable)
2024-12-29T01:59:31,896   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-12-29T01:59:31,897   !!

2024-12-29T01:59:31,897           ********************************************************************************
2024-12-29T01:59:31,898           ############################
2024-12-29T01:59:31,898           # Package would be ignored #
2024-12-29T01:59:31,898           ############################
2024-12-29T01:59:31,899           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-12-29T01:59:31,899           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,900           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,900           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-12-29T01:59:31,901           to the `packages` configuration field.

2024-12-29T01:59:31,902           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,902           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,903           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,904           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,905           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,906           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-12-29T01:59:31,906           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-12-29T01:59:31,907           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,908           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,908           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,909           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,910           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,912           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,912                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,913                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,913                 directory, all directories are treated like packages.
2024-12-29T01:59:31,914           ********************************************************************************

2024-12-29T01:59:31,915   !!
2024-12-29T01:59:31,915     check.warn(importable)
2024-12-29T01:59:31,916   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-12-29T01:59:31,916   !!

2024-12-29T01:59:31,917           ********************************************************************************
2024-12-29T01:59:31,918           ############################
2024-12-29T01:59:31,919           # Package would be ignored #
2024-12-29T01:59:31,919           ############################
2024-12-29T01:59:31,919           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-12-29T01:59:31,920           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,920           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,921           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-12-29T01:59:31,921           to the `packages` configuration field.

2024-12-29T01:59:31,922           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,922           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,922           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,923           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,924           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,925           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-12-29T01:59:31,925           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-12-29T01:59:31,925           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,926           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,926           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,927           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,928           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,929           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,930                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,930                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,931                 directory, all directories are treated like packages.
2024-12-29T01:59:31,931           ********************************************************************************

2024-12-29T01:59:31,933   !!
2024-12-29T01:59:31,933     check.warn(importable)
2024-12-29T01:59:31,934   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-12-29T01:59:31,934   !!

2024-12-29T01:59:31,935           ********************************************************************************
2024-12-29T01:59:31,936           ############################
2024-12-29T01:59:31,936           # Package would be ignored #
2024-12-29T01:59:31,937           ############################
2024-12-29T01:59:31,937           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-12-29T01:59:31,938           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,939           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,939           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-12-29T01:59:31,939           to the `packages` configuration field.

2024-12-29T01:59:31,941           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,941           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,942           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,943           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,944           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,945           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-12-29T01:59:31,946           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-12-29T01:59:31,946           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,946           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,946           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,947           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,948           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,949           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,949                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,950                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,950                 directory, all directories are treated like packages.
2024-12-29T01:59:31,950           ********************************************************************************

2024-12-29T01:59:31,951   !!
2024-12-29T01:59:31,951     check.warn(importable)
2024-12-29T01:59:31,952   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-12-29T01:59:31,952   !!

2024-12-29T01:59:31,953           ********************************************************************************
2024-12-29T01:59:31,953           ############################
2024-12-29T01:59:31,954           # Package would be ignored #
2024-12-29T01:59:31,954           ############################
2024-12-29T01:59:31,955           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-12-29T01:59:31,956           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,957           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,957           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-12-29T01:59:31,958           to the `packages` configuration field.

2024-12-29T01:59:31,959           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,960           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,960           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,961           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,962           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,963           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-12-29T01:59:31,964           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-12-29T01:59:31,964           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,965           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,965           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,966           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,967           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,969           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,969                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,970                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,970                 directory, all directories are treated like packages.
2024-12-29T01:59:31,971           ********************************************************************************

2024-12-29T01:59:31,971   !!
2024-12-29T01:59:31,972     check.warn(importable)
2024-12-29T01:59:31,972   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is absent from the `packages` configuration.
2024-12-29T01:59:31,973   !!

2024-12-29T01:59:31,973           ********************************************************************************
2024-12-29T01:59:31,974           ############################
2024-12-29T01:59:31,974           # Package would be ignored #
2024-12-29T01:59:31,974           ############################
2024-12-29T01:59:31,975           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' as an importable package[^1],
2024-12-29T01:59:31,975           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,976           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,976           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' is explicitly added
2024-12-29T01:59:31,977           to the `packages` configuration field.

2024-12-29T01:59:31,977           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,978           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,978           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,979           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:31,980           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:31,981           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' to be distributed and are
2024-12-29T01:59:31,982           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_llama3_70b_fn' via
2024-12-29T01:59:31,982           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:31,983           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:31,983           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:31,984           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:31,986           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:31,987           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:31,987                 even if it does not contain any `.py` files.
2024-12-29T01:59:31,988                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:31,988                 directory, all directories are treated like packages.
2024-12-29T01:59:31,989           ********************************************************************************

2024-12-29T01:59:31,990   !!
2024-12-29T01:59:31,990     check.warn(importable)
2024-12-29T01:59:31,991   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' is absent from the `packages` configuration.
2024-12-29T01:59:31,991   !!

2024-12-29T01:59:31,992           ********************************************************************************
2024-12-29T01:59:31,993           ############################
2024-12-29T01:59:31,993           # Package would be ignored #
2024-12-29T01:59:31,994           ############################
2024-12-29T01:59:31,994           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' as an importable package[^1],
2024-12-29T01:59:31,995           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:31,996           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:31,997           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' is explicitly added
2024-12-29T01:59:31,997           to the `packages` configuration field.

2024-12-29T01:59:31,998           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:31,998           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:31,998           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:31,999           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,000           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,001           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' to be distributed and are
2024-12-29T01:59:32,001           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_vllm_llama3_70b_fn' via
2024-12-29T01:59:32,001           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,002           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,002           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,003           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,004           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,005           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,006                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,006                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,007                 directory, all directories are treated like packages.
2024-12-29T01:59:32,007           ********************************************************************************

2024-12-29T01:59:32,008   !!
2024-12-29T01:59:32,009     check.warn(importable)
2024-12-29T01:59:32,010   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-12-29T01:59:32,010   !!

2024-12-29T01:59:32,011           ********************************************************************************
2024-12-29T01:59:32,012           ############################
2024-12-29T01:59:32,012           # Package would be ignored #
2024-12-29T01:59:32,013           ############################
2024-12-29T01:59:32,013           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-12-29T01:59:32,014           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,015           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,015           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-12-29T01:59:32,016           to the `packages` configuration field.

2024-12-29T01:59:32,017           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,017           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,018           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,019           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,020           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,021           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-12-29T01:59:32,021           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-12-29T01:59:32,022           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,023           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,023           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,024           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,025           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,026                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,026                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,026                 directory, all directories are treated like packages.
2024-12-29T01:59:32,027           ********************************************************************************

2024-12-29T01:59:32,028   !!
2024-12-29T01:59:32,028     check.warn(importable)
2024-12-29T01:59:32,028   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,029   !!

2024-12-29T01:59:32,030           ********************************************************************************
2024-12-29T01:59:32,030           ############################
2024-12-29T01:59:32,031           # Package would be ignored #
2024-12-29T01:59:32,031           ############################
2024-12-29T01:59:32,032           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-12-29T01:59:32,032           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,033           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,034           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-12-29T01:59:32,034           to the `packages` configuration field.

2024-12-29T01:59:32,035           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,036           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,036           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,037           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,038           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,039           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-12-29T01:59:32,040           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-12-29T01:59:32,040           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,041           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,041           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,042           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,043           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,045           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,045                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,046                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,046                 directory, all directories are treated like packages.
2024-12-29T01:59:32,047           ********************************************************************************

2024-12-29T01:59:32,048   !!
2024-12-29T01:59:32,049     check.warn(importable)
2024-12-29T01:59:32,049   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,049   !!

2024-12-29T01:59:32,050           ********************************************************************************
2024-12-29T01:59:32,050           ############################
2024-12-29T01:59:32,051           # Package would be ignored #
2024-12-29T01:59:32,051           ############################
2024-12-29T01:59:32,051           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-12-29T01:59:32,052           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,053           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,053           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-12-29T01:59:32,053           to the `packages` configuration field.

2024-12-29T01:59:32,054           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,054           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,055           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,056           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,057           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,057           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-12-29T01:59:32,058           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-12-29T01:59:32,058           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,059           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,059           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,060           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,061           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,063           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,063                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,064                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,064                 directory, all directories are treated like packages.
2024-12-29T01:59:32,065           ********************************************************************************

2024-12-29T01:59:32,066   !!
2024-12-29T01:59:32,066     check.warn(importable)
2024-12-29T01:59:32,067   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-12-29T01:59:32,067   !!

2024-12-29T01:59:32,068           ********************************************************************************
2024-12-29T01:59:32,069           ############################
2024-12-29T01:59:32,069           # Package would be ignored #
2024-12-29T01:59:32,070           ############################
2024-12-29T01:59:32,070           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-12-29T01:59:32,071           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,072           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,072           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-12-29T01:59:32,073           to the `packages` configuration field.

2024-12-29T01:59:32,074           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,074           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,075           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,075           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,076           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,077           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-12-29T01:59:32,077           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-12-29T01:59:32,078           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,078           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,078           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,079           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,080           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,081           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,081                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,082                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,082                 directory, all directories are treated like packages.
2024-12-29T01:59:32,083           ********************************************************************************

2024-12-29T01:59:32,084   !!
2024-12-29T01:59:32,084     check.warn(importable)
2024-12-29T01:59:32,085   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-12-29T01:59:32,085   !!

2024-12-29T01:59:32,086           ********************************************************************************
2024-12-29T01:59:32,087           ############################
2024-12-29T01:59:32,088           # Package would be ignored #
2024-12-29T01:59:32,088           ############################
2024-12-29T01:59:32,089           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-12-29T01:59:32,089           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,090           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,091           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-12-29T01:59:32,091           to the `packages` configuration field.

2024-12-29T01:59:32,092           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,093           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,093           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,094           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,095           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,096           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-12-29T01:59:32,096           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-12-29T01:59:32,097           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,097           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,098           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,100           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,101           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,102           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,102                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,103                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,103                 directory, all directories are treated like packages.
2024-12-29T01:59:32,103           ********************************************************************************

2024-12-29T01:59:32,104   !!
2024-12-29T01:59:32,105     check.warn(importable)
2024-12-29T01:59:32,105   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-12-29T01:59:32,105   !!

2024-12-29T01:59:32,106           ********************************************************************************
2024-12-29T01:59:32,106           ############################
2024-12-29T01:59:32,107           # Package would be ignored #
2024-12-29T01:59:32,107           ############################
2024-12-29T01:59:32,107           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-12-29T01:59:32,108           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,109           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,109           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-12-29T01:59:32,110           to the `packages` configuration field.

2024-12-29T01:59:32,111           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,111           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,112           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,113           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,114           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,115           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-12-29T01:59:32,115           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-12-29T01:59:32,116           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,116           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,117           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,118           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,118           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,120           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,120                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,121                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,121                 directory, all directories are treated like packages.
2024-12-29T01:59:32,122           ********************************************************************************

2024-12-29T01:59:32,123   !!
2024-12-29T01:59:32,123     check.warn(importable)
2024-12-29T01:59:32,124   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-12-29T01:59:32,124   !!

2024-12-29T01:59:32,125           ********************************************************************************
2024-12-29T01:59:32,126           ############################
2024-12-29T01:59:32,127           # Package would be ignored #
2024-12-29T01:59:32,127           ############################
2024-12-29T01:59:32,127           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-12-29T01:59:32,128           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,129           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,130           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-12-29T01:59:32,130           to the `packages` configuration field.

2024-12-29T01:59:32,131           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,131           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,131           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,132           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,133           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,134           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-12-29T01:59:32,134           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-12-29T01:59:32,134           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,135           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,135           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,136           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,137           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,139           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,139                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,140                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,141                 directory, all directories are treated like packages.
2024-12-29T01:59:32,141           ********************************************************************************

2024-12-29T01:59:32,142   !!
2024-12-29T01:59:32,143     check.warn(importable)
2024-12-29T01:59:32,144   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-12-29T01:59:32,144   !!

2024-12-29T01:59:32,145           ********************************************************************************
2024-12-29T01:59:32,146           ############################
2024-12-29T01:59:32,146           # Package would be ignored #
2024-12-29T01:59:32,147           ############################
2024-12-29T01:59:32,147           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-12-29T01:59:32,148           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,149           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,149           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-12-29T01:59:32,150           to the `packages` configuration field.

2024-12-29T01:59:32,151           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,151           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,152           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,153           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,154           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,155           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-12-29T01:59:32,155           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-12-29T01:59:32,155           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,156           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,156           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,157           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,158           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,159           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,159                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,159                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,160                 directory, all directories are treated like packages.
2024-12-29T01:59:32,160           ********************************************************************************

2024-12-29T01:59:32,161   !!
2024-12-29T01:59:32,161     check.warn(importable)
2024-12-29T01:59:32,162   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-12-29T01:59:32,162   !!

2024-12-29T01:59:32,163           ********************************************************************************
2024-12-29T01:59:32,164           ############################
2024-12-29T01:59:32,164           # Package would be ignored #
2024-12-29T01:59:32,165           ############################
2024-12-29T01:59:32,165           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-12-29T01:59:32,166           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,167           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,167           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-12-29T01:59:32,168           to the `packages` configuration field.

2024-12-29T01:59:32,169           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,170           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,171           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,172           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,173           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,174           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-12-29T01:59:32,174           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-12-29T01:59:32,175           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,175           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,176           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,177           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,178           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,180           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,180                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,181                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,181                 directory, all directories are treated like packages.
2024-12-29T01:59:32,182           ********************************************************************************

2024-12-29T01:59:32,183   !!
2024-12-29T01:59:32,183     check.warn(importable)
2024-12-29T01:59:32,184   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-12-29T01:59:32,184   !!

2024-12-29T01:59:32,185           ********************************************************************************
2024-12-29T01:59:32,185           ############################
2024-12-29T01:59:32,185           # Package would be ignored #
2024-12-29T01:59:32,186           ############################
2024-12-29T01:59:32,186           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-12-29T01:59:32,186           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,187           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,187           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-12-29T01:59:32,188           to the `packages` configuration field.

2024-12-29T01:59:32,189           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,189           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,189           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,190           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,192           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,193           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-12-29T01:59:32,193           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-12-29T01:59:32,194           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,194           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,195           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,196           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,197           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,199           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,199                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,200                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,200                 directory, all directories are treated like packages.
2024-12-29T01:59:32,201           ********************************************************************************

2024-12-29T01:59:32,202   !!
2024-12-29T01:59:32,202     check.warn(importable)
2024-12-29T01:59:32,203   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-12-29T01:59:32,203   !!

2024-12-29T01:59:32,204           ********************************************************************************
2024-12-29T01:59:32,205           ############################
2024-12-29T01:59:32,205           # Package would be ignored #
2024-12-29T01:59:32,206           ############################
2024-12-29T01:59:32,206           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-12-29T01:59:32,207           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,208           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,209           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-12-29T01:59:32,210           to the `packages` configuration field.

2024-12-29T01:59:32,210           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,211           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,211           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,212           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,213           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,213           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-12-29T01:59:32,214           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-12-29T01:59:32,214           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,214           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,215           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,216           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,217           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,218           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,218                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,219                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,219                 directory, all directories are treated like packages.
2024-12-29T01:59:32,220           ********************************************************************************

2024-12-29T01:59:32,221   !!
2024-12-29T01:59:32,221     check.warn(importable)
2024-12-29T01:59:32,221   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-12-29T01:59:32,222   !!

2024-12-29T01:59:32,223           ********************************************************************************
2024-12-29T01:59:32,224           ############################
2024-12-29T01:59:32,224           # Package would be ignored #
2024-12-29T01:59:32,225           ############################
2024-12-29T01:59:32,225           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-12-29T01:59:32,226           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,227           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,227           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-12-29T01:59:32,228           to the `packages` configuration field.

2024-12-29T01:59:32,229           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,229           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,230           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,231           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,232           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,233           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-12-29T01:59:32,233           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-12-29T01:59:32,234           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,234           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,235           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,236           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,237           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,238           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,238                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,239                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,239                 directory, all directories are treated like packages.
2024-12-29T01:59:32,239           ********************************************************************************

2024-12-29T01:59:32,240   !!
2024-12-29T01:59:32,240     check.warn(importable)
2024-12-29T01:59:32,241   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-12-29T01:59:32,241   !!

2024-12-29T01:59:32,242           ********************************************************************************
2024-12-29T01:59:32,242           ############################
2024-12-29T01:59:32,242           # Package would be ignored #
2024-12-29T01:59:32,243           ############################
2024-12-29T01:59:32,243           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-12-29T01:59:32,243           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,244           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,245           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-12-29T01:59:32,245           to the `packages` configuration field.

2024-12-29T01:59:32,247           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,247           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,248           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,249           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,250           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,251           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-12-29T01:59:32,252           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-12-29T01:59:32,252           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,253           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,253           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,254           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,255           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,256           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,257                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,257                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,258                 directory, all directories are treated like packages.
2024-12-29T01:59:32,258           ********************************************************************************

2024-12-29T01:59:32,259   !!
2024-12-29T01:59:32,260     check.warn(importable)
2024-12-29T01:59:32,260   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,261   !!

2024-12-29T01:59:32,262           ********************************************************************************
2024-12-29T01:59:32,262           ############################
2024-12-29T01:59:32,263           # Package would be ignored #
2024-12-29T01:59:32,263           ############################
2024-12-29T01:59:32,263           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-12-29T01:59:32,264           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,265           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,265           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-12-29T01:59:32,265           to the `packages` configuration field.

2024-12-29T01:59:32,266           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,266           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,267           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,267           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,268           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,269           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-12-29T01:59:32,269           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-12-29T01:59:32,270           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,270           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,271           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,272           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,273           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,274           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,275                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,275                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,276                 directory, all directories are treated like packages.
2024-12-29T01:59:32,277           ********************************************************************************

2024-12-29T01:59:32,278   !!
2024-12-29T01:59:32,278     check.warn(importable)
2024-12-29T01:59:32,279   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-12-29T01:59:32,280   !!

2024-12-29T01:59:32,281           ********************************************************************************
2024-12-29T01:59:32,281           ############################
2024-12-29T01:59:32,282           # Package would be ignored #
2024-12-29T01:59:32,282           ############################
2024-12-29T01:59:32,283           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-12-29T01:59:32,283           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,284           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,285           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-12-29T01:59:32,285           to the `packages` configuration field.

2024-12-29T01:59:32,286           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,287           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,287           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,289           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,290           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,290           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-12-29T01:59:32,291           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-12-29T01:59:32,291           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,291           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,292           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,293           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,293           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,294           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,295                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,295                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,295                 directory, all directories are treated like packages.
2024-12-29T01:59:32,296           ********************************************************************************

2024-12-29T01:59:32,297   !!
2024-12-29T01:59:32,297     check.warn(importable)
2024-12-29T01:59:32,297   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-12-29T01:59:32,298   !!

2024-12-29T01:59:32,299           ********************************************************************************
2024-12-29T01:59:32,299           ############################
2024-12-29T01:59:32,300           # Package would be ignored #
2024-12-29T01:59:32,300           ############################
2024-12-29T01:59:32,301           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-12-29T01:59:32,302           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,303           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,303           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-12-29T01:59:32,304           to the `packages` configuration field.

2024-12-29T01:59:32,305           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,305           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,306           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,307           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,308           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,309           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-12-29T01:59:32,309           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-12-29T01:59:32,310           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,310           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,311           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,312           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,313           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,314           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,315                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,316                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,316                 directory, all directories are treated like packages.
2024-12-29T01:59:32,317           ********************************************************************************

2024-12-29T01:59:32,317   !!
2024-12-29T01:59:32,318     check.warn(importable)
2024-12-29T01:59:32,318   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-12-29T01:59:32,318   !!

2024-12-29T01:59:32,319           ********************************************************************************
2024-12-29T01:59:32,320           ############################
2024-12-29T01:59:32,321           # Package would be ignored #
2024-12-29T01:59:32,321           ############################
2024-12-29T01:59:32,322           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-12-29T01:59:32,322           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,323           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,323           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-12-29T01:59:32,324           to the `packages` configuration field.

2024-12-29T01:59:32,325           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,325           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,326           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,327           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,328           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,329           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-12-29T01:59:32,330           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-12-29T01:59:32,330           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,331           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,331           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,332           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,334           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,335           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,335                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,336                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,336                 directory, all directories are treated like packages.
2024-12-29T01:59:32,337           ********************************************************************************

2024-12-29T01:59:32,337   !!
2024-12-29T01:59:32,338     check.warn(importable)
2024-12-29T01:59:32,338   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-12-29T01:59:32,339   !!

2024-12-29T01:59:32,340           ********************************************************************************
2024-12-29T01:59:32,340           ############################
2024-12-29T01:59:32,341           # Package would be ignored #
2024-12-29T01:59:32,341           ############################
2024-12-29T01:59:32,342           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-12-29T01:59:32,343           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,344           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,344           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-12-29T01:59:32,345           to the `packages` configuration field.

2024-12-29T01:59:32,345           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,346           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,347           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,348           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,349           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,350           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-12-29T01:59:32,350           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-12-29T01:59:32,351           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,351           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,352           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,353           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,354           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,356           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,357                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,358                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,359                 directory, all directories are treated like packages.
2024-12-29T01:59:32,360           ********************************************************************************

2024-12-29T01:59:32,361   !!
2024-12-29T01:59:32,362     check.warn(importable)
2024-12-29T01:59:32,362   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-12-29T01:59:32,363   !!

2024-12-29T01:59:32,365           ********************************************************************************
2024-12-29T01:59:32,366           ############################
2024-12-29T01:59:32,367           # Package would be ignored #
2024-12-29T01:59:32,368           ############################
2024-12-29T01:59:32,368           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-12-29T01:59:32,369           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,370           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,371           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-12-29T01:59:32,371           to the `packages` configuration field.

2024-12-29T01:59:32,373           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,373           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,374           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,375           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,377           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,378           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-12-29T01:59:32,379           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-12-29T01:59:32,380           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,380           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,381           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,382           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,383           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,384           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,385                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,385                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,386                 directory, all directories are treated like packages.
2024-12-29T01:59:32,386           ********************************************************************************

2024-12-29T01:59:32,387   !!
2024-12-29T01:59:32,388     check.warn(importable)
2024-12-29T01:59:32,388   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-12-29T01:59:32,389   !!

2024-12-29T01:59:32,390           ********************************************************************************
2024-12-29T01:59:32,390           ############################
2024-12-29T01:59:32,391           # Package would be ignored #
2024-12-29T01:59:32,392           ############################
2024-12-29T01:59:32,392           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-12-29T01:59:32,393           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,394           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,395           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-12-29T01:59:32,396           to the `packages` configuration field.

2024-12-29T01:59:32,397           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,398           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,398           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,400           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,401           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,403           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-12-29T01:59:32,403           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-12-29T01:59:32,404           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,405           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,405           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,406           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,408           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,410           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,411                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,411                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,413                 directory, all directories are treated like packages.
2024-12-29T01:59:32,413           ********************************************************************************

2024-12-29T01:59:32,415   !!
2024-12-29T01:59:32,416     check.warn(importable)
2024-12-29T01:59:32,416   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,417   !!

2024-12-29T01:59:32,418           ********************************************************************************
2024-12-29T01:59:32,419           ############################
2024-12-29T01:59:32,419           # Package would be ignored #
2024-12-29T01:59:32,420           ############################
2024-12-29T01:59:32,420           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-12-29T01:59:32,421           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,422           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,422           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-12-29T01:59:32,423           to the `packages` configuration field.

2024-12-29T01:59:32,424           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,424           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,425           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,426           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,427           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,428           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-12-29T01:59:32,429           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-12-29T01:59:32,430           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,430           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,431           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,432           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,434           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,436           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,436                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,437                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,438                 directory, all directories are treated like packages.
2024-12-29T01:59:32,439           ********************************************************************************

2024-12-29T01:59:32,440   !!
2024-12-29T01:59:32,440     check.warn(importable)
2024-12-29T01:59:32,441   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,442   !!

2024-12-29T01:59:32,443           ********************************************************************************
2024-12-29T01:59:32,443           ############################
2024-12-29T01:59:32,444           # Package would be ignored #
2024-12-29T01:59:32,445           ############################
2024-12-29T01:59:32,446           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-12-29T01:59:32,446           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,448           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,448           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-12-29T01:59:32,449           to the `packages` configuration field.

2024-12-29T01:59:32,450           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,451           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,451           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,452           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,453           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,454           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-12-29T01:59:32,455           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-12-29T01:59:32,455           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,456           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,456           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,457           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,458           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,460           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,460                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,461                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,461                 directory, all directories are treated like packages.
2024-12-29T01:59:32,462           ********************************************************************************

2024-12-29T01:59:32,463   !!
2024-12-29T01:59:32,464     check.warn(importable)
2024-12-29T01:59:32,465   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,465   !!

2024-12-29T01:59:32,467           ********************************************************************************
2024-12-29T01:59:32,467           ############################
2024-12-29T01:59:32,468           # Package would be ignored #
2024-12-29T01:59:32,469           ############################
2024-12-29T01:59:32,470           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-12-29T01:59:32,470           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,472           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,472           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-12-29T01:59:32,473           to the `packages` configuration field.

2024-12-29T01:59:32,474           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,475           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,475           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,476           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,478           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,479           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-12-29T01:59:32,480           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-12-29T01:59:32,480           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,481           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,482           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,484           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,485           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,486           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,487                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,487                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,488                 directory, all directories are treated like packages.
2024-12-29T01:59:32,488           ********************************************************************************

2024-12-29T01:59:32,489   !!
2024-12-29T01:59:32,489     check.warn(importable)
2024-12-29T01:59:32,490   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-12-29T01:59:32,490   !!

2024-12-29T01:59:32,491           ********************************************************************************
2024-12-29T01:59:32,492           ############################
2024-12-29T01:59:32,492           # Package would be ignored #
2024-12-29T01:59:32,493           ############################
2024-12-29T01:59:32,493           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-12-29T01:59:32,494           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,495           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,495           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-12-29T01:59:32,496           to the `packages` configuration field.

2024-12-29T01:59:32,497           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,498           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,498           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,500           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,501           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,502           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-12-29T01:59:32,503           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-12-29T01:59:32,503           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,504           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,505           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,506           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,507           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,509           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,510                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,510                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,511                 directory, all directories are treated like packages.
2024-12-29T01:59:32,512           ********************************************************************************

2024-12-29T01:59:32,513   !!
2024-12-29T01:59:32,514     check.warn(importable)
2024-12-29T01:59:32,514   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-12-29T01:59:32,515   !!

2024-12-29T01:59:32,516           ********************************************************************************
2024-12-29T01:59:32,517           ############################
2024-12-29T01:59:32,518           # Package would be ignored #
2024-12-29T01:59:32,518           ############################
2024-12-29T01:59:32,519           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-12-29T01:59:32,519           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,520           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,521           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-12-29T01:59:32,521           to the `packages` configuration field.

2024-12-29T01:59:32,522           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,523           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,524           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,525           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,526           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-12-29T01:59:32,526           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-12-29T01:59:32,527           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,527           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,528           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,529           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,530           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,532           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,532                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,533                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,533                 directory, all directories are treated like packages.
2024-12-29T01:59:32,534           ********************************************************************************

2024-12-29T01:59:32,535   !!
2024-12-29T01:59:32,536     check.warn(importable)
2024-12-29T01:59:32,536   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-12-29T01:59:32,537   !!

2024-12-29T01:59:32,538           ********************************************************************************
2024-12-29T01:59:32,538           ############################
2024-12-29T01:59:32,539           # Package would be ignored #
2024-12-29T01:59:32,540           ############################
2024-12-29T01:59:32,540           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-12-29T01:59:32,541           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,542           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,542           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-12-29T01:59:32,543           to the `packages` configuration field.

2024-12-29T01:59:32,544           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,545           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,546           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,547           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,549           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,549           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-12-29T01:59:32,550           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-12-29T01:59:32,550           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,550           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,551           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,551           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,552           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,553           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,554                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,554                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,554                 directory, all directories are treated like packages.
2024-12-29T01:59:32,555           ********************************************************************************

2024-12-29T01:59:32,555   !!
2024-12-29T01:59:32,556     check.warn(importable)
2024-12-29T01:59:32,556   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-12-29T01:59:32,557   !!

2024-12-29T01:59:32,558           ********************************************************************************
2024-12-29T01:59:32,558           ############################
2024-12-29T01:59:32,559           # Package would be ignored #
2024-12-29T01:59:32,559           ############################
2024-12-29T01:59:32,560           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-12-29T01:59:32,560           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,561           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,562           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-12-29T01:59:32,562           to the `packages` configuration field.

2024-12-29T01:59:32,563           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,564           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,565           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,566           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,567           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,568           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-12-29T01:59:32,568           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-12-29T01:59:32,569           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,569           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,570           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,571           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,572           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,574           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,574                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,575                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,575                 directory, all directories are treated like packages.
2024-12-29T01:59:32,576           ********************************************************************************

2024-12-29T01:59:32,577   !!
2024-12-29T01:59:32,577     check.warn(importable)
2024-12-29T01:59:32,577   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-12-29T01:59:32,578   !!

2024-12-29T01:59:32,578           ********************************************************************************
2024-12-29T01:59:32,579           ############################
2024-12-29T01:59:32,579           # Package would be ignored #
2024-12-29T01:59:32,579           ############################
2024-12-29T01:59:32,580           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-12-29T01:59:32,580           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,581           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,581           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-12-29T01:59:32,582           to the `packages` configuration field.

2024-12-29T01:59:32,582           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,583           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,583           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,584           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,585           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,586           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-12-29T01:59:32,587           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-12-29T01:59:32,587           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,588           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,589           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,589           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,590           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,592           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,592                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,593                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,593                 directory, all directories are treated like packages.
2024-12-29T01:59:32,594           ********************************************************************************

2024-12-29T01:59:32,595   !!
2024-12-29T01:59:32,595     check.warn(importable)
2024-12-29T01:59:32,595   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is absent from the `packages` configuration.
2024-12-29T01:59:32,596   !!

2024-12-29T01:59:32,597           ********************************************************************************
2024-12-29T01:59:32,597           ############################
2024-12-29T01:59:32,598           # Package would be ignored #
2024-12-29T01:59:32,598           ############################
2024-12-29T01:59:32,599           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' as an importable package[^1],
2024-12-29T01:59:32,600           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,601           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,601           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is explicitly added
2024-12-29T01:59:32,602           to the `packages` configuration field.

2024-12-29T01:59:32,603           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,603           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,603           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,604           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,606           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' to be distributed and are
2024-12-29T01:59:32,606           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' via
2024-12-29T01:59:32,606           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,607           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,607           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,608           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,609           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,611           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,611                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,612                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,613                 directory, all directories are treated like packages.
2024-12-29T01:59:32,613           ********************************************************************************

2024-12-29T01:59:32,614   !!
2024-12-29T01:59:32,615     check.warn(importable)
2024-12-29T01:59:32,615   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_vllm_llama3_70b' is absent from the `packages` configuration.
2024-12-29T01:59:32,616   !!

2024-12-29T01:59:32,617           ********************************************************************************
2024-12-29T01:59:32,617           ############################
2024-12-29T01:59:32,618           # Package would be ignored #
2024-12-29T01:59:32,618           ############################
2024-12-29T01:59:32,619           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_vllm_llama3_70b' as an importable package[^1],
2024-12-29T01:59:32,619           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,620           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,621           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_vllm_llama3_70b' is explicitly added
2024-12-29T01:59:32,621           to the `packages` configuration field.

2024-12-29T01:59:32,622           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,623           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,623           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,624           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,626           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,627           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_vllm_llama3_70b' to be distributed and are
2024-12-29T01:59:32,627           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_vllm_llama3_70b' via
2024-12-29T01:59:32,628           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,628           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,629           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,629           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,630           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,631           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,631                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,632                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,632                 directory, all directories are treated like packages.
2024-12-29T01:59:32,633           ********************************************************************************

2024-12-29T01:59:32,633   !!
2024-12-29T01:59:32,634     check.warn(importable)
2024-12-29T01:59:32,634   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-12-29T01:59:32,634   !!

2024-12-29T01:59:32,635           ********************************************************************************
2024-12-29T01:59:32,636           ############################
2024-12-29T01:59:32,636           # Package would be ignored #
2024-12-29T01:59:32,637           ############################
2024-12-29T01:59:32,637           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-12-29T01:59:32,637           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,638           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,639           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-12-29T01:59:32,639           to the `packages` configuration field.

2024-12-29T01:59:32,640           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,641           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,642           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,643           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,644           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,645           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-12-29T01:59:32,645           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-12-29T01:59:32,646           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,646           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,646           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,647           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,648           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,650           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,650                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,651                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,652                 directory, all directories are treated like packages.
2024-12-29T01:59:32,653           ********************************************************************************

2024-12-29T01:59:32,653   !!
2024-12-29T01:59:32,654     check.warn(importable)
2024-12-29T01:59:32,654   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-12-29T01:59:32,654   !!

2024-12-29T01:59:32,655           ********************************************************************************
2024-12-29T01:59:32,656           ############################
2024-12-29T01:59:32,656           # Package would be ignored #
2024-12-29T01:59:32,657           ############################
2024-12-29T01:59:32,657           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-12-29T01:59:32,657           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,658           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,659           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-12-29T01:59:32,659           to the `packages` configuration field.

2024-12-29T01:59:32,660           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,660           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,661           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,661           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,662           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,663           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-12-29T01:59:32,664           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-12-29T01:59:32,664           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,665           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,665           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,666           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,667           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,669           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,669                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,670                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,670                 directory, all directories are treated like packages.
2024-12-29T01:59:32,671           ********************************************************************************

2024-12-29T01:59:32,672   !!
2024-12-29T01:59:32,672     check.warn(importable)
2024-12-29T01:59:32,673   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-12-29T01:59:32,673   !!

2024-12-29T01:59:32,674           ********************************************************************************
2024-12-29T01:59:32,675           ############################
2024-12-29T01:59:32,675           # Package would be ignored #
2024-12-29T01:59:32,676           ############################
2024-12-29T01:59:32,676           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-12-29T01:59:32,677           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,678           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,678           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-12-29T01:59:32,679           to the `packages` configuration field.

2024-12-29T01:59:32,680           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,680           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,681           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,681           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,682           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,683           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-12-29T01:59:32,683           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-12-29T01:59:32,683           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,684           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,684           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,685           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,685           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,687           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,687                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,687                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,688                 directory, all directories are treated like packages.
2024-12-29T01:59:32,688           ********************************************************************************

2024-12-29T01:59:32,689   !!
2024-12-29T01:59:32,689     check.warn(importable)
2024-12-29T01:59:32,690   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-12-29T01:59:32,690   !!

2024-12-29T01:59:32,691           ********************************************************************************
2024-12-29T01:59:32,692           ############################
2024-12-29T01:59:32,693           # Package would be ignored #
2024-12-29T01:59:32,693           ############################
2024-12-29T01:59:32,694           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-12-29T01:59:32,694           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,695           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,696           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-12-29T01:59:32,696           to the `packages` configuration field.

2024-12-29T01:59:32,697           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,698           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,698           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,699           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,700           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,701           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-12-29T01:59:32,701           already explicitly excluding 'alpaca_eval.models_configs' via
2024-12-29T01:59:32,702           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,702           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,703           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,704           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,705           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,706           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,706                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,707                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,707                 directory, all directories are treated like packages.
2024-12-29T01:59:32,707           ********************************************************************************

2024-12-29T01:59:32,708   !!
2024-12-29T01:59:32,709     check.warn(importable)
2024-12-29T01:59:32,709   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.NullModel' is absent from the `packages` configuration.
2024-12-29T01:59:32,709   !!

2024-12-29T01:59:32,710           ********************************************************************************
2024-12-29T01:59:32,710           ############################
2024-12-29T01:59:32,711           # Package would be ignored #
2024-12-29T01:59:32,711           ############################
2024-12-29T01:59:32,711           Python recognizes 'alpaca_eval.models_configs.NullModel' as an importable package[^1],
2024-12-29T01:59:32,712           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,713           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,713           package, please make sure that 'alpaca_eval.models_configs.NullModel' is explicitly added
2024-12-29T01:59:32,714           to the `packages` configuration field.

2024-12-29T01:59:32,715           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,715           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,716           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,717           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,718           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,719           If you don't want 'alpaca_eval.models_configs.NullModel' to be distributed and are
2024-12-29T01:59:32,720           already explicitly excluding 'alpaca_eval.models_configs.NullModel' via
2024-12-29T01:59:32,720           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,721           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,721           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,722           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,723           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,725           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,726                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,726                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,727                 directory, all directories are treated like packages.
2024-12-29T01:59:32,727           ********************************************************************************

2024-12-29T01:59:32,729   !!
2024-12-29T01:59:32,729     check.warn(importable)
2024-12-29T01:59:32,730   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.TOA' is absent from the `packages` configuration.
2024-12-29T01:59:32,730   !!

2024-12-29T01:59:32,732           ********************************************************************************
2024-12-29T01:59:32,732           ############################
2024-12-29T01:59:32,733           # Package would be ignored #
2024-12-29T01:59:32,734           ############################
2024-12-29T01:59:32,734           Python recognizes 'alpaca_eval.models_configs.TOA' as an importable package[^1],
2024-12-29T01:59:32,734           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,735           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,735           package, please make sure that 'alpaca_eval.models_configs.TOA' is explicitly added
2024-12-29T01:59:32,736           to the `packages` configuration field.

2024-12-29T01:59:32,737           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,737           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,737           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,738           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,739           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,740           If you don't want 'alpaca_eval.models_configs.TOA' to be distributed and are
2024-12-29T01:59:32,740           already explicitly excluding 'alpaca_eval.models_configs.TOA' via
2024-12-29T01:59:32,741           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,741           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,741           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,742           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,743           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,745           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,745                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,746                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,747                 directory, all directories are treated like packages.
2024-12-29T01:59:32,747           ********************************************************************************

2024-12-29T01:59:32,748   !!
2024-12-29T01:59:32,749     check.warn(importable)
2024-12-29T01:59:32,749   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-12-29T01:59:32,750   !!

2024-12-29T01:59:32,751           ********************************************************************************
2024-12-29T01:59:32,752           ############################
2024-12-29T01:59:32,752           # Package would be ignored #
2024-12-29T01:59:32,753           ############################
2024-12-29T01:59:32,753           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-12-29T01:59:32,754           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,755           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,755           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-12-29T01:59:32,756           to the `packages` configuration field.

2024-12-29T01:59:32,757           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,758           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,758           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,759           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,760           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,761           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-12-29T01:59:32,762           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-12-29T01:59:32,762           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,763           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,763           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,764           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,765           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,766           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,767                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,767                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,767                 directory, all directories are treated like packages.
2024-12-29T01:59:32,768           ********************************************************************************

2024-12-29T01:59:32,770   !!
2024-12-29T01:59:32,770     check.warn(importable)
2024-12-29T01:59:32,771   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-12-29T01:59:32,771   !!

2024-12-29T01:59:32,772           ********************************************************************************
2024-12-29T01:59:32,772           ############################
2024-12-29T01:59:32,773           # Package would be ignored #
2024-12-29T01:59:32,773           ############################
2024-12-29T01:59:32,774           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-12-29T01:59:32,774           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,775           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,776           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-12-29T01:59:32,776           to the `packages` configuration field.

2024-12-29T01:59:32,777           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,778           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,778           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,779           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,780           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,781           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-12-29T01:59:32,782           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-12-29T01:59:32,782           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,783           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,783           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,784           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,785           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,787           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,788                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,788                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,789                 directory, all directories are treated like packages.
2024-12-29T01:59:32,789           ********************************************************************************

2024-12-29T01:59:32,791   !!
2024-12-29T01:59:32,791     check.warn(importable)
2024-12-29T01:59:32,791   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-12-29T01:59:32,792   !!

2024-12-29T01:59:32,793           ********************************************************************************
2024-12-29T01:59:32,793           ############################
2024-12-29T01:59:32,793           # Package would be ignored #
2024-12-29T01:59:32,794           ############################
2024-12-29T01:59:32,794           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-12-29T01:59:32,795           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,796           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,796           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-12-29T01:59:32,796           to the `packages` configuration field.

2024-12-29T01:59:32,797           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,798           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,798           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,799           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,800           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,801           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-12-29T01:59:32,802           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-12-29T01:59:32,802           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,803           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,803           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,804           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,805           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,807           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,807                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,808                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,808                 directory, all directories are treated like packages.
2024-12-29T01:59:32,809           ********************************************************************************

2024-12-29T01:59:32,810   !!
2024-12-29T01:59:32,810     check.warn(importable)
2024-12-29T01:59:32,811   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-12-29T01:59:32,811   !!

2024-12-29T01:59:32,812           ********************************************************************************
2024-12-29T01:59:32,813           ############################
2024-12-29T01:59:32,813           # Package would be ignored #
2024-12-29T01:59:32,814           ############################
2024-12-29T01:59:32,814           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-12-29T01:59:32,815           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,816           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,816           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-12-29T01:59:32,817           to the `packages` configuration field.

2024-12-29T01:59:32,818           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,819           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,819           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,820           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,821           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,822           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-12-29T01:59:32,822           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-12-29T01:59:32,822           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,823           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,823           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,824           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,825           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,827           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,827                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,828                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,828                 directory, all directories are treated like packages.
2024-12-29T01:59:32,829           ********************************************************************************

2024-12-29T01:59:32,830   !!
2024-12-29T01:59:32,830     check.warn(importable)
2024-12-29T01:59:32,831   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-12-29T01:59:32,831   !!

2024-12-29T01:59:32,832           ********************************************************************************
2024-12-29T01:59:32,833           ############################
2024-12-29T01:59:32,833           # Package would be ignored #
2024-12-29T01:59:32,834           ############################
2024-12-29T01:59:32,834           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-12-29T01:59:32,835           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,836           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,837           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-12-29T01:59:32,837           to the `packages` configuration field.

2024-12-29T01:59:32,838           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,839           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,839           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,840           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,841           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,842           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-12-29T01:59:32,843           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-12-29T01:59:32,844           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,844           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,845           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,846           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,847           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,848           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,849                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,849                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,850                 directory, all directories are treated like packages.
2024-12-29T01:59:32,850           ********************************************************************************

2024-12-29T01:59:32,851   !!
2024-12-29T01:59:32,851     check.warn(importable)
2024-12-29T01:59:32,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-12-29T01:59:32,852   !!

2024-12-29T01:59:32,853           ********************************************************************************
2024-12-29T01:59:32,854           ############################
2024-12-29T01:59:32,854           # Package would be ignored #
2024-12-29T01:59:32,855           ############################
2024-12-29T01:59:32,855           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-12-29T01:59:32,856           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,857           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,857           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-12-29T01:59:32,858           to the `packages` configuration field.

2024-12-29T01:59:32,859           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,859           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,860           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,861           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,862           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,863           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-12-29T01:59:32,863           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-12-29T01:59:32,864           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,865           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,865           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,866           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,867           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,869           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,869                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,870                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,870                 directory, all directories are treated like packages.
2024-12-29T01:59:32,871           ********************************************************************************

2024-12-29T01:59:32,872   !!
2024-12-29T01:59:32,873     check.warn(importable)
2024-12-29T01:59:32,873   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-12-29T01:59:32,874   !!

2024-12-29T01:59:32,875           ********************************************************************************
2024-12-29T01:59:32,875           ############################
2024-12-29T01:59:32,876           # Package would be ignored #
2024-12-29T01:59:32,876           ############################
2024-12-29T01:59:32,877           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-12-29T01:59:32,877           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,878           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,878           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-12-29T01:59:32,879           to the `packages` configuration field.

2024-12-29T01:59:32,880           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,880           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,880           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,881           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,882           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,883           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-12-29T01:59:32,883           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-12-29T01:59:32,884           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,885           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,886           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,886           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,888           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,889                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,889                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,890                 directory, all directories are treated like packages.
2024-12-29T01:59:32,890           ********************************************************************************

2024-12-29T01:59:32,891   !!
2024-12-29T01:59:32,892     check.warn(importable)
2024-12-29T01:59:32,892   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-12-29T01:59:32,893   !!

2024-12-29T01:59:32,894           ********************************************************************************
2024-12-29T01:59:32,894           ############################
2024-12-29T01:59:32,895           # Package would be ignored #
2024-12-29T01:59:32,895           ############################
2024-12-29T01:59:32,896           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-12-29T01:59:32,896           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,897           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,898           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-12-29T01:59:32,898           to the `packages` configuration field.

2024-12-29T01:59:32,899           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,900           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,900           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,901           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,902           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,904           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-12-29T01:59:32,904           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-12-29T01:59:32,905           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,905           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,905           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,906           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,907           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,908           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,909                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,909                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,910                 directory, all directories are treated like packages.
2024-12-29T01:59:32,910           ********************************************************************************

2024-12-29T01:59:32,911   !!
2024-12-29T01:59:32,912     check.warn(importable)
2024-12-29T01:59:32,912   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-12-29T01:59:32,913   !!

2024-12-29T01:59:32,914           ********************************************************************************
2024-12-29T01:59:32,914           ############################
2024-12-29T01:59:32,915           # Package would be ignored #
2024-12-29T01:59:32,915           ############################
2024-12-29T01:59:32,916           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-12-29T01:59:32,916           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,917           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,918           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-12-29T01:59:32,918           to the `packages` configuration field.

2024-12-29T01:59:32,919           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,920           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,920           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,921           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,922           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,923           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-12-29T01:59:32,924           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-12-29T01:59:32,925           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,926           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,927           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,928           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,929           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,930                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,930                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,931                 directory, all directories are treated like packages.
2024-12-29T01:59:32,932           ********************************************************************************

2024-12-29T01:59:32,933   !!
2024-12-29T01:59:32,933     check.warn(importable)
2024-12-29T01:59:32,934   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-12-29T01:59:32,934   !!

2024-12-29T01:59:32,935           ********************************************************************************
2024-12-29T01:59:32,936           ############################
2024-12-29T01:59:32,936           # Package would be ignored #
2024-12-29T01:59:32,937           ############################
2024-12-29T01:59:32,937           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-12-29T01:59:32,938           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,939           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,939           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-12-29T01:59:32,939           to the `packages` configuration field.

2024-12-29T01:59:32,940           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,941           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,941           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,942           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,943           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,944           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-12-29T01:59:32,945           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-12-29T01:59:32,945           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,946           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,946           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,947           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,948           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,950           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,950                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,950                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,951                 directory, all directories are treated like packages.
2024-12-29T01:59:32,951           ********************************************************************************

2024-12-29T01:59:32,952   !!
2024-12-29T01:59:32,953     check.warn(importable)
2024-12-29T01:59:32,953   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-12-29T01:59:32,954   !!

2024-12-29T01:59:32,955           ********************************************************************************
2024-12-29T01:59:32,955           ############################
2024-12-29T01:59:32,956           # Package would be ignored #
2024-12-29T01:59:32,956           ############################
2024-12-29T01:59:32,957           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-12-29T01:59:32,957           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,958           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,959           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-12-29T01:59:32,959           to the `packages` configuration field.

2024-12-29T01:59:32,961           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,961           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,961           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,962           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,963           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,964           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-12-29T01:59:32,964           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-12-29T01:59:32,965           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,965           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,965           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,966           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,967           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,969           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,969                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,970                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,970                 directory, all directories are treated like packages.
2024-12-29T01:59:32,970           ********************************************************************************

2024-12-29T01:59:32,971   !!
2024-12-29T01:59:32,972     check.warn(importable)
2024-12-29T01:59:32,972   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-12-29T01:59:32,973   !!

2024-12-29T01:59:32,974           ********************************************************************************
2024-12-29T01:59:32,974           ############################
2024-12-29T01:59:32,975           # Package would be ignored #
2024-12-29T01:59:32,975           ############################
2024-12-29T01:59:32,976           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-12-29T01:59:32,976           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,977           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,978           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-12-29T01:59:32,978           to the `packages` configuration field.

2024-12-29T01:59:32,979           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,980           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,980           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:32,981           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:32,982           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:32,983           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-12-29T01:59:32,984           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-12-29T01:59:32,984           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:32,985           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:32,985           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:32,986           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:32,987           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:32,989           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:32,989                 even if it does not contain any `.py` files.
2024-12-29T01:59:32,990                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:32,990                 directory, all directories are treated like packages.
2024-12-29T01:59:32,990           ********************************************************************************

2024-12-29T01:59:32,991   !!
2024-12-29T01:59:32,992     check.warn(importable)
2024-12-29T01:59:32,992   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-12-29T01:59:32,992   !!

2024-12-29T01:59:32,993           ********************************************************************************
2024-12-29T01:59:32,994           ############################
2024-12-29T01:59:32,994           # Package would be ignored #
2024-12-29T01:59:32,994           ############################
2024-12-29T01:59:32,995           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-12-29T01:59:32,995           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:32,996           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:32,997           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-12-29T01:59:32,997           to the `packages` configuration field.

2024-12-29T01:59:32,998           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:32,999           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:32,999           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:33,000           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:33,001           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:33,002           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-12-29T01:59:33,003           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-12-29T01:59:33,003           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:33,004           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:33,004           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:33,005           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:33,006           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:33,008           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:33,008                 even if it does not contain any `.py` files.
2024-12-29T01:59:33,009                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:33,009                 directory, all directories are treated like packages.
2024-12-29T01:59:33,010           ********************************************************************************

2024-12-29T01:59:33,011   !!
2024-12-29T01:59:33,011     check.warn(importable)
2024-12-29T01:59:33,012   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-12-29T01:59:33,013   !!

2024-12-29T01:59:33,014           ********************************************************************************
2024-12-29T01:59:33,014           ############################
2024-12-29T01:59:33,015           # Package would be ignored #
2024-12-29T01:59:33,015           ############################
2024-12-29T01:59:33,015           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-12-29T01:59:33,016           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:33,017           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:33,017           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-12-29T01:59:33,017           to the `packages` configuration field.

2024-12-29T01:59:33,018           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:33,019           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:33,019           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:33,020           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:33,021           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:33,022           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-12-29T01:59:33,022           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-12-29T01:59:33,022           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:33,023           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:33,023           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:33,024           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:33,025           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:33,027           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:33,027                 even if it does not contain any `.py` files.
2024-12-29T01:59:33,028                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:33,028                 directory, all directories are treated like packages.
2024-12-29T01:59:33,029           ********************************************************************************

2024-12-29T01:59:33,030   !!
2024-12-29T01:59:33,030     check.warn(importable)
2024-12-29T01:59:33,031   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-12-29T01:59:33,031   !!

2024-12-29T01:59:33,032           ********************************************************************************
2024-12-29T01:59:33,033           ############################
2024-12-29T01:59:33,033           # Package would be ignored #
2024-12-29T01:59:33,034           ############################
2024-12-29T01:59:33,034           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-12-29T01:59:33,035           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:33,036           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:33,036           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-12-29T01:59:33,037           to the `packages` configuration field.

2024-12-29T01:59:33,038           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:33,038           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:33,039           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:33,040           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:33,041           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:33,042           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-12-29T01:59:33,042           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-12-29T01:59:33,043           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:33,043           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:33,043           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:33,044           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:33,045           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:33,046           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:33,047                 even if it does not contain any `.py` files.
2024-12-29T01:59:33,047                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:33,047                 directory, all directories are treated like packages.
2024-12-29T01:59:33,048           ********************************************************************************

2024-12-29T01:59:33,049   !!
2024-12-29T01:59:33,049     check.warn(importable)
2024-12-29T01:59:33,050   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-12-29T01:59:33,050   !!

2024-12-29T01:59:33,051           ********************************************************************************
2024-12-29T01:59:33,052           ############################
2024-12-29T01:59:33,052           # Package would be ignored #
2024-12-29T01:59:33,053           ############################
2024-12-29T01:59:33,053           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-12-29T01:59:33,054           but it is absent from setuptools' `packages` configuration.

2024-12-29T01:59:33,055           This leads to an ambiguous overall configuration. If you want to distribute this
2024-12-29T01:59:33,055           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-12-29T01:59:33,056           to the `packages` configuration field.

2024-12-29T01:59:33,057           Alternatively, you can also rely on setuptools' discovery methods
2024-12-29T01:59:33,057           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-12-29T01:59:33,058           instead of `find_packages(...)`/`find:`).

2024-12-29T01:59:33,059           You can read more about "package discovery" on setuptools documentation page:

2024-12-29T01:59:33,060           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-12-29T01:59:33,061           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-12-29T01:59:33,061           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-12-29T01:59:33,062           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-12-29T01:59:33,062           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-12-29T01:59:33,063           combination with a more fine grained `package-data` configuration.

2024-12-29T01:59:33,064           You can read more about "package data files" on setuptools documentation page:

2024-12-29T01:59:33,065           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-12-29T01:59:33,066           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-12-29T01:59:33,067                 even if it does not contain any `.py` files.
2024-12-29T01:59:33,067                 On the other hand, currently there is no concept of package data
2024-12-29T01:59:33,068                 directory, all directories are treated like packages.
2024-12-29T01:59:33,069           ********************************************************************************

2024-12-29T01:59:33,070   !!
2024-12-29T01:59:33,070     check.warn(importable)
2024-12-29T01:59:33,070   creating build/lib/alpaca_eval/evaluators_configs
2024-12-29T01:59:33,071   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-12-29T01:59:33,071   creating build/lib/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:33,071   copying src/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/config.yaml -> build/lib/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:33,072   copying src/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/self_taught.txt -> build/lib/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:33,072   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:33,073   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:33,073   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:33,074   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:33,074   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:33,075   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:33,075   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:33,075   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:33,076   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:33,076   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:33,077   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:33,077   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:33,078   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-12-29T01:59:33,078   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-12-29T01:59:33,079   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-12-29T01:59:33,079   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-12-29T01:59:33,080   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:33,080   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:33,081   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:33,081   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:33,082   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:33,083   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:33,083   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:33,084   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:33,084   copying src/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:33,084   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:33,085   copying src/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:33,085   copying src/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:33,086   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,086   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,087   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,087   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,088   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,088   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,089   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,089   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,090   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,090   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,091   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,091   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,092   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,092   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:33,093   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:33,093   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:33,094   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:33,094   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:33,095   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:33,096   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:33,096   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-12-29T01:59:33,097   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-12-29T01:59:33,097   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-12-29T01:59:33,097   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-12-29T01:59:33,098   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:33,098   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:33,099   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:33,099   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:33,100   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:33,100   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:33,100   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:33,101   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:33,101   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:33,102   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-12-29T01:59:33,102   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-12-29T01:59:33,103   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:33,103   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:33,104   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:33,104   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:33,105   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:33,105   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:33,106   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-12-29T01:59:33,106   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-12-29T01:59:33,107   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:33,107   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:33,108   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:33,108   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-12-29T01:59:33,109   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-12-29T01:59:33,109   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-12-29T01:59:33,110   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-12-29T01:59:33,111   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-12-29T01:59:33,111   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-12-29T01:59:33,111   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:33,112   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:33,112   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:33,113   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:33,113   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:33,114   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:33,114   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-12-29T01:59:33,114   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-12-29T01:59:33,115   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-12-29T01:59:33,115   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-12-29T01:59:33,116   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:33,116   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:33,117   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:33,117   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-12-29T01:59:33,118   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-12-29T01:59:33,118   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-12-29T01:59:33,119   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-12-29T01:59:33,119   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:33,120   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:33,120   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:33,121   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-12-29T01:59:33,121   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-12-29T01:59:33,122   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:33,122   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:33,123   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:33,123   creating build/lib/alpaca_eval/evaluators_configs/test
2024-12-29T01:59:33,124   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-12-29T01:59:33,124   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:33,125   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:33,125   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:33,126   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-12-29T01:59:33,126   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-12-29T01:59:33,127   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18
2024-12-29T01:59:33,127   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18
2024-12-29T01:59:33,128   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-12-29T01:59:33,128   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-12-29T01:59:33,128   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-12-29T01:59:33,129   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-12-29T01:59:33,129   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:33,130   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/README.md -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:33,130   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:33,131   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:33,131   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:33,132   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:33,132   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:33,133   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:33,133   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,134   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,134   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,135   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,135   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,136   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:33,136   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-12-29T01:59:33,137   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-12-29T01:59:33,137   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:33,138   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:33,139   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:33,139   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:33,139   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:33,140   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:33,140   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:33,141   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:33,141   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:33,142   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:33,142   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:33,143   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:33,143   creating build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-12-29T01:59:33,144   copying src/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-12-29T01:59:33,144   creating build/lib/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:33,145   copying src/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:33,145   copying src/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:33,146   creating build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:33,146   copying src/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:33,147   copying src/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:33,147   creating build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct
2024-12-29T01:59:33,148   copying src/alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct
2024-12-29T01:59:33,148   creating build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct
2024-12-29T01:59:33,149   copying src/alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct
2024-12-29T01:59:33,149   creating build/lib/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:33,150   copying src/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:33,150   copying src/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:33,151   creating build/lib/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,151   copying src/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml -> build/lib/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,152   copying src/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt -> build/lib/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,152   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:33,153   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:33,153   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:33,154   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:33,154   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:33,155   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:33,155   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:33,155   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:33,156   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:33,156   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:33,157   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:33,157   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:33,158   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:33,158   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:33,159   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:33,159   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:33,160   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:33,160   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:33,161   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:33,161   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:33,162   copying src/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:33,162   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:33,163   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:33,163   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:33,165   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:33,166   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:33,169   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:33,171   creating build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:33,172   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:33,174   copying src/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:33,176   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:33,177   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:33,179   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:33,181   creating build/lib/alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix
2024-12-29T01:59:33,182   copying src/alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix
2024-12-29T01:59:33,184   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:33,185   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:33,187   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:33,190   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:33,191   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:33,193   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:33,195   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-12-29T01:59:33,196   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-12-29T01:59:33,199   creating build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-12-29T01:59:33,200   copying src/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-12-29T01:59:33,202   creating build/lib/alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:33,203   copying src/alpaca_eval/models_configs/Llama3-PBM-Nova-70B/configs.yaml -> build/lib/alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:33,205   copying src/alpaca_eval/models_configs/Llama3-PBM-Nova-70B/prompt.txt -> build/lib/alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:33,207   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-12-29T01:59:33,208   copying src/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-12-29T01:59:33,211   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-12-29T01:59:33,212   copying src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-12-29T01:59:33,214   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-12-29T01:59:33,215   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-12-29T01:59:33,218   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-12-29T01:59:33,219   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-12-29T01:59:33,221   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-12-29T01:59:33,222   copying src/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-12-29T01:59:33,224   creating build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:33,225   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:33,227   copying src/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:33,229   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-12-29T01:59:33,230   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-12-29T01:59:33,232   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-12-29T01:59:33,233   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-12-29T01:59:33,235   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:33,236   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:33,238   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:33,240   creating build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-12-29T01:59:33,241   copying src/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-12-29T01:59:33,244   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:33,245   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:33,247   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:33,249   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:33,250   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:33,253   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:33,256   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:33,257   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:33,260   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:33,263   creating build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:33,264   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:33,267   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:33,270   creating build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:33,271   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:33,274   copying src/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:33,276   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:33,277   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:33,280   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:33,282   creating build/lib/alpaca_eval/models_configs/NullModel
2024-12-29T01:59:33,284   copying src/alpaca_eval/models_configs/NullModel/configs.yaml -> build/lib/alpaca_eval/models_configs/NullModel
2024-12-29T01:59:33,286   copying src/alpaca_eval/models_configs/NullModel/constant_output.txt -> build/lib/alpaca_eval/models_configs/NullModel
2024-12-29T01:59:33,289   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:33,290   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:33,293   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:33,295   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:33,297   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:33,299   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:33,302   creating build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-12-29T01:59:33,303   copying src/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-12-29T01:59:33,306   creating build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:33,307   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:33,310   copying src/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:33,313   creating build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-12-29T01:59:33,314   copying src/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-12-29T01:59:33,317   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:33,319   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:33,322   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:33,324   creating build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-12-29T01:59:33,325   copying src/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-12-29T01:59:33,328   creating build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:33,329   copying src/alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:33,332   copying src/alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:33,335   creating build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:33,336   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:33,338   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:33,341   creating build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo
2024-12-29T01:59:33,342   copying src/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo/configs.yaml -> build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo
2024-12-29T01:59:33,345   creating build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:33,346   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:33,349   copying src/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:33,351   creating build/lib/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,352   copying src/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,355   copying src/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:33,357   creating build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:33,358   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:33,360   copying src/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:33,362   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:33,363   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:33,366   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:33,368   creating build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-12-29T01:59:33,369   copying src/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-12-29T01:59:33,371   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:33,372   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:33,374   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:33,376   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-12-29T01:59:33,377   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-12-29T01:59:33,379   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-12-29T01:59:33,380   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-12-29T01:59:33,383   creating build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO
2024-12-29T01:59:33,384   copying src/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO
2024-12-29T01:59:33,386   creating build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB
2024-12-29T01:59:33,387   copying src/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB/configs.yaml -> build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB
2024-12-29T01:59:33,389   creating build/lib/alpaca_eval/models_configs/Shopee-SlimMoA-v1
2024-12-29T01:59:33,390   copying src/alpaca_eval/models_configs/Shopee-SlimMoA-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/Shopee-SlimMoA-v1
2024-12-29T01:59:33,392   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:33,393   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:33,395   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:33,397   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:33,398   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:33,400   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:33,402   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:33,403   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:33,406   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:33,408   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-12-29T01:59:33,409   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-12-29T01:59:33,411   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-12-29T01:59:33,412   copying src/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-12-29T01:59:33,414   creating build/lib/alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:33,416   copying src/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:33,418   copying src/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/lib/alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:33,420   creating build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-12-29T01:59:33,421   copying src/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-12-29T01:59:33,423   creating build/lib/alpaca_eval/models_configs/TOA
2024-12-29T01:59:33,424   copying src/alpaca_eval/models_configs/TOA/configs.yaml -> build/lib/alpaca_eval/models_configs/TOA
2024-12-29T01:59:33,427   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-12-29T01:59:33,428   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-12-29T01:59:33,430   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:33,431   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:33,433   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:33,435   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:33,437   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:33,439   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:33,441   creating build/lib/alpaca_eval/models_configs/Together-MoA
2024-12-29T01:59:33,442   copying src/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA
2024-12-29T01:59:33,444   creating build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-12-29T01:59:33,445   copying src/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/lib/alpaca_eval/models_configs/Together-MoA-Lite
2024-12-29T01:59:33,447   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:33,449   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:33,451   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:33,453   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:33,454   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:33,456   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:33,458   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:33,459   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:33,462   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:33,465   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-12-29T01:59:33,466   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-12-29T01:59:33,468   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:33,469   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:33,471   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:33,474   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:33,476   creating build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,477   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,479   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,481   copying src/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,483   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:33,484   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:33,486   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:33,489   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:33,491   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:33,492   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:33,494   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:33,496   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:33,497   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:33,499   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:33,501   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-12-29T01:59:33,502   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-12-29T01:59:33,504   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-12-29T01:59:33,505   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-12-29T01:59:33,507   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-12-29T01:59:33,508   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-12-29T01:59:33,511   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-12-29T01:59:33,512   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-12-29T01:59:33,514   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:33,515   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:33,518   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:33,520   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:33,521   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:33,523   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:33,525   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-12-29T01:59:33,526   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-12-29T01:59:33,528   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-12-29T01:59:33,529   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-12-29T01:59:33,532   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-12-29T01:59:33,533   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-12-29T01:59:33,535   creating build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-12-29T01:59:33,536   copying src/alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml -> build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-12-29T01:59:33,538   creating build/lib/alpaca_eval/models_configs/blendaxai-gm-l6-vo31
2024-12-29T01:59:33,539   copying src/alpaca_eval/models_configs/blendaxai-gm-l6-vo31/configs.yaml -> build/lib/alpaca_eval/models_configs/blendaxai-gm-l6-vo31
2024-12-29T01:59:33,541   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:33,542   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:33,544   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:33,546   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:33,548   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:33,550   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:33,552   creating build/lib/alpaca_eval/models_configs/claude
2024-12-29T01:59:33,553   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-12-29T01:59:33,555   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-12-29T01:59:33,557   creating build/lib/alpaca_eval/models_configs/claude-2
2024-12-29T01:59:33,558   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-12-29T01:59:33,561   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-12-29T01:59:33,562   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-12-29T01:59:33,564   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:33,565   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:33,567   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:33,569   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:33,570   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:33,572   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:33,574   creating build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:33,575   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:33,578   copying src/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:33,580   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-12-29T01:59:33,581   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-12-29T01:59:33,583   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:33,584   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:33,587   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:33,589   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-12-29T01:59:33,590   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-12-29T01:59:33,592   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-12-29T01:59:33,594   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-12-29T01:59:33,596   creating build/lib/alpaca_eval/models_configs/cohere
2024-12-29T01:59:33,597   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-12-29T01:59:33,599   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-12-29T01:59:33,601   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:33,603   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:33,605   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:33,607   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-12-29T01:59:33,609   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-12-29T01:59:33,611   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:33,612   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:33,614   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:33,616   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-12-29T01:59:33,617   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-12-29T01:59:33,619   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-12-29T01:59:33,620   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-12-29T01:59:33,623   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-12-29T01:59:33,624   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-12-29T01:59:33,626   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-12-29T01:59:33,627   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-12-29T01:59:33,629   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-12-29T01:59:33,630   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-12-29T01:59:33,632   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-12-29T01:59:33,633   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-12-29T01:59:33,636   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:33,637   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:33,639   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:33,641   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:33,642   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:33,645   copying src/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:33,647   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-12-29T01:59:33,648   copying src/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-12-29T01:59:33,650   creating build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-12-29T01:59:33,651   copying src/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-12-29T01:59:33,654   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-12-29T01:59:33,655   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-12-29T01:59:33,657   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-12-29T01:59:33,658   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-12-29T01:59:33,660   creating build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:33,662   copying src/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:33,664   copying src/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:33,666   creating build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:33,667   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:33,669   copying src/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:33,671   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-12-29T01:59:33,672   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-12-29T01:59:33,674   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-12-29T01:59:33,675   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-12-29T01:59:33,677   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-12-29T01:59:33,678   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-12-29T01:59:33,680   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-12-29T01:59:33,681   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-12-29T01:59:33,683   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-12-29T01:59:33,684   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-12-29T01:59:33,686   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-12-29T01:59:33,687   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-12-29T01:59:33,690   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-12-29T01:59:33,691   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-12-29T01:59:33,694   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,695   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-12-29T01:59:33,697   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-12-29T01:59:33,698   copying src/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-12-29T01:59:33,700   creating build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-12-29T01:59:33,701   copying src/alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-12-29T01:59:33,704   creating build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-12-29T01:59:33,705   copying src/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-12-29T01:59:33,707   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-12-29T01:59:33,708   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-12-29T01:59:33,710   creating build/lib/alpaca_eval/models_configs/gpt4
2024-12-29T01:59:33,711   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-12-29T01:59:33,713   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-12-29T01:59:33,715   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-12-29T01:59:33,716   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-12-29T01:59:33,719   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-12-29T01:59:33,720   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-12-29T01:59:33,722   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-12-29T01:59:33,723   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-12-29T01:59:33,725   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-12-29T01:59:33,726   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-12-29T01:59:33,728   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:33,730   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:33,732   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:33,734   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:33,735   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:33,737   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:33,739   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:33,740   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:33,742   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:33,744   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-12-29T01:59:33,745   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-12-29T01:59:33,747   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-12-29T01:59:33,749   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-12-29T01:59:33,751   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-12-29T01:59:33,752   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-12-29T01:59:33,754   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-12-29T01:59:33,755   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-12-29T01:59:33,758   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-12-29T01:59:33,759   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-12-29T01:59:33,761   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:33,762   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:33,764   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:33,766   creating build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-12-29T01:59:33,767   copying src/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-12-29T01:59:33,770   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:33,771   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:33,773   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:33,775   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-12-29T01:59:33,776   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-12-29T01:59:33,778   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-12-29T01:59:33,779   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-12-29T01:59:33,781   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:33,782   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:33,784   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:33,786   creating build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-12-29T01:59:33,787   copying src/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-12-29T01:59:33,795   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:33,796   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:33,798   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:33,801   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-12-29T01:59:33,802   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-12-29T01:59:33,804   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:33,805   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:33,807   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:33,809   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:33,810   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:33,812   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:33,814   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:33,815   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:33,817   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:33,819   creating build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:33,820   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:33,823   copying src/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/lib/alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:33,825   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-12-29T01:59:33,826   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-12-29T01:59:33,828   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:33,829   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:33,832   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:33,834   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:33,835   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:33,837   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:33,839   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-12-29T01:59:33,840   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-12-29T01:59:33,842   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:33,843   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:33,845   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:33,847   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:33,848   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:33,850   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:33,852   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:33,853   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:33,856   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:33,858   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-12-29T01:59:33,859   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-12-29T01:59:33,862   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:33,863   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:33,865   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:33,867   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:33,868   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:33,871   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:33,873   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:33,874   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:33,877   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:33,879   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:33,880   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:33,882   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:33,884   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:33,885   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:33,888   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:33,890   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:33,891   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:33,893   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:33,895   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:33,896   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:33,898   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:33,900   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:33,901   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:33,903   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:33,905   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:33,907   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:33,909   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:33,911   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-12-29T01:59:33,912   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-12-29T01:59:33,914   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-12-29T01:59:33,915   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-12-29T01:59:33,917   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-12-29T01:59:33,918   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-12-29T01:59:33,920   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-12-29T01:59:33,921   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-12-29T01:59:33,924   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-12-29T01:59:33,925   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-12-29T01:59:33,927   creating build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-12-29T01:59:33,928   copying src/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-12-29T01:59:33,930   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-12-29T01:59:33,931   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-12-29T01:59:33,934   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-12-29T01:59:33,935   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-12-29T01:59:33,937   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:33,938   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:33,941   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:33,943   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-12-29T01:59:33,945   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-12-29T01:59:33,947   creating build/lib/alpaca_eval/models_configs/phi-2
2024-12-29T01:59:33,948   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-12-29T01:59:33,950   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-12-29T01:59:33,952   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:33,954   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:33,955   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:33,957   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:33,958   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:33,961   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:33,963   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:33,964   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:33,966   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:33,968   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-12-29T01:59:33,969   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-12-29T01:59:33,971   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-12-29T01:59:33,972   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-12-29T01:59:33,974   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-12-29T01:59:33,975   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-12-29T01:59:33,978   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-12-29T01:59:33,979   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-12-29T01:59:33,981   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:33,982   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:33,984   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:33,986   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-12-29T01:59:33,987   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-12-29T01:59:33,989   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-12-29T01:59:33,990   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-12-29T01:59:33,993   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:33,994   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:33,996   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:33,998   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-12-29T01:59:33,999   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-12-29T01:59:34,001   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-12-29T01:59:34,002   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-12-29T01:59:34,005   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-12-29T01:59:34,006   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-12-29T01:59:34,008   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:34,009   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:34,011   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:34,013   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,014   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,016   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,018   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:34,019   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:34,021   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:34,023   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,024   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,027   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,029   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-12-29T01:59:34,030   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-12-29T01:59:34,032   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-12-29T01:59:34,033   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-12-29T01:59:34,035   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-12-29T01:59:34,036   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-12-29T01:59:34,039   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-12-29T01:59:34,040   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-12-29T01:59:34,042   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-12-29T01:59:34,043   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-12-29T01:59:34,045   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,046   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,048   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,050   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-12-29T01:59:34,051   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-12-29T01:59:34,054   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-12-29T01:59:34,055   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-12-29T01:59:34,057   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,058   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,060   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,062   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-12-29T01:59:34,063   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-12-29T01:59:34,066   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-12-29T01:59:34,067   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-12-29T01:59:34,069   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-12-29T01:59:34,070   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-12-29T01:59:34,072   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-12-29T01:59:34,073   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-12-29T01:59:34,075   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-12-29T01:59:34,077   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-12-29T01:59:34,079   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-12-29T01:59:34,080   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-12-29T01:59:34,082   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,083   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,086   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,088   creating build/lib/alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,089   copying src/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,091   copying src/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/lib/alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,093   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,094   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,096   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,098   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,099   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,102   copying src/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,104   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-12-29T01:59:34,105   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-12-29T01:59:34,107   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-12-29T01:59:34,108   copying src/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-12-29T01:59:34,140   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-12-29T01:59:34,140   !!

2024-12-29T01:59:34,141           ********************************************************************************
2024-12-29T01:59:34,142           Please avoid running ``setup.py`` directly.
2024-12-29T01:59:34,142           Instead, use pypa/build, pypa/installer or other
2024-12-29T01:59:34,143           standards-based tools.

2024-12-29T01:59:34,143           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-12-29T01:59:34,144           ********************************************************************************

2024-12-29T01:59:34,145   !!
2024-12-29T01:59:34,145     self.initialize_options()
2024-12-29T01:59:34,168   installing to build/bdist.linux-armv7l/wheel
2024-12-29T01:59:34,168   running install
2024-12-29T01:59:34,193   running install_lib
2024-12-29T01:59:34,220   creating build/bdist.linux-armv7l/wheel
2024-12-29T01:59:34,222   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-12-29T01:59:34,223   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:34,226   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:34,229   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:34,232   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-12-29T01:59:34,234   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-12-29T01:59:34,235   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/bedrock_claude_2
2024-12-29T01:59:34,237   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:34,239   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:34,241   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-12-29T01:59:34,243   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:34,244   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:34,246   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-12-29T01:59:34,249   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:34,250   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:34,252   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-12-29T01:59:34,254   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-12-29T01:59:34,255   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_2
2024-12-29T01:59:34,258   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:34,259   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:34,261   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/lmsys_gpt4
2024-12-29T01:59:34,263   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:34,265   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:34,266   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_ranking
2024-12-29T01:59:34,268   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-12-29T01:59:34,269   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-12-29T01:59:34,272   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-12-29T01:59:34,273   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo
2024-12-29T01:59:34,275   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:34,276   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:34,278   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn
2024-12-29T01:59:34,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:34,281   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:34,283   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn
2024-12-29T01:59:34,286   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-12-29T01:59:34,287   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-12-29T01:59:34,289   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,290   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,293   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,295   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,298   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,300   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,302   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,305   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,306   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,308   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,310   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,312   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,314   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,316   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm
2024-12-29T01:59:34,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:34,319   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:34,321   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-12-29T01:59:34,324   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:34,325   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:34,327   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-12-29T01:59:34,329   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:34,330   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:34,332   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-12-29T01:59:34,334   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:34,335   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:34,337   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/aviary_gpt4
2024-12-29T01:59:34,340   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18
2024-12-29T01:59:34,341   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18
2024-12-29T01:59:34,343   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:34,344   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:34,346   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-12-29T01:59:34,348   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-12-29T01:59:34,349   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-12-29T01:59:34,352   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-12-29T01:59:34,353   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-12-29T01:59:34,355   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs
2024-12-29T01:59:34,357   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:34,358   copying build/lib/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:34,360   copying build/lib/alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/self_taught.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo
2024-12-29T01:59:34,362   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:34,363   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:34,365   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-12-29T01:59:34,368   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:34,369   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:34,371   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/README.md -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b
2024-12-29T01:59:34,373   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-12-29T01:59:34,374   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-12-29T01:59:34,377   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-12-29T01:59:34,378   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/cohere
2024-12-29T01:59:34,380   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-12-29T01:59:34,381   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4
2024-12-29T01:59:34,384   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-12-29T01:59:34,385   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-12-29T01:59:34,387   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:34,388   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:34,390   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-12-29T01:59:34,392   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:34,394   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:34,395   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/guanaco_33b
2024-12-29T01:59:34,397   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-12-29T01:59:34,398   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-12-29T01:59:34,401   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:34,402   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:34,404   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt_fn
2024-12-29T01:59:34,406   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:34,407   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:34,409   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-12-29T01:59:34,412   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:34,413   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:34,415   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/chatgpt
2024-12-29T01:59:34,418   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:34,419   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:34,421   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/claude
2024-12-29T01:59:34,423   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:34,424   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:34,426   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-12-29T01:59:34,428   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-12-29T01:59:34,430   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/test
2024-12-29T01:59:34,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-12-29T01:59:34,433   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-12-29T01:59:34,436   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-12-29T01:59:34,437   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-12-29T01:59:34,439   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-12-29T01:59:34,440   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-12-29T01:59:34,443   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-12-29T01:59:34,444   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-12-29T01:59:34,446   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-12-29T01:59:34,447   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/bedrock_claude
2024-12-29T01:59:34,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:34,451   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:34,453   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-12-29T01:59:34,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:34,457   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:34,458   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/evaluators_configs/text_davinci_003
2024-12-29T01:59:34,464   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-12-29T01:59:34,466   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-12-29T01:59:34,467   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/evo-v2-7b
2024-12-29T01:59:34,470   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:34,471   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:34,473   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baichuan-13b-chat
2024-12-29T01:59:34,475   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-12-29T01:59:34,476   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-SimPO
2024-12-29T01:59:34,478   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:34,479   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:34,481   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-12-29T01:59:34,484   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-12-29T01:59:34,485   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/bedrock_claude_2
2024-12-29T01:59:34,487   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-12-29T01:59:34,488   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-12-29T01:59:34,491   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-12-29T01:59:34,492   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.3
2024-12-29T01:59:34,494   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-12-29T01:59:34,495   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2
2024-12-29T01:59:34,497   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2
2024-12-29T01:59:34,499   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:34,500   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:34,502   copying build/lib/alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-110B-Chat
2024-12-29T01:59:34,504   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-12-29T01:59:34,505   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-12-29T01:59:34,507   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:34,508   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:34,510   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-12-29T01:59:34,513   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:34,514   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:34,516   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO
2024-12-29T01:59:34,519   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-12-29T01:59:34,520   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-12-29T01:59:34,522   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:34,524   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:34,526   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-33b
2024-12-29T01:59:34,528   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-12-29T01:59:34,529   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-7b
2024-12-29T01:59:34,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-12-29T01:59:34,532   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo
2024-12-29T01:59:34,535   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:34,536   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:34,538   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B
2024-12-29T01:59:34,540   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:34,541   copying build/lib/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:34,543   copying build/lib/alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct
2024-12-29T01:59:34,545   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-12-29T01:59:34,546   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-12-29T01:59:34,548   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:34,549   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:34,551   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-12-29T01:59:34,553   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-12-29T01:59:34,555   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/opencoderplus-15b
2024-12-29T01:59:34,557   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-12-29T01:59:34,558   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-33b-api
2024-12-29T01:59:34,561   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:34,562   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:34,564   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-12-29T01:59:34,566   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:34,567   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:34,569   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-13b
2024-12-29T01:59:34,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-12-29T01:59:34,573   copying build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-12-29T01:59:34,575   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-12-29T01:59:34,576   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-2024-05-13
2024-12-29T01:59:34,578   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-12-29T01:59:34,579   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613_concise
2024-12-29T01:59:34,582   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-12-29T01:59:34,583   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0314
2024-12-29T01:59:34,585   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-12-29T01:59:34,586   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-70b
2024-12-29T01:59:34,589   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-12-29T01:59:34,590   copying build/lib/alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1
2024-12-29T01:59:34,593   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:34,594   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:34,595   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-12-29T01:59:34,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-12-29T01:59:34,599   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/airoboros-65b
2024-12-29T01:59:34,601   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-12-29T01:59:34,603   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v2-w-13b
2024-12-29T01:59:34,605   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,606   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,608   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-12-29T01:59:34,610   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,611   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,613   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-12-29T01:59:34,615   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-12-29T01:59:34,616   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-12-29T01:59:34,619   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-12-29T01:59:34,620   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama2-70b
2024-12-29T01:59:34,622   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct
2024-12-29T01:59:34,624   copying build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct
2024-12-29T01:59:34,626   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-12-29T01:59:34,627   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-33b
2024-12-29T01:59:34,630   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,631   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,633   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b
2024-12-29T01:59:34,635   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-12-29T01:59:34,636   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo
2024-12-29T01:59:34,638   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:34,639   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:34,641   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B
2024-12-29T01:59:34,644   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-12-29T01:59:34,645   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-20b-ExPO
2024-12-29T01:59:34,647   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-12-29T01:59:34,648   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-12-29T01:59:34,650   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-12-29T01:59:34,651   copying build/lib/alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-7B-Chat
2024-12-29T01:59:34,654   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-12-29T01:59:34,655   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-12-29T01:59:34,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:34,659   copying build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:34,661   copying build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct
2024-12-29T01:59:34,663   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,664   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,666   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-12-29T01:59:34,669   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-12-29T01:59:34,670   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt35_turbo_instruct
2024-12-29T01:59:34,672   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:34,673   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:34,675   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-12-29T01:59:34,677   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-12-29T01:59:34,678   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v2-13b
2024-12-29T01:59:34,680   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:34,681   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:34,683   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-12-29T01:59:34,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:34,687   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:34,689   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/humpback-llama-65b
2024-12-29T01:59:34,691   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:34,692   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:34,694   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-12-29T01:59:34,696   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:34,698   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:34,700   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-12-29T01:59:34,702   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-12-29T01:59:34,703   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-12-29T01:59:34,706   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-12-29T01:59:34,707   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b_verbose
2024-12-29T01:59:34,709   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,711   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,713   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha
2024-12-29T01:59:34,715   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:34,716   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:34,718   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-12-29T01:59:34,721   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-12-29T01:59:34,722   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613
2024-12-29T01:59:34,724   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:34,725   copying build/lib/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:34,727   copying build/lib/alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct
2024-12-29T01:59:34,729   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-12-29T01:59:34,730   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b_concise
2024-12-29T01:59:34,733   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:34,734   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:34,736   copying build/lib/alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM
2024-12-29T01:59:34,738   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B-best-of-64
2024-12-29T01:59:34,739   copying build/lib/alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B-best-of-64
2024-12-29T01:59:34,742   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-12-29T01:59:34,743   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO
2024-12-29T01:59:34,745   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:34,746   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:34,748   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-12-29T01:59:34,751   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-12-29T01:59:34,752   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-12-29T01:59:34,754   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:34,755   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:34,757   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b
2024-12-29T01:59:34,760   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-12-29T01:59:34,761   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-12-29T01:59:34,764   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/NullModel
2024-12-29T01:59:34,765   copying build/lib/alpaca_eval/models_configs/NullModel/constant_output.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/NullModel
2024-12-29T01:59:34,767   copying build/lib/alpaca_eval/models_configs/NullModel/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/NullModel
2024-12-29T01:59:34,769   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:34,770   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:34,772   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B
2024-12-29T01:59:34,775   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:34,776   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:34,778   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-12-29T01:59:34,781   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:34,782   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:34,784   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-12-29T01:59:34,786   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:34,787   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:34,789   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-7b
2024-12-29T01:59:34,792   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-12-29T01:59:34,793   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2
2024-12-29T01:59:34,795   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO
2024-12-29T01:59:34,796   copying build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO
2024-12-29T01:59:34,799   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-12-29T01:59:34,800   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b-v1.3
2024-12-29T01:59:34,802   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:34,804   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:34,806   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-12-29T01:59:34,808   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:34,809   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:34,811   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-12-29T01:59:34,814   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-12-29T01:59:34,815   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.2
2024-12-29T01:59:34,817   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-12-29T01:59:34,818   copying build/lib/alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-1.8B-Chat
2024-12-29T01:59:34,821   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-12-29T01:59:34,822   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-12-29T01:59:34,824   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-12-29T01:59:34,826   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-33b-v1.3
2024-12-29T01:59:34,828   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix
2024-12-29T01:59:34,829   copying build/lib/alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix
2024-12-29T01:59:34,831   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:34,832   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:34,834   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-12-29T01:59:34,837   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-12-29T01:59:34,838   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3
2024-12-29T01:59:34,840   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:34,841   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:34,843   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/jina-chat
2024-12-29T01:59:34,846   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:34,847   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:34,849   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-sft
2024-12-29T01:59:34,851   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:34,853   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:34,855   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_1106_preview
2024-12-29T01:59:34,857   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:34,858   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:34,860   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-12-29T01:59:34,862   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-12-29T01:59:34,863   copying build/lib/alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1
2024-12-29T01:59:34,866   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:34,867   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:34,869   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/phi-2-dpo
2024-12-29T01:59:34,871   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-12-29T01:59:34,872   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-12-29T01:59:34,874   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB
2024-12-29T01:59:34,876   copying build/lib/alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB
2024-12-29T01:59:34,878   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-12-29T01:59:34,879   copying build/lib/alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/blendaxai-gm-l3-v35
2024-12-29T01:59:34,882   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:34,884   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:34,886   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-DPO
2024-12-29T01:59:34,888   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo
2024-12-29T01:59:34,889   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo
2024-12-29T01:59:34,891   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-12-29T01:59:34,893   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4-0125-preview
2024-12-29T01:59:34,895   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-12-29T01:59:34,896   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_001
2024-12-29T01:59:34,898   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:34,900   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:34,902   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B
2024-12-29T01:59:34,904   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-12-29T01:59:34,905   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-13b
2024-12-29T01:59:34,907   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-12-29T01:59:34,908   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2b-it
2024-12-29T01:59:34,911   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:34,912   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:34,914   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-12-29T01:59:34,916   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-12-29T01:59:34,917   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO
2024-12-29T01:59:34,920   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,921   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,922   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b
2024-12-29T01:59:34,925   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:34,926   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:34,928   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Yi-34B-Chat
2024-12-29T01:59:34,930   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-12-29T01:59:34,931   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-12-29T01:59:34,934   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-12-29T01:59:34,935   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-12-29T01:59:34,937   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:34,939   copying build/lib/alpaca_eval/models_configs/Storm-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:34,941   copying build/lib/alpaca_eval/models_configs/Storm-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Storm-7B
2024-12-29T01:59:34,944   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:34,945   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:34,947   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-12-29T01:59:34,949   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,950   copying build/lib/alpaca_eval/models_configs/yi-large-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,952   copying build/lib/alpaca_eval/models_configs/yi-large-preview/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/yi-large-preview
2024-12-29T01:59:34,954   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-12-29T01:59:34,956   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-12-29T01:59:34,958   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-12-29T01:59:34,959   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO
2024-12-29T01:59:34,962   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,964   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,966   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-alpha-ExPO
2024-12-29T01:59:34,968   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:34,970   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:34,971   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/chatglm2-6b
2024-12-29T01:59:34,974   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:34,976   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:34,978   copying build/lib/alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/merlinite-7B-AOT
2024-12-29T01:59:34,980   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:34,981   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:34,983   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-orpo-beta
2024-12-29T01:59:34,985   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-12-29T01:59:34,987   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-12-29T01:59:34,989   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-12-29T01:59:34,990   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-12-29T01:59:34,993   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-12-29T01:59:34,994   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/dbrx-instruct
2024-12-29T01:59:34,996   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-12-29T01:59:34,997   copying build/lib/alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-mini-2024-07-18
2024-12-29T01:59:35,000   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:35,001   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:35,003   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-medium
2024-12-29T01:59:35,005   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-12-29T01:59:35,006   copying build/lib/alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-4o-2024-08-06
2024-12-29T01:59:35,009   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:35,010   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:35,012   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:35,013   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-12-29T01:59:35,016   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:35,017   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:35,018   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cut-13b
2024-12-29T01:59:35,021   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-12-29T01:59:35,022   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-65b
2024-12-29T01:59:35,024   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-12-29T01:59:35,025   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO
2024-12-29T01:59:35,028   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:35,029   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:35,031   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B
2024-12-29T01:59:35,033   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-12-29T01:59:35,034   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/evo-7b
2024-12-29T01:59:35,037   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct
2024-12-29T01:59:35,038   copying build/lib/alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct
2024-12-29T01:59:35,040   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/blendaxai-gm-l6-vo31
2024-12-29T01:59:35,042   copying build/lib/alpaca_eval/models_configs/blendaxai-gm-l6-vo31/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/blendaxai-gm-l6-vo31
2024-12-29T01:59:35,044   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-12-29T01:59:35,045   copying build/lib/alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/internlm2-chat-7b-ExPO
2024-12-29T01:59:35,047   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-12-29T01:59:35,048   copying build/lib/alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/higgs-llama-3-70b-v2
2024-12-29T01:59:35,051   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-12-29T01:59:35,052   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cohere
2024-12-29T01:59:35,054   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/cohere
2024-12-29T01:59:35,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TOA
2024-12-29T01:59:35,057   copying build/lib/alpaca_eval/models_configs/TOA/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TOA
2024-12-29T01:59:35,059   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:35,060   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:35,062   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemini-pro
2024-12-29T01:59:35,065   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:35,066   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:35,068   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM
2024-12-29T01:59:35,070   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-12-29T01:59:35,071   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-12-29T01:59:35,074   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:35,075   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:35,077   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:35,079   copying build/lib/alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09
2024-12-29T01:59:35,081   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:35,082   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:35,084   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B
2024-12-29T01:59:35,087   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:35,088   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:35,090   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/nous-hermes-13b
2024-12-29T01:59:35,092   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-12-29T01:59:35,093   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/falcon-40b-instruct
2024-12-29T01:59:35,096   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-12-29T01:59:35,097   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat8192-13b
2024-12-29T01:59:35,099   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-12-29T01:59:35,100   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4
2024-12-29T01:59:35,102   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4
2024-12-29T01:59:35,104   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-12-29T01:59:35,105   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-7b-v1.5
2024-12-29T01:59:35,107   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:35,109   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:35,110   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_verbose
2024-12-29T01:59:35,113   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:35,114   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:35,116   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-12-29T01:59:35,118   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-12-29T01:59:35,120   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-1.5-3b
2024-12-29T01:59:35,122   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-12-29T01:59:35,123   copying build/lib/alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB
2024-12-29T01:59:35,126   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-12-29T01:59:35,127   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_gamed
2024-12-29T01:59:35,129   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:35,131   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:35,133   copying build/lib/alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct
2024-12-29T01:59:35,135   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:35,136   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:35,138   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-llama-33b
2024-12-29T01:59:35,141   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-12-29T01:59:35,142   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1
2024-12-29T01:59:35,144   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:35,145   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:35,147   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minichat-3b
2024-12-29T01:59:35,150   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:35,151   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:35,153   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-12-29T01:59:35,155   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-12-29T01:59:35,156   copying build/lib/alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO
2024-12-29T01:59:35,158   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:35,159   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:35,161   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B
2024-12-29T01:59:35,164   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:35,165   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:35,167   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-12-29T01:59:35,169   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-12-29T01:59:35,170   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-beta
2024-12-29T01:59:35,173   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:35,174   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:35,176   copying build/lib/alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-7b-alpha
2024-12-29T01:59:35,178   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:35,179   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:35,181   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-13b
2024-12-29T01:59:35,183   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:35,185   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:35,186   copying build/lib/alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ghost-8b-beta-disl-0x5
2024-12-29T01:59:35,189   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:35,190   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:35,192   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-12-29T01:59:35,194   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-12-29T01:59:35,195   copying build/lib/alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-14B-Chat
2024-12-29T01:59:35,198   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-12-29T01:59:35,199   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/mistral-large-2402
2024-12-29T01:59:35,201   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:35,202   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:35,204   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-70b
2024-12-29T01:59:35,206   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:35,207   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:35,209   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B
2024-12-29T01:59:35,212   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA-Lite
2024-12-29T01:59:35,213   copying build/lib/alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Together-MoA-Lite
2024-12-29T01:59:35,215   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:35,216   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:35,218   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-12-29T01:59:35,221   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-12-29T01:59:35,222   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-12-29T01:59:35,224   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-12-29T01:59:35,225   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude2-alpaca-13b
2024-12-29T01:59:35,228   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-12-29T01:59:35,229   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude
2024-12-29T01:59:35,231   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude
2024-12-29T01:59:35,233   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:35,235   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:35,237   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2.1_concise
2024-12-29T01:59:35,239   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-12-29T01:59:35,240   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-12-29T01:59:35,242   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-12-29T01:59:35,243   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-12-29T01:59:35,246   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Together-MoA
2024-12-29T01:59:35,247   copying build/lib/alpaca_eval/models_configs/Together-MoA/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Together-MoA
2024-12-29T01:59:35,250   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-12-29T01:59:35,251   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/pythia-12b-mix-sft
2024-12-29T01:59:35,253   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:35,254   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:35,256   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b
2024-12-29T01:59:35,259   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:35,260   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:35,262   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Ein-70B-v0.1
2024-12-29T01:59:35,264   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-12-29T01:59:35,265   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/zephyr-7b-beta-ExPO
2024-12-29T01:59:35,267   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:35,269   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:35,270   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:35,272   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-12-29T01:59:35,275   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:35,276   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:35,278   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/ultralm-13b-v2.0
2024-12-29T01:59:35,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:35,281   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:35,283   copying build/lib/alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-5-sonnet-20240620
2024-12-29T01:59:35,285   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:35,286   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:35,288   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-7b-neft
2024-12-29T01:59:35,290   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-12-29T01:59:35,291   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-12-29T01:59:35,294   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-12-29T01:59:35,295   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deita-7b-v1.0
2024-12-29T01:59:35,298   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-12-29T01:59:35,299   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo
2024-12-29T01:59:35,301   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:35,302   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:35,304   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Samba-CoE-v0.1
2024-12-29T01:59:35,306   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-12-29T01:59:35,307   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b
2024-12-29T01:59:35,310   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-12-29T01:59:35,311   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-12-29T01:59:35,314   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-12-29T01:59:35,315   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.5
2024-12-29T01:59:35,317   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:35,318   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:35,320   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-12-29T01:59:35,322   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:35,324   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:35,326   copying build/lib/alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Nanbeige2-16B-Chat
2024-12-29T01:59:35,328   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:35,329   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:35,330   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-12-29T01:59:35,333   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:35,334   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:35,336   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B
2024-12-29T01:59:35,338   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:35,339   copying build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:35,341   copying build/lib/alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen2-72B-Instruct
2024-12-29T01:59:35,343   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,344   copying build/lib/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,346   copying build/lib/alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,349   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:35,350   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:35,352   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-12-29T01:59:35,354   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,355   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,357   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B
2024-12-29T01:59:35,359   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:35,360   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:35,362   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/platolm-7b
2024-12-29T01:59:35,365   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-12-29T01:59:35,366   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO
2024-12-29T01:59:35,368   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:35,369   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:35,371   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/causallm-14b
2024-12-29T01:59:35,373   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:35,375   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:35,376   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-12-29T01:59:35,379   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-12-29T01:59:35,380   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/openchat-v3.1-13b
2024-12-29T01:59:35,382   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:35,383   copying build/lib/alpaca_eval/models_configs/Llama3-PBM-Nova-70B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:35,386   copying build/lib/alpaca_eval/models_configs/Llama3-PBM-Nova-70B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama3-PBM-Nova-70B
2024-12-29T01:59:35,388   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-12-29T01:59:35,389   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai
2024-12-29T01:59:35,391   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-12-29T01:59:35,392   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-3-opus-20240229
2024-12-29T01:59:35,395   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-12-29T01:59:35,396   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/bedrock_claude
2024-12-29T01:59:35,398   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-12-29T01:59:35,399   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO
2024-12-29T01:59:35,402   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-12-29T01:59:35,403   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-12-29T01:59:35,405   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-12-29T01:59:35,407   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gpt4_0613_verbose
2024-12-29T01:59:35,409   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-12-29T01:59:35,410   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-12-29T01:59:35,413   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:35,414   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:35,416   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-12-29T01:59:35,418   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:35,419   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:35,421   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-12-29T01:59:35,423   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:35,424   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:35,426   copying build/lib/alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA
2024-12-29T01:59:35,428   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:35,429   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:35,431   copying build/lib/alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO
2024-12-29T01:59:35,434   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-12-29T01:59:35,435   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/falcon-7b-instruct
2024-12-29T01:59:35,437   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:35,438   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:35,440   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-12-29T01:59:35,443   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:35,444   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:35,446   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/text_davinci_003
2024-12-29T01:59:35,448   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-12-29T01:59:35,449   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/baize-v2-7b
2024-12-29T01:59:35,451   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-12-29T01:59:35,453   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/guanaco-13b
2024-12-29T01:59:35,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:35,456   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:35,458   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-12-29T01:59:35,460   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:35,461   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:35,463   copying build/lib/alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B
2024-12-29T01:59:35,465   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Shopee-SlimMoA-v1
2024-12-29T01:59:35,466   copying build/lib/alpaca_eval/models_configs/Shopee-SlimMoA-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Shopee-SlimMoA-v1
2024-12-29T01:59:35,469   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-12-29T01:59:35,470   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-instant-1.2
2024-12-29T01:59:35,472   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:35,473   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:35,475   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-12-29T01:59:35,478   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-12-29T01:59:35,479   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-12-29T01:59:35,481   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:35,482   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:35,484   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Qwen-14B-Chat
2024-12-29T01:59:35,487   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-12-29T01:59:35,488   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/gemma-7b-it
2024-12-29T01:59:35,490   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:35,491   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:35,493   copying build/lib/alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM
2024-12-29T01:59:35,495   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:35,497   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:35,498   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/minotaur-13b
2024-12-29T01:59:35,501   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:35,502   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:35,504   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/Conifer-7B-DPO
2024-12-29T01:59:35,506   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-12-29T01:59:35,507   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-12-29T01:59:35,510   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-12-29T01:59:35,511   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/./alpaca_eval/models_configs/claude-2
2024-12-29T01:59:35,513   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-12-29T01:59:35,514   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-12-29T01:59:35,516   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-12-29T01:59:35,518   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-12-29T01:59:35,521   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/metrics
2024-12-29T01:59:35,523   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-12-29T01:59:35,524   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-12-29T01:59:35,527   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-12-29T01:59:35,528   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/annotators
2024-12-29T01:59:35,532   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-12-29T01:59:35,533   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,535   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,537   copying build/lib/alpaca_eval/decoders/cache.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,539   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,541   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,543   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,545   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,547   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,549   copying build/lib/alpaca_eval/decoders/test.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,550   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,553   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,555   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,557   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval/decoders
2024-12-29T01:59:35,559   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,561   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,564   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,566   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,568   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-12-29T01:59:35,570   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,571   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,573   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,575   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,577   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,579   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval_2
2024-12-29T01:59:35,581   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-12-29T01:59:35,583   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/evaluators
2024-12-29T01:59:35,586   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:35,587   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:35,589   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:35,591   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:35,593   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/./alpaca_eval/leaderboards/data_AlpacaEval
2024-12-29T01:59:35,594   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,597   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/./alpaca_eval
2024-12-29T01:59:35,599   running install_egg_info
2024-12-29T01:59:35,633   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/./alpaca_eval-0.6.6-py3.11.egg-info
2024-12-29T01:59:35,646   running install_scripts
2024-12-29T01:59:35,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.6.dist-info/WHEEL
2024-12-29T01:59:35,688   creating '/tmp/pip-wheel-8ys5pya9/alpaca_eval-0.6.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-12-29T01:59:35,690   adding 'alpaca_eval/__init__.py'
2024-12-29T01:59:35,693   adding 'alpaca_eval/analyze.py'
2024-12-29T01:59:35,696   adding 'alpaca_eval/completion_parsers.py'
2024-12-29T01:59:35,698   adding 'alpaca_eval/constants.py'
2024-12-29T01:59:35,701   adding 'alpaca_eval/main.py'
2024-12-29T01:59:35,705   adding 'alpaca_eval/plotting.py'
2024-12-29T01:59:35,707   adding 'alpaca_eval/processors.py'
2024-12-29T01:59:35,708   adding 'alpaca_eval/types.py'
2024-12-29T01:59:35,712   adding 'alpaca_eval/utils.py'
2024-12-29T01:59:35,714   adding 'alpaca_eval/annotators/__init__.py'
2024-12-29T01:59:35,718   adding 'alpaca_eval/annotators/base.py'
2024-12-29T01:59:35,721   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-12-29T01:59:35,723   adding 'alpaca_eval/decoders/__init__.py'
2024-12-29T01:59:35,725   adding 'alpaca_eval/decoders/anthropic.py'
2024-12-29T01:59:35,726   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-12-29T01:59:35,727   adding 'alpaca_eval/decoders/cache.py'
2024-12-29T01:59:35,729   adding 'alpaca_eval/decoders/cohere.py'
2024-12-29T01:59:35,730   adding 'alpaca_eval/decoders/google.py'
2024-12-29T01:59:35,732   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-12-29T01:59:35,733   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-12-29T01:59:35,735   adding 'alpaca_eval/decoders/jinachat.py'
2024-12-29T01:59:35,737   adding 'alpaca_eval/decoders/openai.py'
2024-12-29T01:59:35,738   adding 'alpaca_eval/decoders/replicate.py'
2024-12-29T01:59:35,739   adding 'alpaca_eval/decoders/test.py'
2024-12-29T01:59:35,741   adding 'alpaca_eval/decoders/vllm_local.py'
2024-12-29T01:59:35,744   adding 'alpaca_eval/evaluators_configs/README.md'
2024-12-29T01:59:35,745   adding 'alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/config.yaml'
2024-12-29T01:59:35,747   adding 'alpaca_eval/evaluators_configs/Self-taught-llama3.1-70B-dpo/self_taught.txt'
2024-12-29T01:59:35,748   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-12-29T01:59:35,749   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-12-29T01:59:35,751   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-12-29T01:59:35,752   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-12-29T01:59:35,754   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-12-29T01:59:35,755   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-12-29T01:59:35,757   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-12-29T01:59:35,758   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-12-29T01:59:35,760   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-12-29T01:59:35,762   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-12-29T01:59:35,763   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-12-29T01:59:35,764   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-12-29T01:59:35,766   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-12-29T01:59:35,767   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-12-29T01:59:35,769   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt'
2024-12-29T01:59:35,770   adding 'alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml'
2024-12-29T01:59:35,772   adding 'alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt'
2024-12-29T01:59:35,773   adding 'alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml'
2024-12-29T01:59:35,775   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-12-29T01:59:35,777   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-12-29T01:59:35,778   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-12-29T01:59:35,780   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-12-29T01:59:35,781   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-12-29T01:59:35,783   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-12-29T01:59:35,786   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-12-29T01:59:35,787   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-12-29T01:59:35,789   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-12-29T01:59:35,790   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-12-29T01:59:35,792   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-12-29T01:59:35,793   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-12-29T01:59:35,795   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-12-29T01:59:35,797   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-12-29T01:59:35,798   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-12-29T01:59:35,800   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-12-29T01:59:35,801   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-12-29T01:59:35,803   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-12-29T01:59:35,805   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-12-29T01:59:35,806   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-12-29T01:59:35,807   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-12-29T01:59:35,809   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-12-29T01:59:35,811   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-12-29T01:59:35,812   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-12-29T01:59:35,813   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-12-29T01:59:35,815   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-12-29T01:59:35,817   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-12-29T01:59:35,818   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-12-29T01:59:35,820   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-12-29T01:59:35,821   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-12-29T01:59:35,823   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-12-29T01:59:35,825   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-12-29T01:59:35,826   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-12-29T01:59:35,827   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-12-29T01:59:35,829   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-12-29T01:59:35,831   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-12-29T01:59:35,832   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-12-29T01:59:35,834   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-12-29T01:59:35,835   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-12-29T01:59:35,837   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-12-29T01:59:35,838   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-12-29T01:59:35,840   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-12-29T01:59:35,842   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-12-29T01:59:35,843   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-12-29T01:59:35,845   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-12-29T01:59:35,846   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-12-29T01:59:35,848   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-12-29T01:59:35,849   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-12-29T01:59:35,851   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-12-29T01:59:35,853   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-12-29T01:59:35,854   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-12-29T01:59:35,855   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-12-29T01:59:35,857   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-12-29T01:59:35,858   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-12-29T01:59:35,860   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-12-29T01:59:35,861   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt-4o-mini-2024-07-18/configs.yaml'
2024-12-29T01:59:35,863   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-12-29T01:59:35,865   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml'
2024-12-29T01:59:35,866   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/README.md'
2024-12-29T01:59:35,868   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_vllm_llama3_70b/configs.yaml'
2024-12-29T01:59:35,871   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-12-29T01:59:35,872   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-12-29T01:59:35,873   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-12-29T01:59:35,874   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-12-29T01:59:35,876   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-12-29T01:59:35,878   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-12-29T01:59:35,879   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-12-29T01:59:35,880   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-12-29T01:59:35,885   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-12-29T01:59:35,888   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-12-29T01:59:35,890   adding 'alpaca_eval/metrics/__init__.py'
2024-12-29T01:59:35,892   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-12-29T01:59:35,893   adding 'alpaca_eval/metrics/helpers.py'
2024-12-29T01:59:35,895   adding 'alpaca_eval/metrics/winrate.py'
2024-12-29T01:59:35,901   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-12-29T01:59:35,902   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-12-29T01:59:35,904   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-12-29T01:59:35,905   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-12-29T01:59:35,907   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-12-29T01:59:35,908   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-12-29T01:59:35,909   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-12-29T01:59:35,910   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-12-29T01:59:35,912   adding 'alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml'
2024-12-29T01:59:35,914   adding 'alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/configs.yaml'
2024-12-29T01:59:35,915   adding 'alpaca_eval/models_configs/FuseChat-Gemma-2-9B-Instruct/prompt.txt'
2024-12-29T01:59:35,917   adding 'alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/configs.yaml'
2024-12-29T01:59:35,918   adding 'alpaca_eval/models_configs/FuseChat-Llama-3.1-8B-Instruct/prompt.txt'
2024-12-29T01:59:35,920   adding 'alpaca_eval/models_configs/FuseChat-Llama-3.2-1B-Instruct/configs.yaml'
2024-12-29T01:59:35,922   adding 'alpaca_eval/models_configs/FuseChat-Llama-3.2-3B-Instruct/configs.yaml'
2024-12-29T01:59:35,923   adding 'alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/configs.yaml'
2024-12-29T01:59:35,925   adding 'alpaca_eval/models_configs/FuseChat-Qwen-2.5-7B-Instruct/prompt.txt'
2024-12-29T01:59:35,926   adding 'alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml'
2024-12-29T01:59:35,927   adding 'alpaca_eval/models_configs/GPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt'
2024-12-29T01:59:35,929   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml'
2024-12-29T01:59:35,930   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt'
2024-12-29T01:59:35,931   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml'
2024-12-29T01:59:35,933   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt'
2024-12-29T01:59:35,935   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml'
2024-12-29T01:59:35,936   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt'
2024-12-29T01:59:35,937   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml'
2024-12-29T01:59:35,939   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt'
2024-12-29T01:59:35,940   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml'
2024-12-29T01:59:35,941   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt'
2024-12-29T01:59:35,943   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml'
2024-12-29T01:59:35,944   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt'
2024-12-29T01:59:35,946   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml'
2024-12-29T01:59:35,947   adding 'alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt'
2024-12-29T01:59:35,948   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml'
2024-12-29T01:59:35,949   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt'
2024-12-29T01:59:35,951   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml'
2024-12-29T01:59:35,952   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt'
2024-12-29T01:59:35,954   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml'
2024-12-29T01:59:35,955   adding 'alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt'
2024-12-29T01:59:35,956   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-12-29T01:59:35,958   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-12-29T01:59:35,959   adding 'alpaca_eval/models_configs/Llama-3-8B-Instruct-SkillMix/configs.yaml'
2024-12-29T01:59:35,961   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/configs.yaml'
2024-12-29T01:59:35,962   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-RainbowPO/prompt.txt'
2024-12-29T01:59:35,964   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml'
2024-12-29T01:59:35,965   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt'
2024-12-29T01:59:35,967   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml'
2024-12-29T01:59:35,968   adding 'alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml'
2024-12-29T01:59:35,970   adding 'alpaca_eval/models_configs/Llama3-PBM-Nova-70B/configs.yaml'
2024-12-29T01:59:35,971   adding 'alpaca_eval/models_configs/Llama3-PBM-Nova-70B/prompt.txt'
2024-12-29T01:59:35,973   adding 'alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml'
2024-12-29T01:59:35,974   adding 'alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml'
2024-12-29T01:59:35,976   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml'
2024-12-29T01:59:35,978   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml'
2024-12-29T01:59:35,979   adding 'alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml'
2024-12-29T01:59:35,981   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml'
2024-12-29T01:59:35,982   adding 'alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt'
2024-12-29T01:59:35,983   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-12-29T01:59:35,985   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml'
2024-12-29T01:59:35,986   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-12-29T01:59:35,987   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-12-29T01:59:35,989   adding 'alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml'
2024-12-29T01:59:35,990   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-12-29T01:59:35,992   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-12-29T01:59:35,993   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-12-29T01:59:35,994   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-12-29T01:59:35,996   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-12-29T01:59:35,997   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-12-29T01:59:35,999   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml'
2024-12-29T01:59:36,000   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt'
2024-12-29T01:59:36,002   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml'
2024-12-29T01:59:36,003   adding 'alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt'
2024-12-29T01:59:36,005   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-12-29T01:59:36,006   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-12-29T01:59:36,008   adding 'alpaca_eval/models_configs/NullModel/configs.yaml'
2024-12-29T01:59:36,009   adding 'alpaca_eval/models_configs/NullModel/constant_output.txt'
2024-12-29T01:59:36,011   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-12-29T01:59:36,012   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-12-29T01:59:36,014   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-12-29T01:59:36,015   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-12-29T01:59:36,016   adding 'alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml'
2024-12-29T01:59:36,018   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml'
2024-12-29T01:59:36,019   adding 'alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt'
2024-12-29T01:59:36,021   adding 'alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml'
2024-12-29T01:59:36,023   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-12-29T01:59:36,024   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-12-29T01:59:36,025   adding 'alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml'
2024-12-29T01:59:36,027   adding 'alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml'
2024-12-29T01:59:36,028   adding 'alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt'
2024-12-29T01:59:36,030   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml'
2024-12-29T01:59:36,031   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt'
2024-12-29T01:59:36,033   adding 'alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct-Armo/configs.yaml'
2024-12-29T01:59:36,035   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml'
2024-12-29T01:59:36,036   adding 'alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt'
2024-12-29T01:59:36,037   adding 'alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/configs.yaml'
2024-12-29T01:59:36,039   adding 'alpaca_eval/models_configs/SPPO-Llama-3-8B-Instruct-GPM-2B/prompt.txt'
2024-12-29T01:59:36,040   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml'
2024-12-29T01:59:36,041   adding 'alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt'
2024-12-29T01:59:36,043   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml'
2024-12-29T01:59:36,044   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt'
2024-12-29T01:59:36,046   adding 'alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml'
2024-12-29T01:59:36,047   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-12-29T01:59:36,048   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-12-29T01:59:36,050   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-12-29T01:59:36,051   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-12-29T01:59:36,053   adding 'alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-SimPO/configs.yaml'
2024-12-29T01:59:36,054   adding 'alpaca_eval/models_configs/SelfMoA_gemma-2-9b-it-WPO-HB/configs.yaml'
2024-12-29T01:59:36,056   adding 'alpaca_eval/models_configs/Shopee-SlimMoA-v1/configs.yaml'
2024-12-29T01:59:36,057   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-12-29T01:59:36,058   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-12-29T01:59:36,060   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-12-29T01:59:36,061   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-12-29T01:59:36,063   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-12-29T01:59:36,064   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-12-29T01:59:36,066   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml'
2024-12-29T01:59:36,067   adding 'alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml'
2024-12-29T01:59:36,069   adding 'alpaca_eval/models_configs/Storm-7B/configs.yaml'
2024-12-29T01:59:36,070   adding 'alpaca_eval/models_configs/Storm-7B/prompt.txt'
2024-12-29T01:59:36,071   adding 'alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml'
2024-12-29T01:59:36,073   adding 'alpaca_eval/models_configs/TOA/configs.yaml'
2024-12-29T01:59:36,074   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-12-29T01:59:36,076   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-12-29T01:59:36,077   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-12-29T01:59:36,079   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-12-29T01:59:36,080   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-12-29T01:59:36,081   adding 'alpaca_eval/models_configs/Together-MoA/configs.yaml'
2024-12-29T01:59:36,083   adding 'alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml'
2024-12-29T01:59:36,085   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-12-29T01:59:36,086   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-12-29T01:59:36,088   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-12-29T01:59:36,089   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-12-29T01:59:36,091   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-12-29T01:59:36,092   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-12-29T01:59:36,094   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-12-29T01:59:36,095   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-12-29T01:59:36,097   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-12-29T01:59:36,098   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-12-29T01:59:36,099   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml'
2024-12-29T01:59:36,101   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml'
2024-12-29T01:59:36,102   adding 'alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt'
2024-12-29T01:59:36,103   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-12-29T01:59:36,104   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-12-29T01:59:36,105   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-12-29T01:59:36,107   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-12-29T01:59:36,108   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-12-29T01:59:36,109   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-12-29T01:59:36,110   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-12-29T01:59:36,112   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-12-29T01:59:36,114   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-12-29T01:59:36,115   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-12-29T01:59:36,117   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-12-29T01:59:36,118   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-12-29T01:59:36,119   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-12-29T01:59:36,121   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-12-29T01:59:36,122   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-12-29T01:59:36,123   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-12-29T01:59:36,125   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-12-29T01:59:36,127   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-12-29T01:59:36,128   adding 'alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml'
2024-12-29T01:59:36,130   adding 'alpaca_eval/models_configs/blendaxai-gm-l6-vo31/configs.yaml'
2024-12-29T01:59:36,131   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-12-29T01:59:36,132   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-12-29T01:59:36,134   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-12-29T01:59:36,135   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-12-29T01:59:36,137   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-12-29T01:59:36,138   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-12-29T01:59:36,139   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-12-29T01:59:36,141   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-12-29T01:59:36,143   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-12-29T01:59:36,144   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-12-29T01:59:36,146   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-12-29T01:59:36,147   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-12-29T01:59:36,148   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml'
2024-12-29T01:59:36,149   adding 'alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt'
2024-12-29T01:59:36,151   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-12-29T01:59:36,153   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-12-29T01:59:36,154   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-12-29T01:59:36,156   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-12-29T01:59:36,157   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-12-29T01:59:36,159   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-12-29T01:59:36,160   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-12-29T01:59:36,162   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-12-29T01:59:36,163   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-12-29T01:59:36,164   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-12-29T01:59:36,166   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-12-29T01:59:36,167   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-12-29T01:59:36,168   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-12-29T01:59:36,170   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-12-29T01:59:36,171   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-12-29T01:59:36,173   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-12-29T01:59:36,174   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-12-29T01:59:36,176   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-12-29T01:59:36,177   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-12-29T01:59:36,179   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-12-29T01:59:36,181   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml'
2024-12-29T01:59:36,182   adding 'alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt'
2024-12-29T01:59:36,183   adding 'alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml'
2024-12-29T01:59:36,185   adding 'alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml'
2024-12-29T01:59:36,186   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-12-29T01:59:36,188   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-12-29T01:59:36,189   adding 'alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml'
2024-12-29T01:59:36,191   adding 'alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt'
2024-12-29T01:59:36,192   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml'
2024-12-29T01:59:36,193   adding 'alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt'
2024-12-29T01:59:36,195   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-12-29T01:59:36,196   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-12-29T01:59:36,198   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-12-29T01:59:36,199   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-12-29T01:59:36,201   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-12-29T01:59:36,203   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-12-29T01:59:36,204   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-12-29T01:59:36,206   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-12-29T01:59:36,208   adding 'alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml'
2024-12-29T01:59:36,209   adding 'alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml'
2024-12-29T01:59:36,211   adding 'alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml'
2024-12-29T01:59:36,212   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-12-29T01:59:36,214   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-12-29T01:59:36,215   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-12-29T01:59:36,217   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-12-29T01:59:36,218   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-12-29T01:59:36,220   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-12-29T01:59:36,221   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-12-29T01:59:36,223   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-12-29T01:59:36,224   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-12-29T01:59:36,226   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-12-29T01:59:36,227   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-12-29T01:59:36,229   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-12-29T01:59:36,230   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-12-29T01:59:36,231   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-12-29T01:59:36,233   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-12-29T01:59:36,235   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-12-29T01:59:36,236   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-12-29T01:59:36,238   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-12-29T01:59:36,239   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-12-29T01:59:36,240   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-12-29T01:59:36,242   adding 'alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml'
2024-12-29T01:59:36,243   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-12-29T01:59:36,245   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-12-29T01:59:36,246   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-12-29T01:59:36,248   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml'
2024-12-29T01:59:36,249   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-12-29T01:59:36,250   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-12-29T01:59:36,252   adding 'alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml'
2024-12-29T01:59:36,254   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-12-29T01:59:36,255   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-12-29T01:59:36,257   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-12-29T01:59:36,258   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-12-29T01:59:36,259   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-12-29T01:59:36,261   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-12-29T01:59:36,262   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-12-29T01:59:36,264   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-12-29T01:59:36,265   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-12-29T01:59:36,267   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml'
2024-12-29T01:59:36,268   adding 'alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt'
2024-12-29T01:59:36,269   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-12-29T01:59:36,271   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-12-29T01:59:36,272   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-12-29T01:59:36,274   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-12-29T01:59:36,275   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-12-29T01:59:36,277   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-12-29T01:59:36,279   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-12-29T01:59:36,280   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-12-29T01:59:36,282   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-12-29T01:59:36,283   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-12-29T01:59:36,285   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-12-29T01:59:36,286   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-12-29T01:59:36,287   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-12-29T01:59:36,289   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-12-29T01:59:36,290   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-12-29T01:59:36,292   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-12-29T01:59:36,293   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-12-29T01:59:36,295   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-12-29T01:59:36,296   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-12-29T01:59:36,297   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-12-29T01:59:36,299   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-12-29T01:59:36,300   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-12-29T01:59:36,301   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-12-29T01:59:36,303   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-12-29T01:59:36,304   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-12-29T01:59:36,306   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-12-29T01:59:36,307   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-12-29T01:59:36,308   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-12-29T01:59:36,310   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-12-29T01:59:36,311   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-12-29T01:59:36,312   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-12-29T01:59:36,314   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-12-29T01:59:36,315   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-12-29T01:59:36,317   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-12-29T01:59:36,318   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-12-29T01:59:36,320   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-12-29T01:59:36,321   adding 'alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml'
2024-12-29T01:59:36,323   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-12-29T01:59:36,325   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-12-29T01:59:36,326   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-12-29T01:59:36,327   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-12-29T01:59:36,330   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-12-29T01:59:36,544   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-12-29T01:59:36,545   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-12-29T01:59:36,546   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-12-29T01:59:36,548   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-12-29T01:59:36,549   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-12-29T01:59:36,550   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-12-29T01:59:36,552   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-12-29T01:59:36,553   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-12-29T01:59:36,555   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-12-29T01:59:36,556   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-12-29T01:59:36,558   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-12-29T01:59:36,560   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-12-29T01:59:36,561   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-12-29T01:59:36,562   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-12-29T01:59:36,564   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-12-29T01:59:36,566   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml'
2024-12-29T01:59:36,568   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-12-29T01:59:36,569   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-12-29T01:59:36,571   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml'
2024-12-29T01:59:36,572   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-12-29T01:59:36,574   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml'
2024-12-29T01:59:36,575   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-12-29T01:59:36,576   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-12-29T01:59:36,578   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-12-29T01:59:36,579   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-12-29T01:59:36,580   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-12-29T01:59:36,581   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-12-29T01:59:36,583   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-12-29T01:59:36,584   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-12-29T01:59:36,585   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-12-29T01:59:36,587   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-12-29T01:59:36,589   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-12-29T01:59:36,590   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml'
2024-12-29T01:59:36,592   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-12-29T01:59:36,593   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-12-29T01:59:36,595   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-12-29T01:59:36,596   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-12-29T01:59:36,598   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-12-29T01:59:36,599   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-12-29T01:59:36,600   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-12-29T01:59:36,602   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-12-29T01:59:36,603   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-12-29T01:59:36,605   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-12-29T01:59:36,606   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-12-29T01:59:36,608   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-12-29T01:59:36,609   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-12-29T01:59:36,611   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-12-29T01:59:36,612   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-12-29T01:59:36,614   adding 'alpaca_eval/models_configs/yi-large-preview/configs.yaml'
2024-12-29T01:59:36,615   adding 'alpaca_eval/models_configs/yi-large-preview/prompt.txt'
2024-12-29T01:59:36,617   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-12-29T01:59:36,618   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-12-29T01:59:36,620   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml'
2024-12-29T01:59:36,621   adding 'alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt'
2024-12-29T01:59:36,622   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-12-29T01:59:36,624   adding 'alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml'
2024-12-29T01:59:36,627   adding 'alpaca_eval-0.6.6.dist-info/LICENSE'
2024-12-29T01:59:36,639   adding 'alpaca_eval-0.6.6.dist-info/METADATA'
2024-12-29T01:59:36,641   adding 'alpaca_eval-0.6.6.dist-info/WHEEL'
2024-12-29T01:59:36,642   adding 'alpaca_eval-0.6.6.dist-info/entry_points.txt'
2024-12-29T01:59:36,643   adding 'alpaca_eval-0.6.6.dist-info/top_level.txt'
2024-12-29T01:59:36,650   adding 'alpaca_eval-0.6.6.dist-info/RECORD'
2024-12-29T01:59:36,661   removing build/bdist.linux-armv7l/wheel
2024-12-29T01:59:37,002   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-12-29T01:59:37,009   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.6-py3-none-any.whl size=361731 sha256=3a4af49480f0e993d8b98a8a35ce8a69a471511f0d68a53324efb16198f15087
2024-12-29T01:59:37,010   Stored in directory: /tmp/pip-ephem-wheel-cache-d77leqv5/wheels/2a/ed/70/8514d915d2a0e73072422e53b150d71866d1100baaff379d6f
2024-12-29T01:59:37,051 Successfully built alpaca-eval
2024-12-29T01:59:37,065 Removed build tracker: '/tmp/pip-build-tracker-tsfmhksf'