2024-02-24T09:53:07,568 Created temporary directory: /tmp/pip-build-tracker-m7fnf4dx
2024-02-24T09:53:07,569 Initialized build tracking at /tmp/pip-build-tracker-m7fnf4dx
2024-02-24T09:53:07,569 Created build tracker: /tmp/pip-build-tracker-m7fnf4dx
2024-02-24T09:53:07,570 Entered build tracker: /tmp/pip-build-tracker-m7fnf4dx
2024-02-24T09:53:07,571 Created temporary directory: /tmp/pip-wheel-qnuophe1
2024-02-24T09:53:07,574 Created temporary directory: /tmp/pip-ephem-wheel-cache-uo6pa09u
2024-02-24T09:53:07,599 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-02-24T09:53:07,602 2 location(s) to search for versions of alpaca-eval:
2024-02-24T09:53:07,602 * https://pypi.org/simple/alpaca-eval/
2024-02-24T09:53:07,602 * https://www.piwheels.org/simple/alpaca-eval/
2024-02-24T09:53:07,603 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-02-24T09:53:07,604 Getting page https://pypi.org/simple/alpaca-eval/
2024-02-24T09:53:07,605 Found index url https://pypi.org/simple/
2024-02-24T09:53:07,827 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-02-24T09:53:07,838   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:07,839   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-02-24T09:53:07,840   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:07,841   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-02-24T09:53:07,842   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:07,843   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-02-24T09:53:07,844   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,845   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-02-24T09:53:07,845   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,846   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-02-24T09:53:07,847   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,848   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-02-24T09:53:07,849   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,850   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-02-24T09:53:07,851   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,852   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-02-24T09:53:07,852   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,853   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-02-24T09:53:07,854   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,855   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-02-24T09:53:07,856   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,856   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-02-24T09:53:07,857   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,858   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-02-24T09:53:07,859   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,860   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-02-24T09:53:07,861   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,862   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-02-24T09:53:07,863   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,863   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-02-24T09:53:07,864   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,865   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-02-24T09:53:07,865   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,866   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-02-24T09:53:07,867   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,868   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-02-24T09:53:07,869   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,870   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-02-24T09:53:07,870   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,871   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-02-24T09:53:07,872   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,873   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-02-24T09:53:07,874   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,875   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-02-24T09:53:07,875   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,876   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-02-24T09:53:07,877   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,877   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-02-24T09:53:07,878   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,879   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-02-24T09:53:07,880   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,881   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-02-24T09:53:07,881   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,882   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-02-24T09:53:07,883   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,884   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-02-24T09:53:07,885   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,886   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-02-24T09:53:07,887   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:07,887   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-02-24T09:53:07,888 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-02-24T09:53:07,889 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-02-24T09:53:07,890 Found index url https://www.piwheels.org/simple/
2024-02-24T09:53:12,149 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-02-24T09:53:12,166   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,167   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,168   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,169   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,170   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,171   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,172   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,173   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,174   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,175   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,176   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,176   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,177   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,178   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,179   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,179   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,180   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,181   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,182   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,183   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,184   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,185   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-02-24T09:53:12,186   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:12,187   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:12,187   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-02-24T09:53:12,188 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-02-24T09:53:12,189 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-02-24T09:53:12,234 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-02-24T09:53:12,264 Collecting alpaca-eval==0.5.4
2024-02-24T09:53:12,266   Created temporary directory: /tmp/pip-unpack-ih4lisd8
2024-02-24T09:53:12,484   Downloading alpaca_eval-0.5.4.tar.gz (344 kB)
2024-02-24T09:53:13,187   Added alpaca-eval==0.5.4 from https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz to build tracker '/tmp/pip-build-tracker-m7fnf4dx'
2024-02-24T09:53:13,189   Running setup.py (path:/tmp/pip-wheel-qnuophe1/alpaca-eval_3b5e6c42401445b2a387570a24de6dc5/setup.py) egg_info for package alpaca-eval
2024-02-24T09:53:13,190   Created temporary directory: /tmp/pip-pip-egg-info-gwxd80f1
2024-02-24T09:53:13,191   Preparing metadata (setup.py): started
2024-02-24T09:53:13,192   Running command python setup.py egg_info
2024-02-24T09:53:14,216   running egg_info
2024-02-24T09:53:14,217   creating /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info
2024-02-24T09:53:14,241   writing /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/PKG-INFO
2024-02-24T09:53:14,260   writing dependency_links to /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/dependency_links.txt
2024-02-24T09:53:14,262   writing entry points to /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/entry_points.txt
2024-02-24T09:53:14,270   writing requirements to /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/requires.txt
2024-02-24T09:53:14,271   writing top-level names to /tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/top_level.txt
2024-02-24T09:53:14,273   writing manifest file '/tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/SOURCES.txt'
2024-02-24T09:53:14,351   reading manifest file '/tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/SOURCES.txt'
2024-02-24T09:53:14,353   reading manifest template 'MANIFEST.in'
2024-02-24T09:53:14,530   adding license file 'LICENSE'
2024-02-24T09:53:14,541   writing manifest file '/tmp/pip-pip-egg-info-gwxd80f1/alpaca_eval.egg-info/SOURCES.txt'
2024-02-24T09:53:14,647   Preparing metadata (setup.py): finished with status 'done'
2024-02-24T09:53:14,655   Source in /tmp/pip-wheel-qnuophe1/alpaca-eval_3b5e6c42401445b2a387570a24de6dc5 has version 0.5.4, which satisfies requirement alpaca-eval==0.5.4 from https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz
2024-02-24T09:53:14,656   Removed alpaca-eval==0.5.4 from https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz from build tracker '/tmp/pip-build-tracker-m7fnf4dx'
2024-02-24T09:53:14,669 Created temporary directory: /tmp/pip-unpack-iaincwvs
2024-02-24T09:53:14,670 Created temporary directory: /tmp/pip-unpack-vni0saky
2024-02-24T09:53:14,817 Building wheels for collected packages: alpaca-eval
2024-02-24T09:53:14,821   Created temporary directory: /tmp/pip-wheel-6sacubs2
2024-02-24T09:53:14,822   Building wheel for alpaca-eval (setup.py): started
2024-02-24T09:53:14,823   Destination directory: /tmp/pip-wheel-6sacubs2
2024-02-24T09:53:14,823   Running command python setup.py bdist_wheel
2024-02-24T09:53:15,818   running bdist_wheel
2024-02-24T09:53:15,913   running build
2024-02-24T09:53:15,914   running build_py
2024-02-24T09:53:15,941   creating build
2024-02-24T09:53:15,941   creating build/lib
2024-02-24T09:53:15,942   creating build/lib/alpaca_eval
2024-02-24T09:53:15,943   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,946   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,948   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,951   copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,953   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,954   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,956   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,958   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,960   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,962   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-02-24T09:53:15,966   creating build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,967   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,969   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,970   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,972   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,974   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,976   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,978   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,980   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,982   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,984   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,986   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-02-24T09:53:15,988   creating build/lib/alpaca_eval/annotators
2024-02-24T09:53:15,989   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-02-24T09:53:15,991   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-02-24T09:53:15,993   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-02-24T09:53:15,995   running egg_info
2024-02-24T09:53:16,049   writing src/alpaca_eval.egg-info/PKG-INFO
2024-02-24T09:53:16,068   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-02-24T09:53:16,069   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-02-24T09:53:16,078   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-02-24T09:53:16,079   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-02-24T09:53:16,108   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-02-24T09:53:16,117   reading manifest template 'MANIFEST.in'
2024-02-24T09:53:16,263   adding license file 'LICENSE'
2024-02-24T09:53:16,278   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-02-24T09:53:16,282   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-02-24T09:53:16,282   !!

2024-02-24T09:53:16,284           ********************************************************************************
2024-02-24T09:53:16,284           ############################
2024-02-24T09:53:16,285           # Package would be ignored #
2024-02-24T09:53:16,285           ############################
2024-02-24T09:53:16,286           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-02-24T09:53:16,286           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,287           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,287           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-02-24T09:53:16,288           to the `packages` configuration field.

2024-02-24T09:53:16,289           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,289           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,290           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,291           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,291           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,292           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-02-24T09:53:16,293           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-02-24T09:53:16,293           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,293           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,294           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,295           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,296           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,297           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,298                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,298                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,299                 directory, all directories are treated like packages.
2024-02-24T09:53:16,299           ********************************************************************************

2024-02-24T09:53:16,300   !!
2024-02-24T09:53:16,301     check.warn(importable)
2024-02-24T09:53:16,301   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:16,302   !!

2024-02-24T09:53:16,303           ********************************************************************************
2024-02-24T09:53:16,304           ############################
2024-02-24T09:53:16,304           # Package would be ignored #
2024-02-24T09:53:16,305           ############################
2024-02-24T09:53:16,305           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:16,306           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,307           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,307           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-02-24T09:53:16,308           to the `packages` configuration field.

2024-02-24T09:53:16,309           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,309           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,310           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,311           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,312           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,313           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-02-24T09:53:16,314           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-02-24T09:53:16,314           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,314           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,315           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,315           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,316           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,317           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,317                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,318                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,318                 directory, all directories are treated like packages.
2024-02-24T09:53:16,319           ********************************************************************************

2024-02-24T09:53:16,319   !!
2024-02-24T09:53:16,320     check.warn(importable)
2024-02-24T09:53:16,320   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:16,321   !!

2024-02-24T09:53:16,321           ********************************************************************************
2024-02-24T09:53:16,322           ############################
2024-02-24T09:53:16,323           # Package would be ignored #
2024-02-24T09:53:16,323           ############################
2024-02-24T09:53:16,323           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:16,324           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,325           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,325           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-02-24T09:53:16,326           to the `packages` configuration field.

2024-02-24T09:53:16,327           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,327           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,328           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,329           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,330           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,331           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-02-24T09:53:16,331           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-02-24T09:53:16,332           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,333           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,334           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,335           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,336           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,337                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,338                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,338                 directory, all directories are treated like packages.
2024-02-24T09:53:16,339           ********************************************************************************

2024-02-24T09:53:16,339   !!
2024-02-24T09:53:16,340     check.warn(importable)
2024-02-24T09:53:16,340   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-02-24T09:53:16,340   !!

2024-02-24T09:53:16,341           ********************************************************************************
2024-02-24T09:53:16,341           ############################
2024-02-24T09:53:16,342           # Package would be ignored #
2024-02-24T09:53:16,342           ############################
2024-02-24T09:53:16,342           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-02-24T09:53:16,343           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,343           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,344           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-02-24T09:53:16,344           to the `packages` configuration field.

2024-02-24T09:53:16,345           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,346           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,346           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,348           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,349           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,350           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-02-24T09:53:16,351           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-02-24T09:53:16,351           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,352           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,353           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,354           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,355           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,356           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,357                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,357                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,358                 directory, all directories are treated like packages.
2024-02-24T09:53:16,358           ********************************************************************************

2024-02-24T09:53:16,359   !!
2024-02-24T09:53:16,360     check.warn(importable)
2024-02-24T09:53:16,361   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,361   !!

2024-02-24T09:53:16,362           ********************************************************************************
2024-02-24T09:53:16,363           ############################
2024-02-24T09:53:16,363           # Package would be ignored #
2024-02-24T09:53:16,364           ############################
2024-02-24T09:53:16,365           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-02-24T09:53:16,365           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,366           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,366           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-02-24T09:53:16,366           to the `packages` configuration field.

2024-02-24T09:53:16,367           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,367           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,368           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,368           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,369           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,370           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-02-24T09:53:16,370           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-02-24T09:53:16,370           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,371           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,371           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,372           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,373           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,375           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,375                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,376                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,376                 directory, all directories are treated like packages.
2024-02-24T09:53:16,377           ********************************************************************************

2024-02-24T09:53:16,378   !!
2024-02-24T09:53:16,379     check.warn(importable)
2024-02-24T09:53:16,379   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-02-24T09:53:16,380   !!

2024-02-24T09:53:16,381           ********************************************************************************
2024-02-24T09:53:16,381           ############################
2024-02-24T09:53:16,382           # Package would be ignored #
2024-02-24T09:53:16,382           ############################
2024-02-24T09:53:16,383           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-02-24T09:53:16,383           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,384           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,384           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-02-24T09:53:16,385           to the `packages` configuration field.

2024-02-24T09:53:16,386           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,386           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,387           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,388           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,389           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,390           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-02-24T09:53:16,391           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-02-24T09:53:16,391           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,391           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,392           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,392           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,393           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,394           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,394                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,395                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,395                 directory, all directories are treated like packages.
2024-02-24T09:53:16,395           ********************************************************************************

2024-02-24T09:53:16,396   !!
2024-02-24T09:53:16,396     check.warn(importable)
2024-02-24T09:53:16,397   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-02-24T09:53:16,397   !!

2024-02-24T09:53:16,398           ********************************************************************************
2024-02-24T09:53:16,399           ############################
2024-02-24T09:53:16,399           # Package would be ignored #
2024-02-24T09:53:16,400           ############################
2024-02-24T09:53:16,400           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-02-24T09:53:16,401           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,402           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,403           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-02-24T09:53:16,403           to the `packages` configuration field.

2024-02-24T09:53:16,404           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,405           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,405           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,406           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,407           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,408           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-02-24T09:53:16,409           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-02-24T09:53:16,409           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,410           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,410           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,411           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,412           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,414           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,414                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,415                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,415                 directory, all directories are treated like packages.
2024-02-24T09:53:16,416           ********************************************************************************

2024-02-24T09:53:16,417   !!
2024-02-24T09:53:16,417     check.warn(importable)
2024-02-24T09:53:16,418   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-02-24T09:53:16,418   !!

2024-02-24T09:53:16,418           ********************************************************************************
2024-02-24T09:53:16,419           ############################
2024-02-24T09:53:16,419           # Package would be ignored #
2024-02-24T09:53:16,420           ############################
2024-02-24T09:53:16,420           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-02-24T09:53:16,420           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,421           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,421           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-02-24T09:53:16,422           to the `packages` configuration field.

2024-02-24T09:53:16,422           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,423           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,423           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,424           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,426           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-02-24T09:53:16,427           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-02-24T09:53:16,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,428           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,428           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,429           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,430           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,432           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,433                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,433                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,434                 directory, all directories are treated like packages.
2024-02-24T09:53:16,434           ********************************************************************************

2024-02-24T09:53:16,435   !!
2024-02-24T09:53:16,436     check.warn(importable)
2024-02-24T09:53:16,436   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-02-24T09:53:16,436   !!

2024-02-24T09:53:16,437           ********************************************************************************
2024-02-24T09:53:16,438           ############################
2024-02-24T09:53:16,438           # Package would be ignored #
2024-02-24T09:53:16,439           ############################
2024-02-24T09:53:16,439           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-02-24T09:53:16,440           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,441           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,442           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-02-24T09:53:16,443           to the `packages` configuration field.

2024-02-24T09:53:16,444           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,444           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,444           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,445           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,446           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,446           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-02-24T09:53:16,447           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-02-24T09:53:16,447           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,448           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,448           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,449           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,449           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,451           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,451                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,451                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,452                 directory, all directories are treated like packages.
2024-02-24T09:53:16,452           ********************************************************************************

2024-02-24T09:53:16,453   !!
2024-02-24T09:53:16,454     check.warn(importable)
2024-02-24T09:53:16,454   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-02-24T09:53:16,455   !!

2024-02-24T09:53:16,456           ********************************************************************************
2024-02-24T09:53:16,457           ############################
2024-02-24T09:53:16,457           # Package would be ignored #
2024-02-24T09:53:16,458           ############################
2024-02-24T09:53:16,458           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-02-24T09:53:16,459           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,460           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,460           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-02-24T09:53:16,461           to the `packages` configuration field.

2024-02-24T09:53:16,461           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,462           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,462           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,463           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,464           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,466           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-02-24T09:53:16,466           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-02-24T09:53:16,467           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,467           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,468           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,468           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,469           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,470           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,470                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,471                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,471                 directory, all directories are treated like packages.
2024-02-24T09:53:16,471           ********************************************************************************

2024-02-24T09:53:16,472   !!
2024-02-24T09:53:16,473     check.warn(importable)
2024-02-24T09:53:16,473   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,473   !!

2024-02-24T09:53:16,474           ********************************************************************************
2024-02-24T09:53:16,474           ############################
2024-02-24T09:53:16,475           # Package would be ignored #
2024-02-24T09:53:16,475           ############################
2024-02-24T09:53:16,475           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-02-24T09:53:16,476           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,477           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,477           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-02-24T09:53:16,478           to the `packages` configuration field.

2024-02-24T09:53:16,479           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,479           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,480           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,481           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,482           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,483           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-02-24T09:53:16,484           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-02-24T09:53:16,484           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,485           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,485           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,486           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,487           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,488           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,488                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,489                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,489                 directory, all directories are treated like packages.
2024-02-24T09:53:16,490           ********************************************************************************

2024-02-24T09:53:16,491   !!
2024-02-24T09:53:16,492     check.warn(importable)
2024-02-24T09:53:16,492   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,492   !!

2024-02-24T09:53:16,493           ********************************************************************************
2024-02-24T09:53:16,494           ############################
2024-02-24T09:53:16,494           # Package would be ignored #
2024-02-24T09:53:16,494           ############################
2024-02-24T09:53:16,495           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-02-24T09:53:16,495           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,496           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,496           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-02-24T09:53:16,496           to the `packages` configuration field.

2024-02-24T09:53:16,497           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,497           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,498           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,498           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,499           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,500           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-02-24T09:53:16,500           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-02-24T09:53:16,501           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,501           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,502           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,503           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,504           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,505           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,506                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,507                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,507                 directory, all directories are treated like packages.
2024-02-24T09:53:16,507           ********************************************************************************

2024-02-24T09:53:16,508   !!
2024-02-24T09:53:16,509     check.warn(importable)
2024-02-24T09:53:16,509   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-02-24T09:53:16,510   !!

2024-02-24T09:53:16,511           ********************************************************************************
2024-02-24T09:53:16,511           ############################
2024-02-24T09:53:16,512           # Package would be ignored #
2024-02-24T09:53:16,512           ############################
2024-02-24T09:53:16,513           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-02-24T09:53:16,513           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,514           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,515           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-02-24T09:53:16,515           to the `packages` configuration field.

2024-02-24T09:53:16,516           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,517           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,518           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,519           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,519           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,520           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-02-24T09:53:16,520           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-02-24T09:53:16,521           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,521           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,521           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,522           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,523           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,524           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,524                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,524                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,525                 directory, all directories are treated like packages.
2024-02-24T09:53:16,525           ********************************************************************************

2024-02-24T09:53:16,526   !!
2024-02-24T09:53:16,526     check.warn(importable)
2024-02-24T09:53:16,527   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-02-24T09:53:16,527   !!

2024-02-24T09:53:16,528           ********************************************************************************
2024-02-24T09:53:16,529           ############################
2024-02-24T09:53:16,529           # Package would be ignored #
2024-02-24T09:53:16,529           ############################
2024-02-24T09:53:16,530           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-02-24T09:53:16,531           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,532           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,532           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-02-24T09:53:16,533           to the `packages` configuration field.

2024-02-24T09:53:16,534           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,534           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,535           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,536           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,536           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,537           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-02-24T09:53:16,538           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-02-24T09:53:16,538           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,539           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,539           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,541           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,542           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,543           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,544                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,544                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,545                 directory, all directories are treated like packages.
2024-02-24T09:53:16,545           ********************************************************************************

2024-02-24T09:53:16,546   !!
2024-02-24T09:53:16,546     check.warn(importable)
2024-02-24T09:53:16,546   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-02-24T09:53:16,547   !!

2024-02-24T09:53:16,547           ********************************************************************************
2024-02-24T09:53:16,548           ############################
2024-02-24T09:53:16,548           # Package would be ignored #
2024-02-24T09:53:16,548           ############################
2024-02-24T09:53:16,549           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-02-24T09:53:16,549           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,550           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,550           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-02-24T09:53:16,551           to the `packages` configuration field.

2024-02-24T09:53:16,552           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,552           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,553           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,554           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,555           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,556           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-02-24T09:53:16,556           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-02-24T09:53:16,557           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,557           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,558           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,559           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,560           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,561           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,562                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,562                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,563                 directory, all directories are treated like packages.
2024-02-24T09:53:16,563           ********************************************************************************

2024-02-24T09:53:16,564   !!
2024-02-24T09:53:16,564     check.warn(importable)
2024-02-24T09:53:16,565   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-02-24T09:53:16,565   !!

2024-02-24T09:53:16,566           ********************************************************************************
2024-02-24T09:53:16,567           ############################
2024-02-24T09:53:16,567           # Package would be ignored #
2024-02-24T09:53:16,568           ############################
2024-02-24T09:53:16,569           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-02-24T09:53:16,569           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,570           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,570           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-02-24T09:53:16,571           to the `packages` configuration field.

2024-02-24T09:53:16,571           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,572           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,572           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,573           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,574           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,574           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-02-24T09:53:16,575           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-02-24T09:53:16,575           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,575           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,576           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,577           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,577           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,579           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,580                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,580                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,581                 directory, all directories are treated like packages.
2024-02-24T09:53:16,582           ********************************************************************************

2024-02-24T09:53:16,583   !!
2024-02-24T09:53:16,583     check.warn(importable)
2024-02-24T09:53:16,584   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-02-24T09:53:16,584   !!

2024-02-24T09:53:16,585           ********************************************************************************
2024-02-24T09:53:16,586           ############################
2024-02-24T09:53:16,586           # Package would be ignored #
2024-02-24T09:53:16,587           ############################
2024-02-24T09:53:16,587           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-02-24T09:53:16,588           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,589           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,589           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-02-24T09:53:16,590           to the `packages` configuration field.

2024-02-24T09:53:16,591           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,591           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,592           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,593           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,594           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,595           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-02-24T09:53:16,596           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-02-24T09:53:16,597           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,597           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,598           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,598           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,599           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,600           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,600                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,601                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,601                 directory, all directories are treated like packages.
2024-02-24T09:53:16,602           ********************************************************************************

2024-02-24T09:53:16,602   !!
2024-02-24T09:53:16,603     check.warn(importable)
2024-02-24T09:53:16,603   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-02-24T09:53:16,603   !!

2024-02-24T09:53:16,604           ********************************************************************************
2024-02-24T09:53:16,604           ############################
2024-02-24T09:53:16,605           # Package would be ignored #
2024-02-24T09:53:16,605           ############################
2024-02-24T09:53:16,606           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-02-24T09:53:16,606           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,608           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,608           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-02-24T09:53:16,609           to the `packages` configuration field.

2024-02-24T09:53:16,610           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,610           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,611           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,612           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,613           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,614           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-02-24T09:53:16,615           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-02-24T09:53:16,615           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,616           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,616           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,617           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,618           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,620           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,620                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,621                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,621                 directory, all directories are treated like packages.
2024-02-24T09:53:16,622           ********************************************************************************

2024-02-24T09:53:16,623   !!
2024-02-24T09:53:16,623     check.warn(importable)
2024-02-24T09:53:16,624   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-02-24T09:53:16,625   !!

2024-02-24T09:53:16,625           ********************************************************************************
2024-02-24T09:53:16,626           ############################
2024-02-24T09:53:16,626           # Package would be ignored #
2024-02-24T09:53:16,626           ############################
2024-02-24T09:53:16,627           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-02-24T09:53:16,627           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,628           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,628           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-02-24T09:53:16,629           to the `packages` configuration field.

2024-02-24T09:53:16,629           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,630           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,630           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,631           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,632           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,632           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-02-24T09:53:16,633           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-02-24T09:53:16,634           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,634           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,635           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,636           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,637           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,638           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,639                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,639                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,640                 directory, all directories are treated like packages.
2024-02-24T09:53:16,641           ********************************************************************************

2024-02-24T09:53:16,642   !!
2024-02-24T09:53:16,642     check.warn(importable)
2024-02-24T09:53:16,642   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-02-24T09:53:16,643   !!

2024-02-24T09:53:16,644           ********************************************************************************
2024-02-24T09:53:16,644           ############################
2024-02-24T09:53:16,645           # Package would be ignored #
2024-02-24T09:53:16,645           ############################
2024-02-24T09:53:16,646           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-02-24T09:53:16,646           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,647           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,648           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-02-24T09:53:16,648           to the `packages` configuration field.

2024-02-24T09:53:16,650           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,650           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,651           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,651           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,652           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,653           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-02-24T09:53:16,653           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-02-24T09:53:16,653           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,654           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,654           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,655           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,656           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,657           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,658                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,658                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,658                 directory, all directories are treated like packages.
2024-02-24T09:53:16,659           ********************************************************************************

2024-02-24T09:53:16,660   !!
2024-02-24T09:53:16,660     check.warn(importable)
2024-02-24T09:53:16,660   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-02-24T09:53:16,661   !!

2024-02-24T09:53:16,662           ********************************************************************************
2024-02-24T09:53:16,663           ############################
2024-02-24T09:53:16,663           # Package would be ignored #
2024-02-24T09:53:16,664           ############################
2024-02-24T09:53:16,664           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-02-24T09:53:16,665           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,666           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,667           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-02-24T09:53:16,667           to the `packages` configuration field.

2024-02-24T09:53:16,668           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,669           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,669           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,670           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,671           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,672           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-02-24T09:53:16,673           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-02-24T09:53:16,673           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,674           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,674           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,675           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,677           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,678           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,678                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,678                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,679                 directory, all directories are treated like packages.
2024-02-24T09:53:16,679           ********************************************************************************

2024-02-24T09:53:16,680   !!
2024-02-24T09:53:16,680     check.warn(importable)
2024-02-24T09:53:16,680   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,681   !!

2024-02-24T09:53:16,681           ********************************************************************************
2024-02-24T09:53:16,682           ############################
2024-02-24T09:53:16,682           # Package would be ignored #
2024-02-24T09:53:16,683           ############################
2024-02-24T09:53:16,683           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-02-24T09:53:16,683           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,684           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,684           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-02-24T09:53:16,685           to the `packages` configuration field.

2024-02-24T09:53:16,686           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,686           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,687           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,688           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,689           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,690           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-02-24T09:53:16,691           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-02-24T09:53:16,691           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,692           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,692           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,694           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,694           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,696           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,696                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,697                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,697                 directory, all directories are treated like packages.
2024-02-24T09:53:16,698           ********************************************************************************

2024-02-24T09:53:16,699   !!
2024-02-24T09:53:16,699     check.warn(importable)
2024-02-24T09:53:16,700   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:16,700   !!

2024-02-24T09:53:16,701           ********************************************************************************
2024-02-24T09:53:16,702           ############################
2024-02-24T09:53:16,702           # Package would be ignored #
2024-02-24T09:53:16,703           ############################
2024-02-24T09:53:16,704           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:16,704           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,705           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,705           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-02-24T09:53:16,705           to the `packages` configuration field.

2024-02-24T09:53:16,706           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,706           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,707           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,708           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,709           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-02-24T09:53:16,709           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-02-24T09:53:16,710           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,710           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,711           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,714           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,715                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,715                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,715                 directory, all directories are treated like packages.
2024-02-24T09:53:16,716           ********************************************************************************

2024-02-24T09:53:16,717   !!
2024-02-24T09:53:16,717     check.warn(importable)
2024-02-24T09:53:16,718   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-02-24T09:53:16,718   !!

2024-02-24T09:53:16,719           ********************************************************************************
2024-02-24T09:53:16,720           ############################
2024-02-24T09:53:16,721           # Package would be ignored #
2024-02-24T09:53:16,721           ############################
2024-02-24T09:53:16,721           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-02-24T09:53:16,722           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,723           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,723           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-02-24T09:53:16,724           to the `packages` configuration field.

2024-02-24T09:53:16,725           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,725           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,726           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,727           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,728           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,730           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-02-24T09:53:16,730           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-02-24T09:53:16,731           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,731           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,732           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,732           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,733           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,734           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,734                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,735                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,735                 directory, all directories are treated like packages.
2024-02-24T09:53:16,735           ********************************************************************************

2024-02-24T09:53:16,736   !!
2024-02-24T09:53:16,737     check.warn(importable)
2024-02-24T09:53:16,737   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-02-24T09:53:16,737   !!

2024-02-24T09:53:16,738           ********************************************************************************
2024-02-24T09:53:16,738           ############################
2024-02-24T09:53:16,739           # Package would be ignored #
2024-02-24T09:53:16,739           ############################
2024-02-24T09:53:16,740           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-02-24T09:53:16,740           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,741           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,742           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-02-24T09:53:16,742           to the `packages` configuration field.

2024-02-24T09:53:16,743           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,744           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,744           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,745           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,747           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,747           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-02-24T09:53:16,748           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-02-24T09:53:16,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,749           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,749           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,750           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,751           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,753           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,753                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,754                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,755                 directory, all directories are treated like packages.
2024-02-24T09:53:16,755           ********************************************************************************

2024-02-24T09:53:16,756   !!
2024-02-24T09:53:16,757     check.warn(importable)
2024-02-24T09:53:16,757   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-02-24T09:53:16,757   !!

2024-02-24T09:53:16,758           ********************************************************************************
2024-02-24T09:53:16,758           ############################
2024-02-24T09:53:16,759           # Package would be ignored #
2024-02-24T09:53:16,759           ############################
2024-02-24T09:53:16,759           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-02-24T09:53:16,760           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,760           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,761           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-02-24T09:53:16,761           to the `packages` configuration field.

2024-02-24T09:53:16,762           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,762           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,763           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,763           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,764           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,766           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-02-24T09:53:16,766           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-02-24T09:53:16,767           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,767           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,768           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,769           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,770           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,772           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,772                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,773                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,773                 directory, all directories are treated like packages.
2024-02-24T09:53:16,774           ********************************************************************************

2024-02-24T09:53:16,775   !!
2024-02-24T09:53:16,775     check.warn(importable)
2024-02-24T09:53:16,775   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-02-24T09:53:16,776   !!

2024-02-24T09:53:16,777           ********************************************************************************
2024-02-24T09:53:16,777           ############################
2024-02-24T09:53:16,778           # Package would be ignored #
2024-02-24T09:53:16,778           ############################
2024-02-24T09:53:16,779           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-02-24T09:53:16,779           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,781           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,781           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-02-24T09:53:16,782           to the `packages` configuration field.

2024-02-24T09:53:16,782           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,783           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,783           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,784           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,785           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,785           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-02-24T09:53:16,786           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-02-24T09:53:16,786           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,786           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,787           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,787           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,788           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,789           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,790                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,790                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,791                 directory, all directories are treated like packages.
2024-02-24T09:53:16,791           ********************************************************************************

2024-02-24T09:53:16,792   !!
2024-02-24T09:53:16,793     check.warn(importable)
2024-02-24T09:53:16,794   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-02-24T09:53:16,794   !!

2024-02-24T09:53:16,795           ********************************************************************************
2024-02-24T09:53:16,796           ############################
2024-02-24T09:53:16,796           # Package would be ignored #
2024-02-24T09:53:16,797           ############################
2024-02-24T09:53:16,798           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-02-24T09:53:16,798           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,800           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,800           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-02-24T09:53:16,801           to the `packages` configuration field.

2024-02-24T09:53:16,802           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,802           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,803           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,804           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,805           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,806           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-02-24T09:53:16,806           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-02-24T09:53:16,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,807           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,808           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,809           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,810           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,811           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,811                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,811                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,812                 directory, all directories are treated like packages.
2024-02-24T09:53:16,812           ********************************************************************************

2024-02-24T09:53:16,813   !!
2024-02-24T09:53:16,813     check.warn(importable)
2024-02-24T09:53:16,813   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,814   !!

2024-02-24T09:53:16,815           ********************************************************************************
2024-02-24T09:53:16,815           ############################
2024-02-24T09:53:16,815           # Package would be ignored #
2024-02-24T09:53:16,816           ############################
2024-02-24T09:53:16,816           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-02-24T09:53:16,816           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,817           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,818           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-02-24T09:53:16,818           to the `packages` configuration field.

2024-02-24T09:53:16,819           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,820           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,820           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,822           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,823           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,824           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-02-24T09:53:16,824           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-02-24T09:53:16,825           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,826           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,826           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,827           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,828           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,829           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,830                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,830                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,831                 directory, all directories are treated like packages.
2024-02-24T09:53:16,832           ********************************************************************************

2024-02-24T09:53:16,833   !!
2024-02-24T09:53:16,833     check.warn(importable)
2024-02-24T09:53:16,834   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,834   !!

2024-02-24T09:53:16,835           ********************************************************************************
2024-02-24T09:53:16,836           ############################
2024-02-24T09:53:16,836           # Package would be ignored #
2024-02-24T09:53:16,836           ############################
2024-02-24T09:53:16,837           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-02-24T09:53:16,837           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,838           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,838           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-02-24T09:53:16,838           to the `packages` configuration field.

2024-02-24T09:53:16,839           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,839           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,840           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,841           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,842           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,842           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-02-24T09:53:16,843           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-02-24T09:53:16,843           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,844           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,844           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,846           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,847           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,848           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,849                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,849                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,850                 directory, all directories are treated like packages.
2024-02-24T09:53:16,850           ********************************************************************************

2024-02-24T09:53:16,852   !!
2024-02-24T09:53:16,852     check.warn(importable)
2024-02-24T09:53:16,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:16,853   !!

2024-02-24T09:53:16,854           ********************************************************************************
2024-02-24T09:53:16,854           ############################
2024-02-24T09:53:16,855           # Package would be ignored #
2024-02-24T09:53:16,855           ############################
2024-02-24T09:53:16,856           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-02-24T09:53:16,856           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,857           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,858           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-02-24T09:53:16,858           to the `packages` configuration field.

2024-02-24T09:53:16,859           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,861           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,862           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,862           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,863           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-02-24T09:53:16,863           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-02-24T09:53:16,864           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,864           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,864           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,865           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,866           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,867           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,867                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,868                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,868                 directory, all directories are treated like packages.
2024-02-24T09:53:16,869           ********************************************************************************

2024-02-24T09:53:16,870   !!
2024-02-24T09:53:16,870     check.warn(importable)
2024-02-24T09:53:16,871   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-02-24T09:53:16,871   !!

2024-02-24T09:53:16,872           ********************************************************************************
2024-02-24T09:53:16,873           ############################
2024-02-24T09:53:16,873           # Package would be ignored #
2024-02-24T09:53:16,874           ############################
2024-02-24T09:53:16,874           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-02-24T09:53:16,875           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,876           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,876           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-02-24T09:53:16,877           to the `packages` configuration field.

2024-02-24T09:53:16,878           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,878           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,879           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,879           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,880           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,881           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-02-24T09:53:16,882           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-02-24T09:53:16,882           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,883           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,883           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,884           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,885           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,887           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,887                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,888                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,888                 directory, all directories are treated like packages.
2024-02-24T09:53:16,888           ********************************************************************************

2024-02-24T09:53:16,889   !!
2024-02-24T09:53:16,889     check.warn(importable)
2024-02-24T09:53:16,890   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-02-24T09:53:16,890   !!

2024-02-24T09:53:16,891           ********************************************************************************
2024-02-24T09:53:16,891           ############################
2024-02-24T09:53:16,891           # Package would be ignored #
2024-02-24T09:53:16,892           ############################
2024-02-24T09:53:16,892           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-02-24T09:53:16,892           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,893           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,893           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-02-24T09:53:16,894           to the `packages` configuration field.

2024-02-24T09:53:16,895           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,895           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,896           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,897           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,898           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,899           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-02-24T09:53:16,899           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-02-24T09:53:16,900           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,900           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,901           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,902           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,903           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,905           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,905                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,906                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,906                 directory, all directories are treated like packages.
2024-02-24T09:53:16,907           ********************************************************************************

2024-02-24T09:53:16,908   !!
2024-02-24T09:53:16,908     check.warn(importable)
2024-02-24T09:53:16,908   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-02-24T09:53:16,909   !!

2024-02-24T09:53:16,910           ********************************************************************************
2024-02-24T09:53:16,911           ############################
2024-02-24T09:53:16,911           # Package would be ignored #
2024-02-24T09:53:16,912           ############################
2024-02-24T09:53:16,912           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-02-24T09:53:16,913           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,914           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,914           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-02-24T09:53:16,915           to the `packages` configuration field.

2024-02-24T09:53:16,915           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,915           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,916           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,917           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,917           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,918           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-02-24T09:53:16,918           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-02-24T09:53:16,919           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,919           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,919           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,920           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,921           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,922           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,923                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,923                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,924                 directory, all directories are treated like packages.
2024-02-24T09:53:16,924           ********************************************************************************

2024-02-24T09:53:16,926   !!
2024-02-24T09:53:16,926     check.warn(importable)
2024-02-24T09:53:16,927   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:16,927   !!

2024-02-24T09:53:16,928           ********************************************************************************
2024-02-24T09:53:16,929           ############################
2024-02-24T09:53:16,929           # Package would be ignored #
2024-02-24T09:53:16,930           ############################
2024-02-24T09:53:16,931           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:16,931           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,932           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,932           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-02-24T09:53:16,933           to the `packages` configuration field.

2024-02-24T09:53:16,934           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,934           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,935           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,936           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,937           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,938           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-02-24T09:53:16,938           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-02-24T09:53:16,939           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,939           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,940           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,941           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,942           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,943           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,943                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,944                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,944                 directory, all directories are treated like packages.
2024-02-24T09:53:16,944           ********************************************************************************

2024-02-24T09:53:16,945   !!
2024-02-24T09:53:16,946     check.warn(importable)
2024-02-24T09:53:16,946   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:16,947   !!

2024-02-24T09:53:16,947           ********************************************************************************
2024-02-24T09:53:16,948           ############################
2024-02-24T09:53:16,948           # Package would be ignored #
2024-02-24T09:53:16,949           ############################
2024-02-24T09:53:16,950           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:16,950           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,951           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,952           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-02-24T09:53:16,952           to the `packages` configuration field.

2024-02-24T09:53:16,954           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,954           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,955           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,956           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,956           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,957           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-02-24T09:53:16,958           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-02-24T09:53:16,958           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,959           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,959           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,960           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,961           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,963           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,963                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,964                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,965                 directory, all directories are treated like packages.
2024-02-24T09:53:16,966           ********************************************************************************

2024-02-24T09:53:16,966   !!
2024-02-24T09:53:16,967     check.warn(importable)
2024-02-24T09:53:16,967   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-02-24T09:53:16,967   !!

2024-02-24T09:53:16,968           ********************************************************************************
2024-02-24T09:53:16,968           ############################
2024-02-24T09:53:16,969           # Package would be ignored #
2024-02-24T09:53:16,969           ############################
2024-02-24T09:53:16,969           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-02-24T09:53:16,970           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,970           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,971           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-02-24T09:53:16,971           to the `packages` configuration field.

2024-02-24T09:53:16,972           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,972           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,973           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,973           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,975           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,976           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-02-24T09:53:16,976           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-02-24T09:53:16,977           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,977           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,978           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,979           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,980           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,982           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:16,982                 even if it does not contain any `.py` files.
2024-02-24T09:53:16,983                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:16,983                 directory, all directories are treated like packages.
2024-02-24T09:53:16,984           ********************************************************************************

2024-02-24T09:53:16,984   !!
2024-02-24T09:53:16,985     check.warn(importable)
2024-02-24T09:53:16,985   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-02-24T09:53:16,986   !!

2024-02-24T09:53:16,987           ********************************************************************************
2024-02-24T09:53:16,987           ############################
2024-02-24T09:53:16,988           # Package would be ignored #
2024-02-24T09:53:16,988           ############################
2024-02-24T09:53:16,989           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-02-24T09:53:16,989           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:16,991           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:16,991           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-02-24T09:53:16,992           to the `packages` configuration field.

2024-02-24T09:53:16,993           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:16,993           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:16,994           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:16,994           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:16,995           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:16,995           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-02-24T09:53:16,996           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-02-24T09:53:16,996           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:16,996           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:16,997           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:16,997           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:16,998           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:16,999           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,000                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,000                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,000                 directory, all directories are treated like packages.
2024-02-24T09:53:17,001           ********************************************************************************

2024-02-24T09:53:17,002   !!
2024-02-24T09:53:17,002     check.warn(importable)
2024-02-24T09:53:17,003   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-02-24T09:53:17,003   !!

2024-02-24T09:53:17,004           ********************************************************************************
2024-02-24T09:53:17,005           ############################
2024-02-24T09:53:17,005           # Package would be ignored #
2024-02-24T09:53:17,006           ############################
2024-02-24T09:53:17,006           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-02-24T09:53:17,007           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,008           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,009           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-02-24T09:53:17,009           to the `packages` configuration field.

2024-02-24T09:53:17,010           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,010           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,011           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,012           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,013           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,014           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-02-24T09:53:17,015           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-02-24T09:53:17,016           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,016           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,017           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,018           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,019           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,020           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,020                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,021                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,021                 directory, all directories are treated like packages.
2024-02-24T09:53:17,021           ********************************************************************************

2024-02-24T09:53:17,022   !!
2024-02-24T09:53:17,022     check.warn(importable)
2024-02-24T09:53:17,023   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-02-24T09:53:17,023   !!

2024-02-24T09:53:17,024           ********************************************************************************
2024-02-24T09:53:17,024           ############################
2024-02-24T09:53:17,025           # Package would be ignored #
2024-02-24T09:53:17,025           ############################
2024-02-24T09:53:17,025           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-02-24T09:53:17,026           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,027           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,027           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-02-24T09:53:17,028           to the `packages` configuration field.

2024-02-24T09:53:17,029           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,029           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,030           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,031           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,032           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,033           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-02-24T09:53:17,033           already explicitly excluding 'alpaca_eval.models_configs' via
2024-02-24T09:53:17,034           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,034           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,035           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,036           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,037           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,038           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,039                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,039                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,040                 directory, all directories are treated like packages.
2024-02-24T09:53:17,040           ********************************************************************************

2024-02-24T09:53:17,041   !!
2024-02-24T09:53:17,042     check.warn(importable)
2024-02-24T09:53:17,043   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-02-24T09:53:17,043   !!

2024-02-24T09:53:17,044           ********************************************************************************
2024-02-24T09:53:17,045           ############################
2024-02-24T09:53:17,045           # Package would be ignored #
2024-02-24T09:53:17,046           ############################
2024-02-24T09:53:17,046           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-02-24T09:53:17,046           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,047           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,048           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-02-24T09:53:17,048           to the `packages` configuration field.

2024-02-24T09:53:17,049           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,049           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,050           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,051           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,051           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,052           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-02-24T09:53:17,053           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-02-24T09:53:17,053           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,054           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,054           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,055           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,056           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,058           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,058                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,059                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,059                 directory, all directories are treated like packages.
2024-02-24T09:53:17,060           ********************************************************************************

2024-02-24T09:53:17,061   !!
2024-02-24T09:53:17,061     check.warn(importable)
2024-02-24T09:53:17,061   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-02-24T09:53:17,062   !!

2024-02-24T09:53:17,063           ********************************************************************************
2024-02-24T09:53:17,064           ############################
2024-02-24T09:53:17,064           # Package would be ignored #
2024-02-24T09:53:17,065           ############################
2024-02-24T09:53:17,065           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-02-24T09:53:17,065           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,066           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,067           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-02-24T09:53:17,067           to the `packages` configuration field.

2024-02-24T09:53:17,068           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,069           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,069           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,070           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,071           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,073           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-02-24T09:53:17,073           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-02-24T09:53:17,073           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,074           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,074           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,075           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,076           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,078           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,078                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,079                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,079                 directory, all directories are treated like packages.
2024-02-24T09:53:17,080           ********************************************************************************

2024-02-24T09:53:17,081   !!
2024-02-24T09:53:17,081     check.warn(importable)
2024-02-24T09:53:17,082   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-02-24T09:53:17,082   !!

2024-02-24T09:53:17,083           ********************************************************************************
2024-02-24T09:53:17,083           ############################
2024-02-24T09:53:17,084           # Package would be ignored #
2024-02-24T09:53:17,084           ############################
2024-02-24T09:53:17,085           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-02-24T09:53:17,085           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,086           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,087           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-02-24T09:53:17,088           to the `packages` configuration field.

2024-02-24T09:53:17,089           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,089           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,089           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,090           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,091           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,093           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-02-24T09:53:17,093           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-02-24T09:53:17,094           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,094           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,095           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,096           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,097           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,099           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,099                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,100                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,100                 directory, all directories are treated like packages.
2024-02-24T09:53:17,101           ********************************************************************************

2024-02-24T09:53:17,102   !!
2024-02-24T09:53:17,102     check.warn(importable)
2024-02-24T09:53:17,102   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-02-24T09:53:17,103   !!

2024-02-24T09:53:17,104           ********************************************************************************
2024-02-24T09:53:17,104           ############################
2024-02-24T09:53:17,104           # Package would be ignored #
2024-02-24T09:53:17,105           ############################
2024-02-24T09:53:17,105           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-02-24T09:53:17,106           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,107           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,107           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-02-24T09:53:17,108           to the `packages` configuration field.

2024-02-24T09:53:17,109           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,109           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,109           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,110           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,111           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,113           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-02-24T09:53:17,113           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-02-24T09:53:17,114           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,114           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,115           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,115           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,116           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,118           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,118                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,119                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,120                 directory, all directories are treated like packages.
2024-02-24T09:53:17,120           ********************************************************************************

2024-02-24T09:53:17,121   !!
2024-02-24T09:53:17,122     check.warn(importable)
2024-02-24T09:53:17,122   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-02-24T09:53:17,123   !!

2024-02-24T09:53:17,124           ********************************************************************************
2024-02-24T09:53:17,124           ############################
2024-02-24T09:53:17,125           # Package would be ignored #
2024-02-24T09:53:17,125           ############################
2024-02-24T09:53:17,126           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-02-24T09:53:17,127           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,128           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,128           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-02-24T09:53:17,129           to the `packages` configuration field.

2024-02-24T09:53:17,130           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,130           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,131           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,132           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,132           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,133           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-02-24T09:53:17,134           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-02-24T09:53:17,134           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,134           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,135           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,136           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,136           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,138           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,138                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,139                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,139                 directory, all directories are treated like packages.
2024-02-24T09:53:17,140           ********************************************************************************

2024-02-24T09:53:17,141   !!
2024-02-24T09:53:17,141     check.warn(importable)
2024-02-24T09:53:17,142   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-02-24T09:53:17,142   !!

2024-02-24T09:53:17,143           ********************************************************************************
2024-02-24T09:53:17,144           ############################
2024-02-24T09:53:17,144           # Package would be ignored #
2024-02-24T09:53:17,145           ############################
2024-02-24T09:53:17,145           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-02-24T09:53:17,146           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,147           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,147           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-02-24T09:53:17,148           to the `packages` configuration field.

2024-02-24T09:53:17,149           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,149           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,150           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,151           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,153           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-02-24T09:53:17,153           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-02-24T09:53:17,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,154           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,155           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,156           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,157           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,158           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,158                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,159                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,159                 directory, all directories are treated like packages.
2024-02-24T09:53:17,160           ********************************************************************************

2024-02-24T09:53:17,161   !!
2024-02-24T09:53:17,161     check.warn(importable)
2024-02-24T09:53:17,162   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-02-24T09:53:17,162   !!

2024-02-24T09:53:17,163           ********************************************************************************
2024-02-24T09:53:17,163           ############################
2024-02-24T09:53:17,164           # Package would be ignored #
2024-02-24T09:53:17,164           ############################
2024-02-24T09:53:17,165           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-02-24T09:53:17,165           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,166           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,167           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-02-24T09:53:17,167           to the `packages` configuration field.

2024-02-24T09:53:17,168           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,168           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,169           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,170           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,171           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,172           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-02-24T09:53:17,172           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-02-24T09:53:17,173           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,173           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,173           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,174           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,175           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,177                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,178                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,178                 directory, all directories are treated like packages.
2024-02-24T09:53:17,179           ********************************************************************************

2024-02-24T09:53:17,180   !!
2024-02-24T09:53:17,181     check.warn(importable)
2024-02-24T09:53:17,181   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-02-24T09:53:17,182   !!

2024-02-24T09:53:17,183           ********************************************************************************
2024-02-24T09:53:17,183           ############################
2024-02-24T09:53:17,184           # Package would be ignored #
2024-02-24T09:53:17,184           ############################
2024-02-24T09:53:17,185           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-02-24T09:53:17,185           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,186           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,186           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-02-24T09:53:17,187           to the `packages` configuration field.

2024-02-24T09:53:17,187           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,188           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,188           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,189           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,190           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,191           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-02-24T09:53:17,191           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-02-24T09:53:17,192           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,192           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,193           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,194           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,195           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,196           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,197                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,197                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,198                 directory, all directories are treated like packages.
2024-02-24T09:53:17,198           ********************************************************************************

2024-02-24T09:53:17,199   !!
2024-02-24T09:53:17,200     check.warn(importable)
2024-02-24T09:53:17,201   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-02-24T09:53:17,201   !!

2024-02-24T09:53:17,202           ********************************************************************************
2024-02-24T09:53:17,203           ############################
2024-02-24T09:53:17,204           # Package would be ignored #
2024-02-24T09:53:17,204           ############################
2024-02-24T09:53:17,205           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-02-24T09:53:17,206           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,207           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,208           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-02-24T09:53:17,208           to the `packages` configuration field.

2024-02-24T09:53:17,209           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,210           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,211           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,212           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,213           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,214           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-02-24T09:53:17,215           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-02-24T09:53:17,216           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,216           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,217           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,218           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,219           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,220           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,221                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,221                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,222                 directory, all directories are treated like packages.
2024-02-24T09:53:17,223           ********************************************************************************

2024-02-24T09:53:17,224   !!
2024-02-24T09:53:17,224     check.warn(importable)
2024-02-24T09:53:17,225   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-02-24T09:53:17,225   !!

2024-02-24T09:53:17,227           ********************************************************************************
2024-02-24T09:53:17,227           ############################
2024-02-24T09:53:17,228           # Package would be ignored #
2024-02-24T09:53:17,228           ############################
2024-02-24T09:53:17,229           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-02-24T09:53:17,230           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,231           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,231           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-02-24T09:53:17,232           to the `packages` configuration field.

2024-02-24T09:53:17,233           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,234           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,235           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,236           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,237           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,238           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-02-24T09:53:17,239           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-02-24T09:53:17,240           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,240           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,241           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,242           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,243           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,246           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,246                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,247                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,247                 directory, all directories are treated like packages.
2024-02-24T09:53:17,248           ********************************************************************************

2024-02-24T09:53:17,249   !!
2024-02-24T09:53:17,250     check.warn(importable)
2024-02-24T09:53:17,251   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-02-24T09:53:17,251   !!

2024-02-24T09:53:17,252           ********************************************************************************
2024-02-24T09:53:17,253           ############################
2024-02-24T09:53:17,253           # Package would be ignored #
2024-02-24T09:53:17,254           ############################
2024-02-24T09:53:17,255           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-02-24T09:53:17,255           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,256           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,257           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-02-24T09:53:17,257           to the `packages` configuration field.

2024-02-24T09:53:17,258           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,259           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,260           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,261           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,263           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-02-24T09:53:17,264           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-02-24T09:53:17,265           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,265           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,266           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,267           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,268           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,270           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,271                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,271                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,272                 directory, all directories are treated like packages.
2024-02-24T09:53:17,273           ********************************************************************************

2024-02-24T09:53:17,274   !!
2024-02-24T09:53:17,274     check.warn(importable)
2024-02-24T09:53:17,275   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-02-24T09:53:17,276   !!

2024-02-24T09:53:17,277           ********************************************************************************
2024-02-24T09:53:17,278           ############################
2024-02-24T09:53:17,278           # Package would be ignored #
2024-02-24T09:53:17,279           ############################
2024-02-24T09:53:17,279           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-02-24T09:53:17,280           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,281           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,282           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-02-24T09:53:17,283           to the `packages` configuration field.

2024-02-24T09:53:17,284           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,285           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,285           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,286           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,287           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,288           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-02-24T09:53:17,289           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-02-24T09:53:17,289           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,290           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,290           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,291           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,293           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,294           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,295                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,295                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,296                 directory, all directories are treated like packages.
2024-02-24T09:53:17,297           ********************************************************************************

2024-02-24T09:53:17,298   !!
2024-02-24T09:53:17,298     check.warn(importable)
2024-02-24T09:53:17,299   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-02-24T09:53:17,300   !!

2024-02-24T09:53:17,301           ********************************************************************************
2024-02-24T09:53:17,301           ############################
2024-02-24T09:53:17,302           # Package would be ignored #
2024-02-24T09:53:17,302           ############################
2024-02-24T09:53:17,303           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-02-24T09:53:17,303           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,304           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,305           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-02-24T09:53:17,305           to the `packages` configuration field.

2024-02-24T09:53:17,306           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,307           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,307           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,308           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,309           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,310           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-02-24T09:53:17,311           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-02-24T09:53:17,311           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,312           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,312           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,313           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,314           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,315           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,315                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,316                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,316                 directory, all directories are treated like packages.
2024-02-24T09:53:17,317           ********************************************************************************

2024-02-24T09:53:17,317   !!
2024-02-24T09:53:17,318     check.warn(importable)
2024-02-24T09:53:17,318   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-02-24T09:53:17,319   !!

2024-02-24T09:53:17,319           ********************************************************************************
2024-02-24T09:53:17,320           ############################
2024-02-24T09:53:17,320           # Package would be ignored #
2024-02-24T09:53:17,321           ############################
2024-02-24T09:53:17,321           Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1],
2024-02-24T09:53:17,322           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,323           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,323           package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added
2024-02-24T09:53:17,323           to the `packages` configuration field.

2024-02-24T09:53:17,324           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,325           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,325           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,326           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,327           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,328           If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are
2024-02-24T09:53:17,329           already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via
2024-02-24T09:53:17,329           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,330           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,330           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,331           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,332           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,333           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,334                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,334                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,335                 directory, all directories are treated like packages.
2024-02-24T09:53:17,335           ********************************************************************************

2024-02-24T09:53:17,337   !!
2024-02-24T09:53:17,337     check.warn(importable)
2024-02-24T09:53:17,337   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-02-24T09:53:17,338   !!

2024-02-24T09:53:17,339           ********************************************************************************
2024-02-24T09:53:17,339           ############################
2024-02-24T09:53:17,340           # Package would be ignored #
2024-02-24T09:53:17,340           ############################
2024-02-24T09:53:17,341           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-02-24T09:53:17,341           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,342           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,342           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-02-24T09:53:17,343           to the `packages` configuration field.

2024-02-24T09:53:17,344           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,344           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,345           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,345           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,346           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,347           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-02-24T09:53:17,347           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-02-24T09:53:17,348           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,348           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,349           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,350           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,351           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,352           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,353                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,353                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,353                 directory, all directories are treated like packages.
2024-02-24T09:53:17,354           ********************************************************************************

2024-02-24T09:53:17,355   !!
2024-02-24T09:53:17,355     check.warn(importable)
2024-02-24T09:53:17,356   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-02-24T09:53:17,356   !!

2024-02-24T09:53:17,357           ********************************************************************************
2024-02-24T09:53:17,358           ############################
2024-02-24T09:53:17,358           # Package would be ignored #
2024-02-24T09:53:17,359           ############################
2024-02-24T09:53:17,359           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-02-24T09:53:17,360           but it is absent from setuptools' `packages` configuration.

2024-02-24T09:53:17,361           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T09:53:17,361           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-02-24T09:53:17,362           to the `packages` configuration field.

2024-02-24T09:53:17,363           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T09:53:17,364           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T09:53:17,364           instead of `find_packages(...)`/`find:`).

2024-02-24T09:53:17,365           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T09:53:17,366           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T09:53:17,367           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-02-24T09:53:17,367           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-02-24T09:53:17,368           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T09:53:17,368           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T09:53:17,368           combination with a more fine grained `package-data` configuration.

2024-02-24T09:53:17,369           You can read more about "package data files" on setuptools documentation page:

2024-02-24T09:53:17,370           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T09:53:17,371           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T09:53:17,372                 even if it does not contain any `.py` files.
2024-02-24T09:53:17,372                 On the other hand, currently there is no concept of package data
2024-02-24T09:53:17,373                 directory, all directories are treated like packages.
2024-02-24T09:53:17,373           ********************************************************************************

2024-02-24T09:53:17,374   !!
2024-02-24T09:53:17,374     check.warn(importable)
2024-02-24T09:53:17,375   creating build/lib/alpaca_eval/evaluators_configs
2024-02-24T09:53:17,375   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-02-24T09:53:17,376   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:17,376   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:17,377   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:17,377   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,377   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,378   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,378   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:17,379   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:17,379   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:17,380   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:17,381   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:17,381   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:17,382   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-02-24T09:53:17,382   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-02-24T09:53:17,383   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-02-24T09:53:17,383   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-02-24T09:53:17,384   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:17,384   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:17,385   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:17,385   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:17,386   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:17,386   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:17,387   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,387   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,387   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,388   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,388   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,389   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,389   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,390   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,390   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,391   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,391   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,392   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,392   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,393   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:17,393   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:17,394   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:17,394   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:17,395   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:17,395   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:17,396   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:17,396   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-02-24T09:53:17,397   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-02-24T09:53:17,397   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-02-24T09:53:17,398   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-02-24T09:53:17,398   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:17,399   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:17,399   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:17,399   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:17,400   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:17,400   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:17,401   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,401   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,402   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,402   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-02-24T09:53:17,403   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-02-24T09:53:17,403   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,404   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,404   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,405   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-02-24T09:53:17,405   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-02-24T09:53:17,406   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-02-24T09:53:17,406   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-02-24T09:53:17,406   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-02-24T09:53:17,407   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-02-24T09:53:17,407   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-02-24T09:53:17,408   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-02-24T09:53:17,408   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,409   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,409   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,410   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,410   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,411   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,411   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-02-24T09:53:17,412   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-02-24T09:53:17,412   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-02-24T09:53:17,413   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-02-24T09:53:17,413   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:17,414   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:17,414   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:17,415   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-02-24T09:53:17,415   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-02-24T09:53:17,415   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-02-24T09:53:17,416   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-02-24T09:53:17,416   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,417   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,417   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,418   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:17,418   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:17,419   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:17,419   creating build/lib/alpaca_eval/evaluators_configs/test
2024-02-24T09:53:17,420   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-02-24T09:53:17,420   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:17,421   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:17,421   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:17,422   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-02-24T09:53:17,422   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-02-24T09:53:17,423   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-02-24T09:53:17,423   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-02-24T09:53:17,424   creating build/lib/alpaca_eval/leaderboards
2024-02-24T09:53:17,424   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:17,425   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:17,425   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:17,426   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:17,426   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:17,427   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:17,427   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:17,428   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:17,428   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:17,429   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-02-24T09:53:17,429   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-02-24T09:53:17,429   creating build/lib/alpaca_eval/models_configs
2024-02-24T09:53:17,430   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:17,430   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:17,431   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:17,431   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-02-24T09:53:17,432   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-02-24T09:53:17,432   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:17,433   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:17,433   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:17,434   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:17,434   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:17,435   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:17,435   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:17,435   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:17,436   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:17,436   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:17,437   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:17,437   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:17,438   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:17,438   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:17,439   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:17,440   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:17,440   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:17,441   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:17,441   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:17,442   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:17,442   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:17,442   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:17,443   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:17,443   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:17,444   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:17,444   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:17,444   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:17,445   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:17,445   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:17,446   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:17,446   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:17,447   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:17,447   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:17,448   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:17,448   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:17,449   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:17,449   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-02-24T09:53:17,450   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-02-24T09:53:17,451   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:17,451   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:17,452   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:17,452   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:17,453   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:17,453   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:17,453   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-02-24T09:53:17,454   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-02-24T09:53:17,455   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-02-24T09:53:17,455   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-02-24T09:53:17,456   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-02-24T09:53:17,456   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-02-24T09:53:17,457   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-02-24T09:53:17,457   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-02-24T09:53:17,458   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:17,458   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:17,459   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:17,459   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:17,460   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:17,460   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:17,461   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-02-24T09:53:17,461   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-02-24T09:53:17,462   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-02-24T09:53:17,462   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-02-24T09:53:17,463   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-02-24T09:53:17,463   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-02-24T09:53:17,464   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:17,464   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:17,464   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:17,465   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:17,465   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:17,466   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:17,466   creating build/lib/alpaca_eval/models_configs/claude
2024-02-24T09:53:17,467   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-02-24T09:53:17,467   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-02-24T09:53:17,468   creating build/lib/alpaca_eval/models_configs/claude-2
2024-02-24T09:53:17,469   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-02-24T09:53:17,469   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-02-24T09:53:17,470   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-02-24T09:53:17,470   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:17,471   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:17,471   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:17,472   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:17,472   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:17,473   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:17,473   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-02-24T09:53:17,474   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-02-24T09:53:17,474   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-02-24T09:53:17,474   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-02-24T09:53:17,475   creating build/lib/alpaca_eval/models_configs/cohere
2024-02-24T09:53:17,475   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-02-24T09:53:17,476   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-02-24T09:53:17,476   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:17,477   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:17,477   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:17,478   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:17,478   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:17,479   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:17,479   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-02-24T09:53:17,480   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-02-24T09:53:17,480   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-02-24T09:53:17,481   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-02-24T09:53:17,481   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-02-24T09:53:17,482   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-02-24T09:53:17,482   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-02-24T09:53:17,483   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-02-24T09:53:17,483   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-02-24T09:53:17,484   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-02-24T09:53:17,486   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-02-24T09:53:17,487   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-02-24T09:53:17,489   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:17,490   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:17,492   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:17,494   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-02-24T09:53:17,495   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-02-24T09:53:17,497   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-02-24T09:53:17,498   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-02-24T09:53:17,500   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-02-24T09:53:17,501   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-02-24T09:53:17,503   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-02-24T09:53:17,504   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-02-24T09:53:17,506   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-02-24T09:53:17,507   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-02-24T09:53:17,509   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-02-24T09:53:17,511   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-02-24T09:53:17,513   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-02-24T09:53:17,513   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-02-24T09:53:17,515   creating build/lib/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:17,520   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:17,522   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:17,524   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-02-24T09:53:17,525   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-02-24T09:53:17,527   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-02-24T09:53:17,528   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-02-24T09:53:17,530   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-02-24T09:53:17,531   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-02-24T09:53:17,533   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-02-24T09:53:17,533   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-02-24T09:53:17,535   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:17,536   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:17,538   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:17,540   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:17,541   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:17,543   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:17,545   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:17,546   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:17,549   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:17,551   creating build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:17,552   copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:17,554   copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:17,556   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-02-24T09:53:17,557   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-02-24T09:53:17,559   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-02-24T09:53:17,560   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-02-24T09:53:17,562   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-02-24T09:53:17,562   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-02-24T09:53:17,565   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-02-24T09:53:17,565   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-02-24T09:53:17,567   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:17,568   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:17,570   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:17,573   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:17,573   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:17,575   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:17,577   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-02-24T09:53:17,578   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-02-24T09:53:17,580   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:17,581   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:17,583   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:17,585   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:17,586   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:17,588   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:17,590   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-02-24T09:53:17,591   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-02-24T09:53:17,594   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:17,594   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:17,597   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:17,599   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:17,599   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:17,602   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:17,604   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:17,604   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:17,606   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:17,608   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-02-24T09:53:17,609   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-02-24T09:53:17,611   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:17,612   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:17,614   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:17,616   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:17,617   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:17,619   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:17,621   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:17,622   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:17,624   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:17,625   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:17,626   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:17,628   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:17,630   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-02-24T09:53:17,631   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-02-24T09:53:17,633   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:17,634   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:17,637   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:17,638   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:17,639   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:17,642   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:17,644   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:17,645   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:17,647   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:17,649   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:17,650   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:17,652   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:17,654   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:17,655   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:17,657   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:17,659   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:17,659   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:17,662   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:17,664   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:17,664   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:17,666   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:17,668   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:17,669   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:17,671   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:17,673   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:17,674   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:17,676   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:17,678   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-02-24T09:53:17,679   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-02-24T09:53:17,681   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-02-24T09:53:17,682   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-02-24T09:53:17,684   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-02-24T09:53:17,685   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-02-24T09:53:17,687   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-02-24T09:53:17,687   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-02-24T09:53:17,689   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-02-24T09:53:17,690   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-02-24T09:53:17,692   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-02-24T09:53:17,693   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-02-24T09:53:17,695   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-02-24T09:53:17,696   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-02-24T09:53:17,699   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:17,700   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:17,702   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:17,704   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-02-24T09:53:17,705   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-02-24T09:53:17,706   creating build/lib/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:17,707   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:17,709   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:17,711   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:17,712   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:17,714   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:17,715   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:17,716   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:17,718   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:17,720   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:17,721   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:17,723   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:17,724   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-02-24T09:53:17,725   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-02-24T09:53:17,727   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-02-24T09:53:17,728   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-02-24T09:53:17,730   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-02-24T09:53:17,731   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-02-24T09:53:17,733   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-02-24T09:53:17,734   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-02-24T09:53:17,737   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:17,737   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:17,740   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:17,742   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-02-24T09:53:17,743   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-02-24T09:53:17,745   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:17,746   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:17,748   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:17,749   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-02-24T09:53:17,750   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-02-24T09:53:17,753   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:17,754   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:17,756   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:17,758   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:17,758   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:17,761   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:17,763   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:17,763   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:17,766   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:17,767   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:17,768   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:17,770   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:17,772   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-02-24T09:53:17,773   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-02-24T09:53:17,775   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-02-24T09:53:17,776   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-02-24T09:53:17,778   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-02-24T09:53:17,779   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-02-24T09:53:17,781   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-02-24T09:53:17,782   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-02-24T09:53:17,784   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:17,785   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:17,787   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:17,789   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-02-24T09:53:17,790   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-02-24T09:53:17,792   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-02-24T09:53:17,793   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-02-24T09:53:17,795   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:17,796   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:17,798   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:17,800   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-02-24T09:53:17,801   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-02-24T09:53:17,803   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-02-24T09:53:17,804   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-02-24T09:53:17,806   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-02-24T09:53:17,807   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-02-24T09:53:17,809   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-02-24T09:53:17,810   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-02-24T09:53:17,812   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-02-24T09:53:17,813   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-02-24T09:53:17,815   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-02-24T09:53:17,816   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-02-24T09:53:17,818   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:17,819   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:17,821   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:17,823   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:17,823   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:17,825   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:17,827   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-02-24T09:53:17,828   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-02-24T09:53:17,856   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-02-24T09:53:17,856   !!

2024-02-24T09:53:17,858           ********************************************************************************
2024-02-24T09:53:17,858           Please avoid running ``setup.py`` directly.
2024-02-24T09:53:17,859           Instead, use pypa/build, pypa/installer or other
2024-02-24T09:53:17,859           standards-based tools.

2024-02-24T09:53:17,861           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-02-24T09:53:17,861           ********************************************************************************

2024-02-24T09:53:17,863   !!
2024-02-24T09:53:17,863     self.initialize_options()
2024-02-24T09:53:17,881   installing to build/bdist.linux-armv7l/wheel
2024-02-24T09:53:17,882   running install
2024-02-24T09:53:17,907   running install_lib
2024-02-24T09:53:17,930   creating build/bdist.linux-armv7l
2024-02-24T09:53:17,931   creating build/bdist.linux-armv7l/wheel
2024-02-24T09:53:17,932   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:17,933   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:17,937   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,938   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,940   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,942   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,944   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,946   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,948   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,950   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,952   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,954   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,956   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,958   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-02-24T09:53:17,960   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:17,963   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-02-24T09:53:17,964   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,965   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,967   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-02-24T09:53:17,969   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,970   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,972   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-02-24T09:53:17,974   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,975   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,977   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-02-24T09:53:17,979   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,980   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,982   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-02-24T09:53:17,984   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,985   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,987   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-02-24T09:53:17,989   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,990   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,992   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-02-24T09:53:17,994   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-02-24T09:53:17,995   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-02-24T09:53:17,997   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-02-24T09:53:17,998   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-02-24T09:53:18,000   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-02-24T09:53:18,001   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-02-24T09:53:18,003   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-02-24T09:53:18,003   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-02-24T09:53:18,006   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:18,006   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:18,008   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-02-24T09:53:18,010   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-02-24T09:53:18,011   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-02-24T09:53:18,013   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-02-24T09:53:18,016   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-02-24T09:53:18,017   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-02-24T09:53:18,019   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-02-24T09:53:18,020   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-02-24T09:53:18,022   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:18,023   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:18,025   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-02-24T09:53:18,027   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-02-24T09:53:18,028   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-02-24T09:53:18,030   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-02-24T09:53:18,031   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-02-24T09:53:18,033   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,034   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,036   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,039   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,040   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,042   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,044   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,046   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,048   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,050   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,052   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,054   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,056   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,058   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-02-24T09:53:18,060   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-02-24T09:53:18,061   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-02-24T09:53:18,063   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:18,064   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:18,066   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-02-24T09:53:18,068   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-02-24T09:53:18,069   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-02-24T09:53:18,072   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-02-24T09:53:18,073   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-02-24T09:53:18,075   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:18,076   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:18,078   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-02-24T09:53:18,080   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:18,081   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:18,083   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-02-24T09:53:18,085   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:18,086   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:18,088   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-02-24T09:53:18,090   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:18,091   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:18,093   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-02-24T09:53:18,095   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-02-24T09:53:18,096   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-02-24T09:53:18,098   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:18,099   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:18,101   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-02-24T09:53:18,103   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-02-24T09:53:18,104   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-02-24T09:53:18,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:18,107   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:18,110   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-02-24T09:53:18,112   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:18,113   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:18,115   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-02-24T09:53:18,117   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-02-24T09:53:18,118   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-02-24T09:53:18,120   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:18,121   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:18,123   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-02-24T09:53:18,125   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:18,126   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:18,128   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-02-24T09:53:18,130   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-02-24T09:53:18,130   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-02-24T09:53:18,132   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,135   copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,137   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,141   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-02-24T09:53:18,142   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:18,143   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:18,145   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-02-24T09:53:18,147   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-02-24T09:53:18,148   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-02-24T09:53:18,150   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:18,151   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:18,153   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-02-24T09:53:18,155   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-02-24T09:53:18,156   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-02-24T09:53:18,158   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-02-24T09:53:18,159   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-02-24T09:53:18,161   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-02-24T09:53:18,163   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:18,164   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:18,166   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-02-24T09:53:18,168   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-02-24T09:53:18,169   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-02-24T09:53:18,171   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-02-24T09:53:18,172   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-02-24T09:53:18,174   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-02-24T09:53:18,175   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-02-24T09:53:18,177   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:18,178   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:18,179   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-02-24T09:53:18,181   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:18,182   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:18,184   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-02-24T09:53:18,186   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:18,187   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:18,189   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-02-24T09:53:18,191   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-02-24T09:53:18,192   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-02-24T09:53:18,194   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-02-24T09:53:18,196   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-02-24T09:53:18,197   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-02-24T09:53:18,199   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:18,200   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:18,202   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-02-24T09:53:18,204   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:18,205   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:18,207   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-02-24T09:53:18,209   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-02-24T09:53:18,210   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-02-24T09:53:18,212   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-02-24T09:53:18,213   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-02-24T09:53:18,215   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:18,216   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:18,218   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-02-24T09:53:18,220   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-02-24T09:53:18,221   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-02-24T09:53:18,223   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:18,224   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:18,225   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-02-24T09:53:18,227   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-02-24T09:53:18,228   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-02-24T09:53:18,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:18,231   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:18,233   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-02-24T09:53:18,236   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:18,237   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:18,238   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-02-24T09:53:18,241   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:18,242   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:18,243   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-02-24T09:53:18,245   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:18,246   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:18,248   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-02-24T09:53:18,251   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:18,252   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:18,253   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-02-24T09:53:18,255   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:18,256   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:18,258   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-02-24T09:53:18,260   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:18,261   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:18,263   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-02-24T09:53:18,265   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:18,266   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:18,267   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-02-24T09:53:18,269   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:18,270   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:18,272   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-02-24T09:53:18,274   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-02-24T09:53:18,275   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-02-24T09:53:18,277   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:18,278   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:18,280   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-02-24T09:53:18,282   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:18,283   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:18,285   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-02-24T09:53:18,287   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:18,288   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:18,290   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-02-24T09:53:18,292   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:18,293   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:18,295   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-02-24T09:53:18,297   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-02-24T09:53:18,297   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-02-24T09:53:18,300   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-02-24T09:53:18,300   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-02-24T09:53:18,303   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-02-24T09:53:18,303   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-02-24T09:53:18,306   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:18,307   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:18,308   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-02-24T09:53:18,310   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-02-24T09:53:18,311   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-02-24T09:53:18,314   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:18,314   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:18,316   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-02-24T09:53:18,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-02-24T09:53:18,319   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-02-24T09:53:18,322   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-02-24T09:53:18,322   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-02-24T09:53:18,325   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:18,325   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:18,327   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-02-24T09:53:18,329   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:18,330   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:18,332   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-02-24T09:53:18,334   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:18,335   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:18,337   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-02-24T09:53:18,339   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:18,340   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:18,342   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-02-24T09:53:18,344   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:18,345   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:18,346   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-02-24T09:53:18,349   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-02-24T09:53:18,350   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-02-24T09:53:18,352   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-02-24T09:53:18,353   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-02-24T09:53:18,355   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-02-24T09:53:18,356   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-02-24T09:53:18,358   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-02-24T09:53:18,359   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-02-24T09:53:18,361   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-02-24T09:53:18,362   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-02-24T09:53:18,364   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-02-24T09:53:18,365   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-02-24T09:53:18,367   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-02-24T09:53:18,368   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-02-24T09:53:18,370   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:18,371   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:18,373   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-02-24T09:53:18,375   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:18,376   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:18,378   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-02-24T09:53:18,380   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:18,381   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:18,382   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-02-24T09:53:18,384   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-02-24T09:53:18,385   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-02-24T09:53:18,387   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-02-24T09:53:18,388   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-02-24T09:53:18,390   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-02-24T09:53:18,391   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-02-24T09:53:18,394   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-02-24T09:53:18,394   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-02-24T09:53:18,397   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-02-24T09:53:18,397   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-02-24T09:53:18,400   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-02-24T09:53:18,401   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-02-24T09:53:18,403   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-02-24T09:53:18,404   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-02-24T09:53:18,406   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:18,407   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:18,409   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-02-24T09:53:18,411   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-02-24T09:53:18,412   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-02-24T09:53:18,414   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-02-24T09:53:18,415   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-02-24T09:53:18,417   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:18,418   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:18,420   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-02-24T09:53:18,422   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:18,423   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:18,425   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-02-24T09:53:18,427   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:18,428   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:18,429   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-02-24T09:53:18,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-02-24T09:53:18,433   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-02-24T09:53:18,435   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:18,436   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:18,437   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-02-24T09:53:18,439   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-02-24T09:53:18,440   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-02-24T09:53:18,442   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-02-24T09:53:18,443   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-02-24T09:53:18,446   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:18,446   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:18,448   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-02-24T09:53:18,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:18,451   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:18,453   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-02-24T09:53:18,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:18,456   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:18,458   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-02-24T09:53:18,460   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-02-24T09:53:18,463   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-02-24T09:53:18,465   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-02-24T09:53:18,466   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-02-24T09:53:18,468   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-02-24T09:53:18,469   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-02-24T09:53:18,471   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-02-24T09:53:18,472   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-02-24T09:53:18,474   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:18,475   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:18,477   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-02-24T09:53:18,479   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-02-24T09:53:18,480   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-02-24T09:53:18,482   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-02-24T09:53:18,483   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-02-24T09:53:18,485   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-02-24T09:53:18,486   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-02-24T09:53:18,488   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:18,489   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:18,491   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-02-24T09:53:18,493   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-02-24T09:53:18,494   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-02-24T09:53:18,496   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:18,497   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:18,499   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-02-24T09:53:18,501   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-02-24T09:53:18,502   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-02-24T09:53:18,504   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:18,505   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:18,507   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-02-24T09:53:18,509   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-02-24T09:53:18,510   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-02-24T09:53:18,512   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-02-24T09:53:18,513   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-02-24T09:53:18,515   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-02-24T09:53:18,516   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-02-24T09:53:18,518   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:18,519   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:18,521   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-02-24T09:53:18,523   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:18,524   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:18,525   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-02-24T09:53:18,527   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-02-24T09:53:18,528   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-02-24T09:53:18,531   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:18,531   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:18,533   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-02-24T09:53:18,535   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-02-24T09:53:18,536   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-02-24T09:53:18,539   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:18,539   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:18,541   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-02-24T09:53:18,543   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:18,544   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:18,546   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-02-24T09:53:18,548   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:18,549   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:18,551   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-02-24T09:53:18,553   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-02-24T09:53:18,554   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-02-24T09:53:18,556   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:18,557   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:18,559   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-02-24T09:53:18,561   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-02-24T09:53:18,561   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-02-24T09:53:18,564   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:18,564   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:18,566   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-02-24T09:53:18,568   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:18,569   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:18,571   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-02-24T09:53:18,573   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:18,574   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:18,576   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-02-24T09:53:18,578   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-02-24T09:53:18,579   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-02-24T09:53:18,581   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-02-24T09:53:18,582   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-02-24T09:53:18,585   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:18,585   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:18,587   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-02-24T09:53:18,590   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-02-24T09:53:18,591   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-02-24T09:53:18,593   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:18,594   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:18,596   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-02-24T09:53:18,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-02-24T09:53:18,598   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-02-24T09:53:18,601   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:18,601   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:18,603   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-02-24T09:53:18,605   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:18,606   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:18,608   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-02-24T09:53:18,610   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:18,611   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:18,613   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-02-24T09:53:18,615   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-02-24T09:53:18,616   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-02-24T09:53:18,618   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-02-24T09:53:18,619   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-02-24T09:53:18,622   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:18,623   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:18,624   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-02-24T09:53:18,627   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:18,628   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:18,629   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-02-24T09:53:18,632   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:18,633   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:18,634   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-02-24T09:53:18,637   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-02-24T09:53:18,638   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-02-24T09:53:18,640   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-02-24T09:53:18,641   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-02-24T09:53:18,643   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-02-24T09:53:18,644   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-02-24T09:53:18,646   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-02-24T09:53:18,647   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-02-24T09:53:18,649   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-02-24T09:53:18,650   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-02-24T09:53:18,653   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:18,654   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:18,655   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-02-24T09:53:18,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-02-24T09:53:18,659   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-02-24T09:53:18,661   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-02-24T09:53:18,662   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-02-24T09:53:18,664   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,665   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,669   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-02-24T09:53:18,670   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-02-24T09:53:18,672   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-02-24T09:53:18,674   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-02-24T09:53:18,677   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-02-24T09:53:18,679   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:18,680   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:18,682   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:18,684   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-02-24T09:53:18,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:18,687   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:18,689   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:18,691   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:18,693   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-02-24T09:53:18,695   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-02-24T09:53:18,696   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-02-24T09:53:18,698   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,701   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,703   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-02-24T09:53:18,706   running install_egg_info
2024-02-24T09:53:18,740   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.4-py3.11.egg-info
2024-02-24T09:53:18,755   running install_scripts
2024-02-24T09:53:18,792   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.4.dist-info/WHEEL
2024-02-24T09:53:18,795   creating '/tmp/pip-wheel-6sacubs2/alpaca_eval-0.5.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-02-24T09:53:18,797   adding 'alpaca_eval/__init__.py'
2024-02-24T09:53:18,800   adding 'alpaca_eval/analyze.py'
2024-02-24T09:53:18,803   adding 'alpaca_eval/completion_parsers.py'
2024-02-24T09:53:18,804   adding 'alpaca_eval/constants.py'
2024-02-24T09:53:18,808   adding 'alpaca_eval/main.py'
2024-02-24T09:53:18,809   adding 'alpaca_eval/metrics.py'
2024-02-24T09:53:18,812   adding 'alpaca_eval/plotting.py'
2024-02-24T09:53:18,814   adding 'alpaca_eval/processors.py'
2024-02-24T09:53:18,815   adding 'alpaca_eval/types.py'
2024-02-24T09:53:18,818   adding 'alpaca_eval/utils.py'
2024-02-24T09:53:18,820   adding 'alpaca_eval/annotators/__init__.py'
2024-02-24T09:53:18,824   adding 'alpaca_eval/annotators/base.py'
2024-02-24T09:53:18,826   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-02-24T09:53:18,828   adding 'alpaca_eval/decoders/__init__.py'
2024-02-24T09:53:18,830   adding 'alpaca_eval/decoders/anthropic.py'
2024-02-24T09:53:18,831   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-02-24T09:53:18,833   adding 'alpaca_eval/decoders/cohere.py'
2024-02-24T09:53:18,834   adding 'alpaca_eval/decoders/google.py'
2024-02-24T09:53:18,836   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-02-24T09:53:18,837   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-02-24T09:53:18,839   adding 'alpaca_eval/decoders/jinachat.py'
2024-02-24T09:53:18,841   adding 'alpaca_eval/decoders/openai.py'
2024-02-24T09:53:18,843   adding 'alpaca_eval/decoders/replicate.py'
2024-02-24T09:53:18,844   adding 'alpaca_eval/decoders/vllm_local.py'
2024-02-24T09:53:18,847   adding 'alpaca_eval/evaluators_configs/README.md'
2024-02-24T09:53:18,849   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-02-24T09:53:18,850   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-02-24T09:53:18,852   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-02-24T09:53:18,853   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-02-24T09:53:18,855   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-02-24T09:53:18,856   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-02-24T09:53:18,858   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-02-24T09:53:18,859   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-02-24T09:53:18,860   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-02-24T09:53:18,862   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-02-24T09:53:18,864   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-02-24T09:53:18,865   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-02-24T09:53:18,866   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-02-24T09:53:18,868   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-02-24T09:53:18,869   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-02-24T09:53:18,871   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-02-24T09:53:18,872   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-02-24T09:53:18,874   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-02-24T09:53:18,875   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-02-24T09:53:18,876   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-02-24T09:53:18,878   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-02-24T09:53:18,880   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-02-24T09:53:18,881   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-02-24T09:53:18,882   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-02-24T09:53:18,884   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-02-24T09:53:18,885   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-02-24T09:53:18,887   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-02-24T09:53:18,889   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-02-24T09:53:18,890   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-02-24T09:53:18,892   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-02-24T09:53:18,893   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-02-24T09:53:18,895   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-02-24T09:53:18,897   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-02-24T09:53:18,898   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-02-24T09:53:18,900   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-02-24T09:53:18,902   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-02-24T09:53:18,903   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-02-24T09:53:18,905   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-02-24T09:53:18,906   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-02-24T09:53:18,908   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-02-24T09:53:18,909   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-02-24T09:53:18,911   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-02-24T09:53:18,913   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-02-24T09:53:18,914   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-02-24T09:53:18,916   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-02-24T09:53:18,918   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-02-24T09:53:18,919   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-02-24T09:53:18,921   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-02-24T09:53:18,922   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-02-24T09:53:18,923   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-02-24T09:53:18,925   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-02-24T09:53:18,927   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-02-24T09:53:18,928   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-02-24T09:53:18,930   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-02-24T09:53:18,931   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-02-24T09:53:18,933   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-02-24T09:53:18,934   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-02-24T09:53:18,936   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-02-24T09:53:18,937   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-02-24T09:53:18,938   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-02-24T09:53:18,940   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-02-24T09:53:18,942   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-02-24T09:53:18,943   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-02-24T09:53:18,944   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-02-24T09:53:18,946   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-02-24T09:53:18,949   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-02-24T09:53:18,950   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-02-24T09:53:18,951   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-02-24T09:53:18,952   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-02-24T09:53:18,954   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-02-24T09:53:18,955   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-02-24T09:53:18,957   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-02-24T09:53:18,960   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-02-24T09:53:18,964   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-02-24T09:53:18,965   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-02-24T09:53:18,967   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-02-24T09:53:18,968   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-02-24T09:53:18,969   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-02-24T09:53:18,971   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-02-24T09:53:18,972   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-02-24T09:53:18,974   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-02-24T09:53:18,975   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-02-24T09:53:18,977   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-02-24T09:53:18,978   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-02-24T09:53:18,980   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-02-24T09:53:18,981   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-02-24T09:53:18,983   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-02-24T09:53:18,984   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-02-24T09:53:18,986   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-02-24T09:53:18,987   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-02-24T09:53:18,988   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-02-24T09:53:18,989   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-02-24T09:53:18,991   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-02-24T09:53:18,992   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-02-24T09:53:18,993   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-02-24T09:53:18,995   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-02-24T09:53:18,996   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-02-24T09:53:18,997   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-02-24T09:53:18,999   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-02-24T09:53:19,000   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-02-24T09:53:19,002   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-02-24T09:53:19,003   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-02-24T09:53:19,004   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-02-24T09:53:19,006   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-02-24T09:53:19,007   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-02-24T09:53:19,009   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-02-24T09:53:19,011   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-02-24T09:53:19,012   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-02-24T09:53:19,014   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-02-24T09:53:19,015   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-02-24T09:53:19,017   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-02-24T09:53:19,018   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-02-24T09:53:19,019   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-02-24T09:53:19,021   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-02-24T09:53:19,023   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-02-24T09:53:19,024   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-02-24T09:53:19,026   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-02-24T09:53:19,027   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-02-24T09:53:19,029   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-02-24T09:53:19,030   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-02-24T09:53:19,032   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-02-24T09:53:19,033   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-02-24T09:53:19,034   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-02-24T09:53:19,036   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-02-24T09:53:19,038   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-02-24T09:53:19,039   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-02-24T09:53:19,041   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-02-24T09:53:19,042   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-02-24T09:53:19,043   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-02-24T09:53:19,045   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-02-24T09:53:19,047   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-02-24T09:53:19,048   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-02-24T09:53:19,049   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-02-24T09:53:19,050   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-02-24T09:53:19,052   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-02-24T09:53:19,053   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-02-24T09:53:19,054   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-02-24T09:53:19,056   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-02-24T09:53:19,057   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-02-24T09:53:19,059   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-02-24T09:53:19,061   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-02-24T09:53:19,062   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-02-24T09:53:19,064   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-02-24T09:53:19,065   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-02-24T09:53:19,066   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-02-24T09:53:19,068   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-02-24T09:53:19,069   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-02-24T09:53:19,071   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-02-24T09:53:19,072   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-02-24T09:53:19,074   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-02-24T09:53:19,076   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-02-24T09:53:19,077   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-02-24T09:53:19,078   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-02-24T09:53:19,080   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-02-24T09:53:19,082   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-02-24T09:53:19,083   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-02-24T09:53:19,085   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-02-24T09:53:19,086   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-02-24T09:53:19,088   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-02-24T09:53:19,089   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-02-24T09:53:19,090   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-02-24T09:53:19,092   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-02-24T09:53:19,093   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-02-24T09:53:19,095   adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt'
2024-02-24T09:53:19,096   adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml'
2024-02-24T09:53:19,098   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-02-24T09:53:19,099   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-02-24T09:53:19,101   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-02-24T09:53:19,103   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-02-24T09:53:19,104   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-02-24T09:53:19,106   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-02-24T09:53:19,107   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-02-24T09:53:19,109   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-02-24T09:53:19,110   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-02-24T09:53:19,112   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-02-24T09:53:19,113   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-02-24T09:53:19,114   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-02-24T09:53:19,115   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-02-24T09:53:19,117   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-02-24T09:53:19,118   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-02-24T09:53:19,120   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-02-24T09:53:19,121   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-02-24T09:53:19,122   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-02-24T09:53:19,124   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-02-24T09:53:19,125   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-02-24T09:53:19,126   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-02-24T09:53:19,128   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-02-24T09:53:19,129   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-02-24T09:53:19,131   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-02-24T09:53:19,132   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-02-24T09:53:19,133   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-02-24T09:53:19,134   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-02-24T09:53:19,136   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-02-24T09:53:19,137   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-02-24T09:53:19,139   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-02-24T09:53:19,140   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-02-24T09:53:19,142   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-02-24T09:53:19,143   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-02-24T09:53:19,144   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-02-24T09:53:19,146   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-02-24T09:53:19,147   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-02-24T09:53:19,149   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-02-24T09:53:19,150   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-02-24T09:53:19,152   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-02-24T09:53:19,153   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-02-24T09:53:19,155   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-02-24T09:53:19,156   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-02-24T09:53:19,158   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-02-24T09:53:19,159   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-02-24T09:53:19,161   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-02-24T09:53:19,162   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-02-24T09:53:19,164   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-02-24T09:53:19,165   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-02-24T09:53:19,167   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-02-24T09:53:19,168   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-02-24T09:53:19,170   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-02-24T09:53:19,172   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-02-24T09:53:19,174   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-02-24T09:53:19,175   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-02-24T09:53:19,177   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-02-24T09:53:19,178   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-02-24T09:53:19,179   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-02-24T09:53:19,181   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-02-24T09:53:19,182   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-02-24T09:53:19,183   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-02-24T09:53:19,185   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-02-24T09:53:19,186   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-02-24T09:53:19,188   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-02-24T09:53:19,189   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-02-24T09:53:19,190   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-02-24T09:53:19,192   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-02-24T09:53:19,193   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-02-24T09:53:19,195   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-02-24T09:53:19,196   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-02-24T09:53:19,198   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-02-24T09:53:19,200   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-02-24T09:53:19,201   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-02-24T09:53:19,202   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-02-24T09:53:19,204   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-02-24T09:53:19,205   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-02-24T09:53:19,206   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-02-24T09:53:19,208   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-02-24T09:53:19,209   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-02-24T09:53:19,211   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-02-24T09:53:19,212   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-02-24T09:53:19,214   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-02-24T09:53:19,215   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-02-24T09:53:19,217   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-02-24T09:53:19,218   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-02-24T09:53:19,219   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-02-24T09:53:19,221   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-02-24T09:53:19,223   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-02-24T09:53:19,224   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-02-24T09:53:19,226   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-02-24T09:53:19,227   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-02-24T09:53:19,229   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-02-24T09:53:19,231   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-02-24T09:53:19,232   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-02-24T09:53:19,234   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-02-24T09:53:19,235   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-02-24T09:53:19,237   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-02-24T09:53:19,239   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-02-24T09:53:19,240   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-02-24T09:53:19,242   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-02-24T09:53:19,243   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-02-24T09:53:19,245   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-02-24T09:53:19,246   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-02-24T09:53:19,248   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-02-24T09:53:19,249   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-02-24T09:53:19,250   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-02-24T09:53:19,253   adding 'alpaca_eval-0.5.4.dist-info/LICENSE'
2024-02-24T09:53:19,264   adding 'alpaca_eval-0.5.4.dist-info/METADATA'
2024-02-24T09:53:19,266   adding 'alpaca_eval-0.5.4.dist-info/WHEEL'
2024-02-24T09:53:19,266   adding 'alpaca_eval-0.5.4.dist-info/entry_points.txt'
2024-02-24T09:53:19,267   adding 'alpaca_eval-0.5.4.dist-info/top_level.txt'
2024-02-24T09:53:19,273   adding 'alpaca_eval-0.5.4.dist-info/RECORD'
2024-02-24T09:53:19,280   removing build/bdist.linux-armv7l/wheel
2024-02-24T09:53:19,517   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-02-24T09:53:19,522   Created wheel for alpaca-eval: filename=alpaca_eval-0.5.4-py3-none-any.whl size=257588 sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785
2024-02-24T09:53:19,523   Stored in directory: /tmp/pip-ephem-wheel-cache-uo6pa09u/wheels/29/d0/bb/e3e99b52bc55bed7f2edd9c096801090f09ecf8d8e74d6f022
2024-02-24T09:53:19,554 Successfully built alpaca-eval
2024-02-24T09:53:19,565 Removed build tracker: '/tmp/pip-build-tracker-m7fnf4dx'