2024-04-19T08:08:29,029 Created temporary directory: /tmp/pip-build-tracker-cbb50yau
2024-04-19T08:08:29,030 Initialized build tracking at /tmp/pip-build-tracker-cbb50yau
2024-04-19T08:08:29,031 Created build tracker: /tmp/pip-build-tracker-cbb50yau
2024-04-19T08:08:29,032 Entered build tracker: /tmp/pip-build-tracker-cbb50yau
2024-04-19T08:08:29,032 Created temporary directory: /tmp/pip-wheel-z9qavv48
2024-04-19T08:08:29,036 Created temporary directory: /tmp/pip-ephem-wheel-cache-2x6ql36u
2024-04-19T08:08:29,058 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-04-19T08:08:29,061 2 location(s) to search for versions of alpaca-eval:
2024-04-19T08:08:29,061 * https://pypi.org/simple/alpaca-eval/
2024-04-19T08:08:29,061 * https://www.piwheels.org/simple/alpaca-eval/
2024-04-19T08:08:29,062 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-04-19T08:08:29,063 Getting page https://pypi.org/simple/alpaca-eval/
2024-04-19T08:08:29,065 Found index url https://pypi.org/simple/
2024-04-19T08:08:29,286 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-04-19T08:08:29,299   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,300   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-04-19T08:08:29,300   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,301   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-04-19T08:08:29,302   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,303   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-04-19T08:08:29,304   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,305   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-04-19T08:08:29,305   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,306   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-04-19T08:08:29,307   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,308   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-04-19T08:08:29,309   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,310   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-04-19T08:08:29,311   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,312   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-04-19T08:08:29,312   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,313   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-04-19T08:08:29,314   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,315   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-04-19T08:08:29,315   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,316   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-04-19T08:08:29,317   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,318   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-04-19T08:08:29,319   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,320   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-04-19T08:08:29,320   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,321   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-04-19T08:08:29,322   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,323   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-04-19T08:08:29,324   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,324   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-04-19T08:08:29,325   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,326   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-04-19T08:08:29,327   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,328   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-04-19T08:08:29,328   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,329   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-04-19T08:08:29,330   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,330   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-04-19T08:08:29,331   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,332   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-04-19T08:08:29,333   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,334   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-04-19T08:08:29,334   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,335   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-04-19T08:08:29,335   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,336   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-04-19T08:08:29,337   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,338   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-04-19T08:08:29,339   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,340   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-04-19T08:08:29,340   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,341   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-04-19T08:08:29,342   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,343   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-04-19T08:08:29,343   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,345   Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3
2024-04-19T08:08:29,345   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,346   Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4
2024-04-19T08:08:29,347   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,347   Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6
2024-04-19T08:08:29,348   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/50/6b/cbc910f0fe05f05fd16037b8edbd39a5aa5e52ef5d433e653a1a1974dbc2/alpaca_eval-0.6.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,349   Found link https://files.pythonhosted.org/packages/5a/0c/c46d793fa6f171816c6cc0e1f84488a71487a118b2d3800017198d424005/alpaca_eval-0.6.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.1
2024-04-19T08:08:29,349   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ea/4d/9b44ccd56c4f7579c9e4b6886096daa1ad6d75019e4a2b03f0b94476a623/alpaca_eval-0.6.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,350   Found link https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6.2
2024-04-19T08:08:29,351 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-04-19T08:08:29,352 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-04-19T08:08:29,354 Found index url https://www.piwheels.org/simple/
2024-04-19T08:08:29,676 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-04-19T08:08:29,685   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6.1-py3-none-any.whl#sha256=69f33e18379374a6bd7b8d105c2eb5e646a36a802730450943b0be22763dd4e8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,686   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.6-py3-none-any.whl#sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,686   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,687   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,687   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,688   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,689   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,689   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,690   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,690   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,691   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,691   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,692   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,692   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,693   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,694   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,694   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,695   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,696   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,696   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,696   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,697   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,697   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,698   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,698   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-04-19T08:08:29,699   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,699   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,700   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-04-19T08:08:29,701 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-04-19T08:08:29,701 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-04-19T08:08:29,724 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-04-19T08:08:29,742 Collecting alpaca-eval==0.6.2
2024-04-19T08:08:29,745   Created temporary directory: /tmp/pip-unpack-2xli8wal
2024-04-19T08:08:29,963   Downloading alpaca_eval-0.6.2.tar.gz (368 kB)
2024-04-19T08:08:30,797   Added alpaca-eval==0.6.2 from https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz to build tracker '/tmp/pip-build-tracker-cbb50yau'
2024-04-19T08:08:30,798   Running setup.py (path:/tmp/pip-wheel-z9qavv48/alpaca-eval_165ebdb88ee2495abb154e76de9afe6b/setup.py) egg_info for package alpaca-eval
2024-04-19T08:08:30,800   Created temporary directory: /tmp/pip-pip-egg-info-nl3bo9yb
2024-04-19T08:08:30,800   Preparing metadata (setup.py): started
2024-04-19T08:08:30,801   Running command python setup.py egg_info
2024-04-19T08:08:31,873   running egg_info
2024-04-19T08:08:31,874   creating /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info
2024-04-19T08:08:31,899   writing /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/PKG-INFO
2024-04-19T08:08:31,920   writing dependency_links to /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/dependency_links.txt
2024-04-19T08:08:31,922   writing entry points to /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/entry_points.txt
2024-04-19T08:08:31,931   writing requirements to /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/requires.txt
2024-04-19T08:08:31,932   writing top-level names to /tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/top_level.txt
2024-04-19T08:08:31,933   writing manifest file '/tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/SOURCES.txt'
2024-04-19T08:08:32,017   reading manifest file '/tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/SOURCES.txt'
2024-04-19T08:08:32,018   reading manifest template 'MANIFEST.in'
2024-04-19T08:08:32,244   adding license file 'LICENSE'
2024-04-19T08:08:32,256   writing manifest file '/tmp/pip-pip-egg-info-nl3bo9yb/alpaca_eval.egg-info/SOURCES.txt'
2024-04-19T08:08:32,366   Preparing metadata (setup.py): finished with status 'done'
2024-04-19T08:08:32,374   Source in /tmp/pip-wheel-z9qavv48/alpaca-eval_165ebdb88ee2495abb154e76de9afe6b has version 0.6.2, which satisfies requirement alpaca-eval==0.6.2 from https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz
2024-04-19T08:08:32,375   Removed alpaca-eval==0.6.2 from https://files.pythonhosted.org/packages/8b/1f/a5b724bc11abfc5bb1e43a067527d9daec1051fe1f6f11d0db2c30325b7b/alpaca_eval-0.6.2.tar.gz from build tracker '/tmp/pip-build-tracker-cbb50yau'
2024-04-19T08:08:32,390 Created temporary directory: /tmp/pip-unpack-9q12xl7g
2024-04-19T08:08:32,391 Created temporary directory: /tmp/pip-unpack-tdf1sk5e
2024-04-19T08:08:32,543 Building wheels for collected packages: alpaca-eval
2024-04-19T08:08:32,547   Created temporary directory: /tmp/pip-wheel-zjr0uc2t
2024-04-19T08:08:32,548   Building wheel for alpaca-eval (setup.py): started
2024-04-19T08:08:32,549   Destination directory: /tmp/pip-wheel-zjr0uc2t
2024-04-19T08:08:32,550   Running command python setup.py bdist_wheel
2024-04-19T08:08:33,627   running bdist_wheel
2024-04-19T08:08:33,723   running build
2024-04-19T08:08:33,724   running build_py
2024-04-19T08:08:33,752   creating build
2024-04-19T08:08:33,753   creating build/lib
2024-04-19T08:08:33,753   creating build/lib/alpaca_eval
2024-04-19T08:08:33,755   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,757   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,759   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,762   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,765   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,767   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,770   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,772   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,774   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-04-19T08:08:33,777   creating build/lib/alpaca_eval/metrics
2024-04-19T08:08:33,779   copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics
2024-04-19T08:08:33,781   copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics
2024-04-19T08:08:33,783   copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics
2024-04-19T08:08:33,784   copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics
2024-04-19T08:08:33,788   creating build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,789   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,791   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,793   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,795   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,797   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,799   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,801   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,803   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,805   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,807   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,809   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-04-19T08:08:33,811   creating build/lib/alpaca_eval/annotators
2024-04-19T08:08:33,812   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-04-19T08:08:33,815   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-04-19T08:08:33,818   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-04-19T08:08:33,820   running egg_info
2024-04-19T08:08:33,881   writing src/alpaca_eval.egg-info/PKG-INFO
2024-04-19T08:08:33,901   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-04-19T08:08:33,903   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-04-19T08:08:33,912   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-04-19T08:08:33,914   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-04-19T08:08:33,945   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-04-19T08:08:33,955   reading manifest template 'MANIFEST.in'
2024-04-19T08:08:34,138   adding license file 'LICENSE'
2024-04-19T08:08:34,155   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-04-19T08:08:34,158   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-04-19T08:08:34,159   !!

2024-04-19T08:08:34,160           ********************************************************************************
2024-04-19T08:08:34,160           ############################
2024-04-19T08:08:34,161           # Package would be ignored #
2024-04-19T08:08:34,161           ############################
2024-04-19T08:08:34,162           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-04-19T08:08:34,163           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,164           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,164           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-04-19T08:08:34,165           to the `packages` configuration field.

2024-04-19T08:08:34,166           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,167           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,167           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,168           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,170           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,170           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-04-19T08:08:34,171           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-04-19T08:08:34,171           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,171           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,172           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,172           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,173           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,174           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,174                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,175                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,175                 directory, all directories are treated like packages.
2024-04-19T08:08:34,175           ********************************************************************************

2024-04-19T08:08:34,176   !!
2024-04-19T08:08:34,177     check.warn(importable)
2024-04-19T08:08:34,177   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-04-19T08:08:34,177   !!

2024-04-19T08:08:34,178           ********************************************************************************
2024-04-19T08:08:34,179           ############################
2024-04-19T08:08:34,180           # Package would be ignored #
2024-04-19T08:08:34,180           ############################
2024-04-19T08:08:34,181           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-04-19T08:08:34,181           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,182           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,183           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-04-19T08:08:34,183           to the `packages` configuration field.

2024-04-19T08:08:34,184           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,185           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,185           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,186           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,187           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,188           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-04-19T08:08:34,188           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-04-19T08:08:34,189           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,189           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,190           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,191           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,192           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,193           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,193                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,194                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,195                 directory, all directories are treated like packages.
2024-04-19T08:08:34,195           ********************************************************************************

2024-04-19T08:08:34,195   !!
2024-04-19T08:08:34,196     check.warn(importable)
2024-04-19T08:08:34,196   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-04-19T08:08:34,196   !!

2024-04-19T08:08:34,197           ********************************************************************************
2024-04-19T08:08:34,198           ############################
2024-04-19T08:08:34,198           # Package would be ignored #
2024-04-19T08:08:34,198           ############################
2024-04-19T08:08:34,199           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-04-19T08:08:34,199           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,200           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,200           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-04-19T08:08:34,200           to the `packages` configuration field.

2024-04-19T08:08:34,201           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,201           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,202           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,203           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,204           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,204           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-04-19T08:08:34,205           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-04-19T08:08:34,205           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,206           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,206           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,207           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,208           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,209           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,210                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,210                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,211                 directory, all directories are treated like packages.
2024-04-19T08:08:34,211           ********************************************************************************

2024-04-19T08:08:34,212   !!
2024-04-19T08:08:34,213     check.warn(importable)
2024-04-19T08:08:34,213   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-04-19T08:08:34,214   !!

2024-04-19T08:08:34,215           ********************************************************************************
2024-04-19T08:08:34,215           ############################
2024-04-19T08:08:34,216           # Package would be ignored #
2024-04-19T08:08:34,216           ############################
2024-04-19T08:08:34,217           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-04-19T08:08:34,217           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,218           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,219           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-04-19T08:08:34,219           to the `packages` configuration field.

2024-04-19T08:08:34,220           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,220           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,220           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,221           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,222           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,223           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-04-19T08:08:34,223           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-04-19T08:08:34,224           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,224           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,224           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,225           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,226           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,228           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,228                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,228                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,229                 directory, all directories are treated like packages.
2024-04-19T08:08:34,229           ********************************************************************************

2024-04-19T08:08:34,230   !!
2024-04-19T08:08:34,231     check.warn(importable)
2024-04-19T08:08:34,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,232   !!

2024-04-19T08:08:34,233           ********************************************************************************
2024-04-19T08:08:34,233           ############################
2024-04-19T08:08:34,234           # Package would be ignored #
2024-04-19T08:08:34,234           ############################
2024-04-19T08:08:34,235           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-04-19T08:08:34,235           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,236           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,237           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-04-19T08:08:34,237           to the `packages` configuration field.

2024-04-19T08:08:34,238           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,239           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,240           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,241           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,242           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-04-19T08:08:34,243           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-04-19T08:08:34,244           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,245           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,246           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,246           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,247           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,248                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,248                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,249                 directory, all directories are treated like packages.
2024-04-19T08:08:34,249           ********************************************************************************

2024-04-19T08:08:34,250   !!
2024-04-19T08:08:34,250     check.warn(importable)
2024-04-19T08:08:34,250   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-04-19T08:08:34,251   !!

2024-04-19T08:08:34,252           ********************************************************************************
2024-04-19T08:08:34,252           ############################
2024-04-19T08:08:34,252           # Package would be ignored #
2024-04-19T08:08:34,253           ############################
2024-04-19T08:08:34,253           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-04-19T08:08:34,254           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,255           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,255           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-04-19T08:08:34,256           to the `packages` configuration field.

2024-04-19T08:08:34,257           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,257           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,258           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,259           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,260           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,261           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-04-19T08:08:34,261           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-04-19T08:08:34,262           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,262           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,262           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,263           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,264           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,266           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,266                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,267                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,267                 directory, all directories are treated like packages.
2024-04-19T08:08:34,268           ********************************************************************************

2024-04-19T08:08:34,269   !!
2024-04-19T08:08:34,269     check.warn(importable)
2024-04-19T08:08:34,269   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-04-19T08:08:34,270   !!

2024-04-19T08:08:34,270           ********************************************************************************
2024-04-19T08:08:34,271           ############################
2024-04-19T08:08:34,271           # Package would be ignored #
2024-04-19T08:08:34,271           ############################
2024-04-19T08:08:34,272           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-04-19T08:08:34,272           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,273           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,273           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-04-19T08:08:34,273           to the `packages` configuration field.

2024-04-19T08:08:34,274           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,274           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,275           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,276           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,276           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,277           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-04-19T08:08:34,278           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-04-19T08:08:34,278           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,278           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,279           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,280           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,281           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,283           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,283                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,284                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,284                 directory, all directories are treated like packages.
2024-04-19T08:08:34,285           ********************************************************************************

2024-04-19T08:08:34,285   !!
2024-04-19T08:08:34,286     check.warn(importable)
2024-04-19T08:08:34,286   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-04-19T08:08:34,287   !!

2024-04-19T08:08:34,288           ********************************************************************************
2024-04-19T08:08:34,288           ############################
2024-04-19T08:08:34,289           # Package would be ignored #
2024-04-19T08:08:34,289           ############################
2024-04-19T08:08:34,290           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-04-19T08:08:34,290           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,291           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,292           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-04-19T08:08:34,293           to the `packages` configuration field.

2024-04-19T08:08:34,293           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,294           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,294           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,295           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,295           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,296           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-04-19T08:08:34,296           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-04-19T08:08:34,297           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,297           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,298           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,298           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,299           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,300           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,301                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,301                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,301                 directory, all directories are treated like packages.
2024-04-19T08:08:34,302           ********************************************************************************

2024-04-19T08:08:34,303   !!
2024-04-19T08:08:34,303     check.warn(importable)
2024-04-19T08:08:34,304   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-04-19T08:08:34,304   !!

2024-04-19T08:08:34,306           ********************************************************************************
2024-04-19T08:08:34,306           ############################
2024-04-19T08:08:34,306           # Package would be ignored #
2024-04-19T08:08:34,307           ############################
2024-04-19T08:08:34,308           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-04-19T08:08:34,308           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,309           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,310           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-04-19T08:08:34,310           to the `packages` configuration field.

2024-04-19T08:08:34,311           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,312           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,312           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,313           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,314           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,315           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-04-19T08:08:34,316           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-04-19T08:08:34,316           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,317           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,318           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,319           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,320           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,320           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,321                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,321                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,321                 directory, all directories are treated like packages.
2024-04-19T08:08:34,322           ********************************************************************************

2024-04-19T08:08:34,323   !!
2024-04-19T08:08:34,323     check.warn(importable)
2024-04-19T08:08:34,323   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-04-19T08:08:34,324   !!

2024-04-19T08:08:34,324           ********************************************************************************
2024-04-19T08:08:34,325           ############################
2024-04-19T08:08:34,325           # Package would be ignored #
2024-04-19T08:08:34,326           ############################
2024-04-19T08:08:34,326           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-04-19T08:08:34,326           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,327           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,327           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-04-19T08:08:34,328           to the `packages` configuration field.

2024-04-19T08:08:34,329           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,329           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,330           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,331           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,332           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,333           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-04-19T08:08:34,333           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-04-19T08:08:34,333           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,334           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,334           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,335           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,336           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,338           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,338                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,339                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,339                 directory, all directories are treated like packages.
2024-04-19T08:08:34,340           ********************************************************************************

2024-04-19T08:08:34,341   !!
2024-04-19T08:08:34,341     check.warn(importable)
2024-04-19T08:08:34,342   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,342   !!

2024-04-19T08:08:34,343           ********************************************************************************
2024-04-19T08:08:34,344           ############################
2024-04-19T08:08:34,344           # Package would be ignored #
2024-04-19T08:08:34,344           ############################
2024-04-19T08:08:34,345           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-04-19T08:08:34,345           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,346           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,346           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-04-19T08:08:34,347           to the `packages` configuration field.

2024-04-19T08:08:34,347           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,348           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,348           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,349           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,350           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,350           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-04-19T08:08:34,351           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-04-19T08:08:34,351           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,352           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,352           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,353           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,354           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,355           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,355                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,356                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,356                 directory, all directories are treated like packages.
2024-04-19T08:08:34,357           ********************************************************************************

2024-04-19T08:08:34,358   !!
2024-04-19T08:08:34,358     check.warn(importable)
2024-04-19T08:08:34,358   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,359   !!

2024-04-19T08:08:34,360           ********************************************************************************
2024-04-19T08:08:34,360           ############################
2024-04-19T08:08:34,361           # Package would be ignored #
2024-04-19T08:08:34,361           ############################
2024-04-19T08:08:34,362           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-04-19T08:08:34,362           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,363           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,363           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-04-19T08:08:34,364           to the `packages` configuration field.

2024-04-19T08:08:34,365           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,365           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,366           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,366           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,367           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,368           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-04-19T08:08:34,368           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-04-19T08:08:34,368           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,369           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,369           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,370           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,370           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,371           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,372                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,372                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,372                 directory, all directories are treated like packages.
2024-04-19T08:08:34,373           ********************************************************************************

2024-04-19T08:08:34,374   !!
2024-04-19T08:08:34,374     check.warn(importable)
2024-04-19T08:08:34,375   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-04-19T08:08:34,375   !!

2024-04-19T08:08:34,376           ********************************************************************************
2024-04-19T08:08:34,376           ############################
2024-04-19T08:08:34,377           # Package would be ignored #
2024-04-19T08:08:34,378           ############################
2024-04-19T08:08:34,378           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-04-19T08:08:34,378           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,379           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,380           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-04-19T08:08:34,380           to the `packages` configuration field.

2024-04-19T08:08:34,381           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,382           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,382           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,383           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,384           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,385           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-04-19T08:08:34,386           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-04-19T08:08:34,386           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,386           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,387           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,388           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,389           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,391           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,391                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,391                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,392                 directory, all directories are treated like packages.
2024-04-19T08:08:34,392           ********************************************************************************

2024-04-19T08:08:34,393   !!
2024-04-19T08:08:34,393     check.warn(importable)
2024-04-19T08:08:34,393   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-04-19T08:08:34,394   !!

2024-04-19T08:08:34,394           ********************************************************************************
2024-04-19T08:08:34,395           ############################
2024-04-19T08:08:34,395           # Package would be ignored #
2024-04-19T08:08:34,395           ############################
2024-04-19T08:08:34,396           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-04-19T08:08:34,396           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,397           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,397           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-04-19T08:08:34,398           to the `packages` configuration field.

2024-04-19T08:08:34,398           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,399           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,399           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,400           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,401           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,402           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-04-19T08:08:34,402           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-04-19T08:08:34,402           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,403           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,403           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,404           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,405           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,406           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,407                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,407                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,408                 directory, all directories are treated like packages.
2024-04-19T08:08:34,408           ********************************************************************************

2024-04-19T08:08:34,409   !!
2024-04-19T08:08:34,410     check.warn(importable)
2024-04-19T08:08:34,410   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-04-19T08:08:34,411   !!

2024-04-19T08:08:34,412           ********************************************************************************
2024-04-19T08:08:34,412           ############################
2024-04-19T08:08:34,413           # Package would be ignored #
2024-04-19T08:08:34,413           ############################
2024-04-19T08:08:34,414           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-04-19T08:08:34,414           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,415           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,415           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-04-19T08:08:34,416           to the `packages` configuration field.

2024-04-19T08:08:34,416           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,417           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,417           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,418           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,419           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,420           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-04-19T08:08:34,420           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-04-19T08:08:34,420           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,421           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,421           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,422           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,423           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,424           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,425                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,425                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,425                 directory, all directories are treated like packages.
2024-04-19T08:08:34,426           ********************************************************************************

2024-04-19T08:08:34,427   !!
2024-04-19T08:08:34,427     check.warn(importable)
2024-04-19T08:08:34,428   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-04-19T08:08:34,428   !!

2024-04-19T08:08:34,429           ********************************************************************************
2024-04-19T08:08:34,430           ############################
2024-04-19T08:08:34,430           # Package would be ignored #
2024-04-19T08:08:34,431           ############################
2024-04-19T08:08:34,431           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-04-19T08:08:34,432           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,433           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,433           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-04-19T08:08:34,434           to the `packages` configuration field.

2024-04-19T08:08:34,435           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,435           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,435           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,436           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,438           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,439           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-04-19T08:08:34,439           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-04-19T08:08:34,440           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,441           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,442           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,442           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,443           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,444                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,444                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,445                 directory, all directories are treated like packages.
2024-04-19T08:08:34,445           ********************************************************************************

2024-04-19T08:08:34,446   !!
2024-04-19T08:08:34,446     check.warn(importable)
2024-04-19T08:08:34,447   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-04-19T08:08:34,447   !!

2024-04-19T08:08:34,448           ********************************************************************************
2024-04-19T08:08:34,448           ############################
2024-04-19T08:08:34,449           # Package would be ignored #
2024-04-19T08:08:34,449           ############################
2024-04-19T08:08:34,450           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-04-19T08:08:34,450           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,451           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,452           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-04-19T08:08:34,452           to the `packages` configuration field.

2024-04-19T08:08:34,453           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,454           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,454           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,455           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,456           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,457           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-04-19T08:08:34,458           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-04-19T08:08:34,458           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,459           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,459           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,460           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,461           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,463           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,463                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,464                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,464                 directory, all directories are treated like packages.
2024-04-19T08:08:34,465           ********************************************************************************

2024-04-19T08:08:34,466   !!
2024-04-19T08:08:34,466     check.warn(importable)
2024-04-19T08:08:34,467   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-04-19T08:08:34,467   !!

2024-04-19T08:08:34,468           ********************************************************************************
2024-04-19T08:08:34,468           ############################
2024-04-19T08:08:34,468           # Package would be ignored #
2024-04-19T08:08:34,469           ############################
2024-04-19T08:08:34,469           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-04-19T08:08:34,469           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,470           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,470           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-04-19T08:08:34,471           to the `packages` configuration field.

2024-04-19T08:08:34,471           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,472           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,472           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,473           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,474           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,474           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-04-19T08:08:34,475           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-04-19T08:08:34,475           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,476           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,476           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,477           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,478           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,479           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,480                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,480                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,481                 directory, all directories are treated like packages.
2024-04-19T08:08:34,481           ********************************************************************************

2024-04-19T08:08:34,482   !!
2024-04-19T08:08:34,483     check.warn(importable)
2024-04-19T08:08:34,483   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration.
2024-04-19T08:08:34,484   !!

2024-04-19T08:08:34,484           ********************************************************************************
2024-04-19T08:08:34,485           ############################
2024-04-19T08:08:34,485           # Package would be ignored #
2024-04-19T08:08:34,486           ############################
2024-04-19T08:08:34,486           Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1],
2024-04-19T08:08:34,487           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,488           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,488           package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added
2024-04-19T08:08:34,489           to the `packages` configuration field.

2024-04-19T08:08:34,490           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,490           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,490           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,491           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,492           If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are
2024-04-19T08:08:34,493           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via
2024-04-19T08:08:34,493           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,493           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,494           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,494           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,495           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,496           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,496                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,497                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,497                 directory, all directories are treated like packages.
2024-04-19T08:08:34,497           ********************************************************************************

2024-04-19T08:08:34,498   !!
2024-04-19T08:08:34,499     check.warn(importable)
2024-04-19T08:08:34,499   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-04-19T08:08:34,500   !!

2024-04-19T08:08:34,500           ********************************************************************************
2024-04-19T08:08:34,501           ############################
2024-04-19T08:08:34,501           # Package would be ignored #
2024-04-19T08:08:34,502           ############################
2024-04-19T08:08:34,502           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-04-19T08:08:34,503           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,504           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,504           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-04-19T08:08:34,505           to the `packages` configuration field.

2024-04-19T08:08:34,506           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,506           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,507           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,507           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,508           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,509           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-04-19T08:08:34,510           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-04-19T08:08:34,510           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,511           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,512           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,513           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,514           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,515           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,515                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,516                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,516                 directory, all directories are treated like packages.
2024-04-19T08:08:34,516           ********************************************************************************

2024-04-19T08:08:34,517   !!
2024-04-19T08:08:34,517     check.warn(importable)
2024-04-19T08:08:34,518   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-04-19T08:08:34,518   !!

2024-04-19T08:08:34,519           ********************************************************************************
2024-04-19T08:08:34,519           ############################
2024-04-19T08:08:34,519           # Package would be ignored #
2024-04-19T08:08:34,520           ############################
2024-04-19T08:08:34,520           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-04-19T08:08:34,521           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,522           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-04-19T08:08:34,522           to the `packages` configuration field.

2024-04-19T08:08:34,523           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,523           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,524           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,525           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,526           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,527           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-04-19T08:08:34,527           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-04-19T08:08:34,527           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,528           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,528           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,529           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,530           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,531           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,532                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,532                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,533                 directory, all directories are treated like packages.
2024-04-19T08:08:34,533           ********************************************************************************

2024-04-19T08:08:34,534   !!
2024-04-19T08:08:34,535     check.warn(importable)
2024-04-19T08:08:34,535   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-04-19T08:08:34,535   !!

2024-04-19T08:08:34,536           ********************************************************************************
2024-04-19T08:08:34,537           ############################
2024-04-19T08:08:34,537           # Package would be ignored #
2024-04-19T08:08:34,538           ############################
2024-04-19T08:08:34,538           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-04-19T08:08:34,538           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,539           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,539           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-04-19T08:08:34,540           to the `packages` configuration field.

2024-04-19T08:08:34,540           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,541           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,541           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,542           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,543           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,544           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-04-19T08:08:34,544           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-04-19T08:08:34,544           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,545           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,545           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,546           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,547           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,549           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,549                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,550                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,550                 directory, all directories are treated like packages.
2024-04-19T08:08:34,551           ********************************************************************************

2024-04-19T08:08:34,552   !!
2024-04-19T08:08:34,552     check.warn(importable)
2024-04-19T08:08:34,553   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,553   !!

2024-04-19T08:08:34,554           ********************************************************************************
2024-04-19T08:08:34,555           ############################
2024-04-19T08:08:34,555           # Package would be ignored #
2024-04-19T08:08:34,556           ############################
2024-04-19T08:08:34,556           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-04-19T08:08:34,557           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,558           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,558           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-04-19T08:08:34,558           to the `packages` configuration field.

2024-04-19T08:08:34,559           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,560           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,560           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,561           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,562           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,564           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-04-19T08:08:34,564           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-04-19T08:08:34,564           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,565           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,565           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,566           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,567           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,568           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,568                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,568                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,569                 directory, all directories are treated like packages.
2024-04-19T08:08:34,569           ********************************************************************************

2024-04-19T08:08:34,570   !!
2024-04-19T08:08:34,570     check.warn(importable)
2024-04-19T08:08:34,570   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-04-19T08:08:34,571   !!

2024-04-19T08:08:34,572           ********************************************************************************
2024-04-19T08:08:34,572           ############################
2024-04-19T08:08:34,572           # Package would be ignored #
2024-04-19T08:08:34,573           ############################
2024-04-19T08:08:34,574           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-04-19T08:08:34,574           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,575           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,576           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-04-19T08:08:34,576           to the `packages` configuration field.

2024-04-19T08:08:34,577           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,578           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,579           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,580           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,581           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,582           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-04-19T08:08:34,582           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-04-19T08:08:34,583           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,583           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,584           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,585           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,586           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,588           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,588                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,589                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,589                 directory, all directories are treated like packages.
2024-04-19T08:08:34,590           ********************************************************************************

2024-04-19T08:08:34,591   !!
2024-04-19T08:08:34,591     check.warn(importable)
2024-04-19T08:08:34,591   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-04-19T08:08:34,592   !!

2024-04-19T08:08:34,592           ********************************************************************************
2024-04-19T08:08:34,593           ############################
2024-04-19T08:08:34,593           # Package would be ignored #
2024-04-19T08:08:34,593           ############################
2024-04-19T08:08:34,594           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-04-19T08:08:34,594           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,595           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,595           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-04-19T08:08:34,595           to the `packages` configuration field.

2024-04-19T08:08:34,596           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,597           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,597           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,598           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,598           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,599           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-04-19T08:08:34,600           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-04-19T08:08:34,600           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,601           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,601           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,602           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,603           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,605           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,605                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,606                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,606                 directory, all directories are treated like packages.
2024-04-19T08:08:34,607           ********************************************************************************

2024-04-19T08:08:34,607   !!
2024-04-19T08:08:34,608     check.warn(importable)
2024-04-19T08:08:34,608   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-04-19T08:08:34,609   !!

2024-04-19T08:08:34,610           ********************************************************************************
2024-04-19T08:08:34,610           ############################
2024-04-19T08:08:34,611           # Package would be ignored #
2024-04-19T08:08:34,611           ############################
2024-04-19T08:08:34,612           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-04-19T08:08:34,612           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,613           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,614           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-04-19T08:08:34,615           to the `packages` configuration field.

2024-04-19T08:08:34,615           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,616           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,616           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,617           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,617           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,618           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-04-19T08:08:34,618           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-04-19T08:08:34,619           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,619           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,619           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,620           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,621           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,622           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,623                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,623                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,623                 directory, all directories are treated like packages.
2024-04-19T08:08:34,624           ********************************************************************************

2024-04-19T08:08:34,625   !!
2024-04-19T08:08:34,625     check.warn(importable)
2024-04-19T08:08:34,626   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-04-19T08:08:34,626   !!

2024-04-19T08:08:34,627           ********************************************************************************
2024-04-19T08:08:34,628           ############################
2024-04-19T08:08:34,628           # Package would be ignored #
2024-04-19T08:08:34,629           ############################
2024-04-19T08:08:34,629           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-04-19T08:08:34,629           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,630           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,631           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-04-19T08:08:34,631           to the `packages` configuration field.

2024-04-19T08:08:34,632           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,633           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,633           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,634           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,635           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,636           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-04-19T08:08:34,637           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-04-19T08:08:34,637           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,638           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,638           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,639           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,640           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,641           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,641                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,642                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,642                 directory, all directories are treated like packages.
2024-04-19T08:08:34,642           ********************************************************************************

2024-04-19T08:08:34,643   !!
2024-04-19T08:08:34,643     check.warn(importable)
2024-04-19T08:08:34,644   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-04-19T08:08:34,644   !!

2024-04-19T08:08:34,645           ********************************************************************************
2024-04-19T08:08:34,645           ############################
2024-04-19T08:08:34,646           # Package would be ignored #
2024-04-19T08:08:34,646           ############################
2024-04-19T08:08:34,647           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-04-19T08:08:34,647           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,648           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,649           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-04-19T08:08:34,649           to the `packages` configuration field.

2024-04-19T08:08:34,650           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,651           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,651           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,652           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,653           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,654           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-04-19T08:08:34,655           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-04-19T08:08:34,655           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,656           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,656           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,657           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,658           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,659           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,660                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,660                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,661                 directory, all directories are treated like packages.
2024-04-19T08:08:34,661           ********************************************************************************

2024-04-19T08:08:34,662   !!
2024-04-19T08:08:34,662     check.warn(importable)
2024-04-19T08:08:34,663   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-04-19T08:08:34,663   !!

2024-04-19T08:08:34,664           ********************************************************************************
2024-04-19T08:08:34,665           ############################
2024-04-19T08:08:34,665           # Package would be ignored #
2024-04-19T08:08:34,665           ############################
2024-04-19T08:08:34,666           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-04-19T08:08:34,666           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,667           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,667           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-04-19T08:08:34,667           to the `packages` configuration field.

2024-04-19T08:08:34,668           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,668           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,669           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,669           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,670           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,671           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-04-19T08:08:34,671           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-04-19T08:08:34,672           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,672           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,673           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,673           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,674           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,676           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,677                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,677                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,678                 directory, all directories are treated like packages.
2024-04-19T08:08:34,678           ********************************************************************************

2024-04-19T08:08:34,679   !!
2024-04-19T08:08:34,679     check.warn(importable)
2024-04-19T08:08:34,680   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,680   !!

2024-04-19T08:08:34,681           ********************************************************************************
2024-04-19T08:08:34,682           ############################
2024-04-19T08:08:34,682           # Package would be ignored #
2024-04-19T08:08:34,682           ############################
2024-04-19T08:08:34,683           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-04-19T08:08:34,683           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,684           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,685           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-04-19T08:08:34,685           to the `packages` configuration field.

2024-04-19T08:08:34,686           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,687           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,687           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,688           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,689           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,690           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-04-19T08:08:34,690           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-04-19T08:08:34,690           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,691           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,691           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,692           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,692           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,694           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,694                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,694                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,695                 directory, all directories are treated like packages.
2024-04-19T08:08:34,695           ********************************************************************************

2024-04-19T08:08:34,696   !!
2024-04-19T08:08:34,696     check.warn(importable)
2024-04-19T08:08:34,697   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,697   !!

2024-04-19T08:08:34,698           ********************************************************************************
2024-04-19T08:08:34,699           ############################
2024-04-19T08:08:34,699           # Package would be ignored #
2024-04-19T08:08:34,700           ############################
2024-04-19T08:08:34,700           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-04-19T08:08:34,701           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,701           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,702           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-04-19T08:08:34,702           to the `packages` configuration field.

2024-04-19T08:08:34,703           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,704           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,704           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,705           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,706           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,707           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-04-19T08:08:34,708           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-04-19T08:08:34,708           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,709           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,709           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,710           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,713           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,713                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,714                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,714                 directory, all directories are treated like packages.
2024-04-19T08:08:34,715           ********************************************************************************

2024-04-19T08:08:34,715   !!
2024-04-19T08:08:34,716     check.warn(importable)
2024-04-19T08:08:34,716   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:34,717   !!

2024-04-19T08:08:34,717           ********************************************************************************
2024-04-19T08:08:34,718           ############################
2024-04-19T08:08:34,718           # Package would be ignored #
2024-04-19T08:08:34,718           ############################
2024-04-19T08:08:34,719           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-04-19T08:08:34,719           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,720           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,720           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-04-19T08:08:34,721           to the `packages` configuration field.

2024-04-19T08:08:34,721           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,722           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,722           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,723           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,724           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,725           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-04-19T08:08:34,726           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-04-19T08:08:34,726           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,727           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,728           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,729           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,730           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,731           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,731                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,732                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,733                 directory, all directories are treated like packages.
2024-04-19T08:08:34,733           ********************************************************************************

2024-04-19T08:08:34,734   !!
2024-04-19T08:08:34,735     check.warn(importable)
2024-04-19T08:08:34,735   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-04-19T08:08:34,735   !!

2024-04-19T08:08:34,736           ********************************************************************************
2024-04-19T08:08:34,737           ############################
2024-04-19T08:08:34,738           # Package would be ignored #
2024-04-19T08:08:34,738           ############################
2024-04-19T08:08:34,739           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-04-19T08:08:34,740           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,740           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,741           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-04-19T08:08:34,741           to the `packages` configuration field.

2024-04-19T08:08:34,742           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,742           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,742           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,743           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,744           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,745           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-04-19T08:08:34,745           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-04-19T08:08:34,745           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,746           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,746           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,747           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,748           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,749           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,749                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,750                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,750                 directory, all directories are treated like packages.
2024-04-19T08:08:34,751           ********************************************************************************

2024-04-19T08:08:34,752   !!
2024-04-19T08:08:34,752     check.warn(importable)
2024-04-19T08:08:34,753   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-04-19T08:08:34,754   !!

2024-04-19T08:08:34,755           ********************************************************************************
2024-04-19T08:08:34,755           ############################
2024-04-19T08:08:34,756           # Package would be ignored #
2024-04-19T08:08:34,756           ############################
2024-04-19T08:08:34,757           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-04-19T08:08:34,757           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,758           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,759           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-04-19T08:08:34,759           to the `packages` configuration field.

2024-04-19T08:08:34,760           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,761           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,761           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,762           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,763           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,765           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-04-19T08:08:34,765           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-04-19T08:08:34,766           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,766           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,767           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,767           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,768           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,769           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,770                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,770                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,770                 directory, all directories are treated like packages.
2024-04-19T08:08:34,771           ********************************************************************************

2024-04-19T08:08:34,772   !!
2024-04-19T08:08:34,772     check.warn(importable)
2024-04-19T08:08:34,772   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-04-19T08:08:34,773   !!

2024-04-19T08:08:34,774           ********************************************************************************
2024-04-19T08:08:34,774           ############################
2024-04-19T08:08:34,774           # Package would be ignored #
2024-04-19T08:08:34,775           ############################
2024-04-19T08:08:34,775           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-04-19T08:08:34,776           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,777           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,777           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-04-19T08:08:34,778           to the `packages` configuration field.

2024-04-19T08:08:34,783           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,784           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,784           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,785           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,786           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,787           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-04-19T08:08:34,788           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-04-19T08:08:34,788           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,789           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,789           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,791           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,792           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,793           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,794                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,794                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,794                 directory, all directories are treated like packages.
2024-04-19T08:08:34,795           ********************************************************************************

2024-04-19T08:08:34,796   !!
2024-04-19T08:08:34,797     check.warn(importable)
2024-04-19T08:08:34,797   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-04-19T08:08:34,798   !!

2024-04-19T08:08:34,798           ********************************************************************************
2024-04-19T08:08:34,799           ############################
2024-04-19T08:08:34,799           # Package would be ignored #
2024-04-19T08:08:34,799           ############################
2024-04-19T08:08:34,800           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-04-19T08:08:34,800           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,801           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,801           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-04-19T08:08:34,802           to the `packages` configuration field.

2024-04-19T08:08:34,802           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,803           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,803           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,804           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,805           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,806           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-04-19T08:08:34,806           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-04-19T08:08:34,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,808           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,808           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,809           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,810           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,812           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,812                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,813                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,813                 directory, all directories are treated like packages.
2024-04-19T08:08:34,814           ********************************************************************************

2024-04-19T08:08:34,815   !!
2024-04-19T08:08:34,815     check.warn(importable)
2024-04-19T08:08:34,816   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-04-19T08:08:34,816   !!

2024-04-19T08:08:34,817           ********************************************************************************
2024-04-19T08:08:34,817           ############################
2024-04-19T08:08:34,818           # Package would be ignored #
2024-04-19T08:08:34,819           ############################
2024-04-19T08:08:34,819           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-04-19T08:08:34,820           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,821           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,821           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-04-19T08:08:34,822           to the `packages` configuration field.

2024-04-19T08:08:34,823           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,823           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,824           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,824           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,825           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,826           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-04-19T08:08:34,826           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-04-19T08:08:34,827           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,827           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,827           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,828           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,829           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,830           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,830                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,831                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,831                 directory, all directories are treated like packages.
2024-04-19T08:08:34,831           ********************************************************************************

2024-04-19T08:08:34,833   !!
2024-04-19T08:08:34,833     check.warn(importable)
2024-04-19T08:08:34,833   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is absent from the `packages` configuration.
2024-04-19T08:08:34,834   !!

2024-04-19T08:08:34,835           ********************************************************************************
2024-04-19T08:08:34,835           ############################
2024-04-19T08:08:34,836           # Package would be ignored #
2024-04-19T08:08:34,836           ############################
2024-04-19T08:08:34,837           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' as an importable package[^1],
2024-04-19T08:08:34,837           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,838           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,839           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' is explicitly added
2024-04-19T08:08:34,839           to the `packages` configuration field.

2024-04-19T08:08:34,840           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,841           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,841           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,843           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,844           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,845           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' to be distributed and are
2024-04-19T08:08:34,845           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo_new' via
2024-04-19T08:08:34,846           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,846           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,847           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,848           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,848           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,849           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,850                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,850                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,850                 directory, all directories are treated like packages.
2024-04-19T08:08:34,851           ********************************************************************************

2024-04-19T08:08:34,851   !!
2024-04-19T08:08:34,852     check.warn(importable)
2024-04-19T08:08:34,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-04-19T08:08:34,852   !!

2024-04-19T08:08:34,853           ********************************************************************************
2024-04-19T08:08:34,853           ############################
2024-04-19T08:08:34,854           # Package would be ignored #
2024-04-19T08:08:34,854           ############################
2024-04-19T08:08:34,855           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-04-19T08:08:34,855           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,856           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,857           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-04-19T08:08:34,857           to the `packages` configuration field.

2024-04-19T08:08:34,858           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,859           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,859           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,860           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,861           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,862           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-04-19T08:08:34,863           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-04-19T08:08:34,863           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,864           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,864           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,865           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,867           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,869           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,869                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,870                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,871                 directory, all directories are treated like packages.
2024-04-19T08:08:34,871           ********************************************************************************

2024-04-19T08:08:34,872   !!
2024-04-19T08:08:34,873     check.warn(importable)
2024-04-19T08:08:34,873   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-04-19T08:08:34,874   !!

2024-04-19T08:08:34,875           ********************************************************************************
2024-04-19T08:08:34,876           ############################
2024-04-19T08:08:34,876           # Package would be ignored #
2024-04-19T08:08:34,877           ############################
2024-04-19T08:08:34,877           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-04-19T08:08:34,877           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,878           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,878           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-04-19T08:08:34,879           to the `packages` configuration field.

2024-04-19T08:08:34,879           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,880           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,880           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,881           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,882           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,882           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-04-19T08:08:34,883           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-04-19T08:08:34,883           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,884           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,886           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,887           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,888           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,889                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,889                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,890                 directory, all directories are treated like packages.
2024-04-19T08:08:34,890           ********************************************************************************

2024-04-19T08:08:34,891   !!
2024-04-19T08:08:34,892     check.warn(importable)
2024-04-19T08:08:34,892   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-04-19T08:08:34,893   !!

2024-04-19T08:08:34,894           ********************************************************************************
2024-04-19T08:08:34,894           ############################
2024-04-19T08:08:34,895           # Package would be ignored #
2024-04-19T08:08:34,895           ############################
2024-04-19T08:08:34,896           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-04-19T08:08:34,896           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,897           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,898           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-04-19T08:08:34,898           to the `packages` configuration field.

2024-04-19T08:08:34,899           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,900           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,900           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,901           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,902           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,903           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-04-19T08:08:34,903           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-04-19T08:08:34,904           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,904           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,905           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,905           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,906           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,907           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,908                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,908                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,909                 directory, all directories are treated like packages.
2024-04-19T08:08:34,909           ********************************************************************************

2024-04-19T08:08:34,910   !!
2024-04-19T08:08:34,911     check.warn(importable)
2024-04-19T08:08:34,911   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-04-19T08:08:34,912   !!

2024-04-19T08:08:34,913           ********************************************************************************
2024-04-19T08:08:34,913           ############################
2024-04-19T08:08:34,913           # Package would be ignored #
2024-04-19T08:08:34,914           ############################
2024-04-19T08:08:34,914           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-04-19T08:08:34,915           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,916           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,916           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-04-19T08:08:34,917           to the `packages` configuration field.

2024-04-19T08:08:34,918           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,918           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,919           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,920           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,921           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,922           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-04-19T08:08:34,922           already explicitly excluding 'alpaca_eval.models_configs' via
2024-04-19T08:08:34,923           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,923           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,924           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,925           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,926           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,928           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,928                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,929                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,929                 directory, all directories are treated like packages.
2024-04-19T08:08:34,929           ********************************************************************************

2024-04-19T08:08:34,930   !!
2024-04-19T08:08:34,930     check.warn(importable)
2024-04-19T08:08:34,931   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-04-19T08:08:34,931   !!

2024-04-19T08:08:34,932           ********************************************************************************
2024-04-19T08:08:34,932           ############################
2024-04-19T08:08:34,933           # Package would be ignored #
2024-04-19T08:08:34,933           ############################
2024-04-19T08:08:34,933           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-04-19T08:08:34,934           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,935           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,935           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-04-19T08:08:34,935           to the `packages` configuration field.

2024-04-19T08:08:34,936           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,937           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,937           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,938           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,939           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,940           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-04-19T08:08:34,941           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-04-19T08:08:34,941           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,942           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,942           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,943           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,944           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,945           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,946                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,946                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,947                 directory, all directories are treated like packages.
2024-04-19T08:08:34,947           ********************************************************************************

2024-04-19T08:08:34,948   !!
2024-04-19T08:08:34,949     check.warn(importable)
2024-04-19T08:08:34,949   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-04-19T08:08:34,950   !!

2024-04-19T08:08:34,951           ********************************************************************************
2024-04-19T08:08:34,951           ############################
2024-04-19T08:08:34,952           # Package would be ignored #
2024-04-19T08:08:34,952           ############################
2024-04-19T08:08:34,953           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-04-19T08:08:34,953           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,955           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,955           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-04-19T08:08:34,955           to the `packages` configuration field.

2024-04-19T08:08:34,956           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,957           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,957           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,958           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,959           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,960           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-04-19T08:08:34,960           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-04-19T08:08:34,961           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,961           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,962           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,963           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,964           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,966           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,967                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,968                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,969                 directory, all directories are treated like packages.
2024-04-19T08:08:34,969           ********************************************************************************

2024-04-19T08:08:34,970   !!
2024-04-19T08:08:34,971     check.warn(importable)
2024-04-19T08:08:34,972   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-04-19T08:08:34,972   !!

2024-04-19T08:08:34,974           ********************************************************************************
2024-04-19T08:08:34,974           ############################
2024-04-19T08:08:34,975           # Package would be ignored #
2024-04-19T08:08:34,975           ############################
2024-04-19T08:08:34,976           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-04-19T08:08:34,976           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:34,978           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:34,978           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-04-19T08:08:34,979           to the `packages` configuration field.

2024-04-19T08:08:34,980           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:34,981           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:34,981           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:34,982           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:34,984           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:34,985           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-04-19T08:08:34,985           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-04-19T08:08:34,986           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:34,987           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:34,988           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:34,989           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:34,990           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:34,992           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:34,992                 even if it does not contain any `.py` files.
2024-04-19T08:08:34,992                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:34,993                 directory, all directories are treated like packages.
2024-04-19T08:08:34,994           ********************************************************************************

2024-04-19T08:08:34,995   !!
2024-04-19T08:08:34,995     check.warn(importable)
2024-04-19T08:08:34,996   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-04-19T08:08:34,996   !!

2024-04-19T08:08:34,997           ********************************************************************************
2024-04-19T08:08:34,998           ############################
2024-04-19T08:08:34,998           # Package would be ignored #
2024-04-19T08:08:34,999           ############################
2024-04-19T08:08:34,999           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-04-19T08:08:35,000           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,001           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,001           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-04-19T08:08:35,002           to the `packages` configuration field.

2024-04-19T08:08:35,003           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,004           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,004           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,005           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,007           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,008           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-04-19T08:08:35,008           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-04-19T08:08:35,009           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,010           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,010           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,011           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,012           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,014           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,015                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,015                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,016                 directory, all directories are treated like packages.
2024-04-19T08:08:35,016           ********************************************************************************

2024-04-19T08:08:35,018   !!
2024-04-19T08:08:35,018     check.warn(importable)
2024-04-19T08:08:35,019   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-04-19T08:08:35,020   !!

2024-04-19T08:08:35,021           ********************************************************************************
2024-04-19T08:08:35,021           ############################
2024-04-19T08:08:35,022           # Package would be ignored #
2024-04-19T08:08:35,023           ############################
2024-04-19T08:08:35,023           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-04-19T08:08:35,024           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,025           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,026           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-04-19T08:08:35,027           to the `packages` configuration field.

2024-04-19T08:08:35,028           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,029           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,030           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,031           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,032           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,033           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-04-19T08:08:35,033           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-04-19T08:08:35,034           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,034           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,035           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,036           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,037           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,038           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,039                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,039                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,040                 directory, all directories are treated like packages.
2024-04-19T08:08:35,041           ********************************************************************************

2024-04-19T08:08:35,042   !!
2024-04-19T08:08:35,042     check.warn(importable)
2024-04-19T08:08:35,043   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-04-19T08:08:35,044   !!

2024-04-19T08:08:35,045           ********************************************************************************
2024-04-19T08:08:35,045           ############################
2024-04-19T08:08:35,046           # Package would be ignored #
2024-04-19T08:08:35,046           ############################
2024-04-19T08:08:35,047           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-04-19T08:08:35,048           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,049           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,049           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-04-19T08:08:35,050           to the `packages` configuration field.

2024-04-19T08:08:35,051           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,052           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,052           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,054           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,054           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,055           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-04-19T08:08:35,056           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-04-19T08:08:35,056           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,057           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,058           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,059           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,060           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,062           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,063                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,063                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,064                 directory, all directories are treated like packages.
2024-04-19T08:08:35,064           ********************************************************************************

2024-04-19T08:08:35,066   !!
2024-04-19T08:08:35,066     check.warn(importable)
2024-04-19T08:08:35,067   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-04-19T08:08:35,068   !!

2024-04-19T08:08:35,069           ********************************************************************************
2024-04-19T08:08:35,070           ############################
2024-04-19T08:08:35,071           # Package would be ignored #
2024-04-19T08:08:35,072           ############################
2024-04-19T08:08:35,073           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-04-19T08:08:35,073           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,075           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,075           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-04-19T08:08:35,076           to the `packages` configuration field.

2024-04-19T08:08:35,077           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,078           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,078           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,079           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,081           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,082           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-04-19T08:08:35,082           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-04-19T08:08:35,083           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,083           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,084           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,085           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,086           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,088           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,088                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,089                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,090                 directory, all directories are treated like packages.
2024-04-19T08:08:35,090           ********************************************************************************

2024-04-19T08:08:35,091   !!
2024-04-19T08:08:35,091     check.warn(importable)
2024-04-19T08:08:35,092   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-04-19T08:08:35,092   !!

2024-04-19T08:08:35,093           ********************************************************************************
2024-04-19T08:08:35,094           ############################
2024-04-19T08:08:35,094           # Package would be ignored #
2024-04-19T08:08:35,095           ############################
2024-04-19T08:08:35,095           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-04-19T08:08:35,096           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,097           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,097           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-04-19T08:08:35,098           to the `packages` configuration field.

2024-04-19T08:08:35,099           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,099           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,100           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,101           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,102           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,103           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-04-19T08:08:35,103           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-04-19T08:08:35,104           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,104           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,105           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,106           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,107           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,109           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,110                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,110                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,111                 directory, all directories are treated like packages.
2024-04-19T08:08:35,111           ********************************************************************************

2024-04-19T08:08:35,112   !!
2024-04-19T08:08:35,113     check.warn(importable)
2024-04-19T08:08:35,113   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration.
2024-04-19T08:08:35,114   !!

2024-04-19T08:08:35,115           ********************************************************************************
2024-04-19T08:08:35,116           ############################
2024-04-19T08:08:35,116           # Package would be ignored #
2024-04-19T08:08:35,117           ############################
2024-04-19T08:08:35,117           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1],
2024-04-19T08:08:35,118           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,119           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,120           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added
2024-04-19T08:08:35,120           to the `packages` configuration field.

2024-04-19T08:08:35,121           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,122           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,123           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,123           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,124           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,125           If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are
2024-04-19T08:08:35,126           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via
2024-04-19T08:08:35,126           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,127           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,128           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,129           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,130           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,131           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,132                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,132                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,133                 directory, all directories are treated like packages.
2024-04-19T08:08:35,134           ********************************************************************************

2024-04-19T08:08:35,135   !!
2024-04-19T08:08:35,135     check.warn(importable)
2024-04-19T08:08:35,136   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration.
2024-04-19T08:08:35,136   !!

2024-04-19T08:08:35,138           ********************************************************************************
2024-04-19T08:08:35,138           ############################
2024-04-19T08:08:35,139           # Package would be ignored #
2024-04-19T08:08:35,139           ############################
2024-04-19T08:08:35,140           Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1],
2024-04-19T08:08:35,140           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,141           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,142           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added
2024-04-19T08:08:35,142           to the `packages` configuration field.

2024-04-19T08:08:35,144           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,144           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,145           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,146           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,147           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,148           If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are
2024-04-19T08:08:35,148           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via
2024-04-19T08:08:35,149           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,149           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,150           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,151           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,153           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,154           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,155                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,155                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,156                 directory, all directories are treated like packages.
2024-04-19T08:08:35,156           ********************************************************************************

2024-04-19T08:08:35,157   !!
2024-04-19T08:08:35,158     check.warn(importable)
2024-04-19T08:08:35,158   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-04-19T08:08:35,159   !!

2024-04-19T08:08:35,160           ********************************************************************************
2024-04-19T08:08:35,160           ############################
2024-04-19T08:08:35,161           # Package would be ignored #
2024-04-19T08:08:35,161           ############################
2024-04-19T08:08:35,162           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-04-19T08:08:35,162           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,164           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,164           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-04-19T08:08:35,165           to the `packages` configuration field.

2024-04-19T08:08:35,166           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,166           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,167           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,168           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,169           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,170           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-04-19T08:08:35,170           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-04-19T08:08:35,171           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,171           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,172           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,173           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,174           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,176           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,176                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,177                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,177                 directory, all directories are treated like packages.
2024-04-19T08:08:35,178           ********************************************************************************

2024-04-19T08:08:35,179   !!
2024-04-19T08:08:35,179     check.warn(importable)
2024-04-19T08:08:35,180   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration.
2024-04-19T08:08:35,181   !!

2024-04-19T08:08:35,182           ********************************************************************************
2024-04-19T08:08:35,182           ############################
2024-04-19T08:08:35,183           # Package would be ignored #
2024-04-19T08:08:35,183           ############################
2024-04-19T08:08:35,183           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1],
2024-04-19T08:08:35,184           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,185           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,185           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added
2024-04-19T08:08:35,186           to the `packages` configuration field.

2024-04-19T08:08:35,187           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,187           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,188           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,189           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,190           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,191           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are
2024-04-19T08:08:35,191           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via
2024-04-19T08:08:35,192           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,193           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,193           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,194           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,195           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,197           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,197                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,198                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,199                 directory, all directories are treated like packages.
2024-04-19T08:08:35,199           ********************************************************************************

2024-04-19T08:08:35,200   !!
2024-04-19T08:08:35,201     check.warn(importable)
2024-04-19T08:08:35,201   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration.
2024-04-19T08:08:35,202   !!

2024-04-19T08:08:35,203           ********************************************************************************
2024-04-19T08:08:35,204           ############################
2024-04-19T08:08:35,204           # Package would be ignored #
2024-04-19T08:08:35,205           ############################
2024-04-19T08:08:35,205           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1],
2024-04-19T08:08:35,206           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,207           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,208           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added
2024-04-19T08:08:35,208           to the `packages` configuration field.

2024-04-19T08:08:35,210           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,210           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,211           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,212           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,213           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,214           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are
2024-04-19T08:08:35,214           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via
2024-04-19T08:08:35,215           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,215           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,215           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,216           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,217           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,219           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,219                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,220                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,220                 directory, all directories are treated like packages.
2024-04-19T08:08:35,220           ********************************************************************************

2024-04-19T08:08:35,221   !!
2024-04-19T08:08:35,222     check.warn(importable)
2024-04-19T08:08:35,222   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration.
2024-04-19T08:08:35,223   !!

2024-04-19T08:08:35,224           ********************************************************************************
2024-04-19T08:08:35,225           ############################
2024-04-19T08:08:35,225           # Package would be ignored #
2024-04-19T08:08:35,226           ############################
2024-04-19T08:08:35,227           Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1],
2024-04-19T08:08:35,227           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,228           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,229           package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added
2024-04-19T08:08:35,229           to the `packages` configuration field.

2024-04-19T08:08:35,231           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,231           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,232           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,233           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,234           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,235           If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are
2024-04-19T08:08:35,235           already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via
2024-04-19T08:08:35,236           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,237           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,237           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,238           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,240           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,241           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,242                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,242                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,243                 directory, all directories are treated like packages.
2024-04-19T08:08:35,243           ********************************************************************************

2024-04-19T08:08:35,244   !!
2024-04-19T08:08:35,245     check.warn(importable)
2024-04-19T08:08:35,246   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-04-19T08:08:35,246   !!

2024-04-19T08:08:35,247           ********************************************************************************
2024-04-19T08:08:35,248           ############################
2024-04-19T08:08:35,248           # Package would be ignored #
2024-04-19T08:08:35,249           ############################
2024-04-19T08:08:35,249           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-04-19T08:08:35,250           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,251           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,251           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-04-19T08:08:35,252           to the `packages` configuration field.

2024-04-19T08:08:35,253           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,253           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,254           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,255           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,256           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,257           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-04-19T08:08:35,258           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-04-19T08:08:35,259           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,259           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,260           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,261           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,262           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,263           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,264                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,265                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,265                 directory, all directories are treated like packages.
2024-04-19T08:08:35,266           ********************************************************************************

2024-04-19T08:08:35,267   !!
2024-04-19T08:08:35,267     check.warn(importable)
2024-04-19T08:08:35,268   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-04-19T08:08:35,268   !!

2024-04-19T08:08:35,270           ********************************************************************************
2024-04-19T08:08:35,270           ############################
2024-04-19T08:08:35,271           # Package would be ignored #
2024-04-19T08:08:35,272           ############################
2024-04-19T08:08:35,272           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-04-19T08:08:35,273           but it is absent from setuptools' `packages` configuration.

2024-04-19T08:08:35,274           This leads to an ambiguous overall configuration. If you want to distribute this
2024-04-19T08:08:35,275           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-04-19T08:08:35,275           to the `packages` configuration field.

2024-04-19T08:08:35,276           Alternatively, you can also rely on setuptools' discovery methods
2024-04-19T08:08:35,277           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-04-19T08:08:35,277           instead of `find_packages(...)`/`find:`).

2024-04-19T08:08:35,279           You can read more about "package discovery" on setuptools documentation page:

2024-04-19T08:08:35,280           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-04-19T08:08:35,280           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-04-19T08:08:35,281           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-04-19T08:08:35,281           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-04-19T08:08:35,282           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-04-19T08:08:35,283           combination with a more fine grained `package-data` configuration.

2024-04-19T08:08:35,284           You can read more about "package data files" on setuptools documentation page:

2024-04-19T08:08:35,285           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-04-19T08:08:35,287           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-04-19T08:08:35,287                 even if it does not contain any `.py` files.
2024-04-19T08:08:35,288                 On the other hand, currently there is no concept of package data
2024-04-19T08:08:35,288                 directory, all directories are treated like packages.
2024-04-19T08:08:35,289           ********************************************************************************

2024-04-19T08:08:35,290   !!
2024-04-19T08:08:35,290     check.warn(importable)
2024-04-19T08:08:35,291   creating build/lib/alpaca_eval/evaluators_configs
2024-04-19T08:08:35,292   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-04-19T08:08:35,292   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:35,293   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:35,293   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:35,294   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,294   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,295   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,295   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:35,296   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:35,297   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:35,297   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:35,298   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:35,298   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:35,299   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-19T08:08:35,299   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-19T08:08:35,300   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-19T08:08:35,300   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-19T08:08:35,301   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:35,301   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:35,302   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:35,302   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,303   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,303   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,304   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,304   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,305   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,305   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,306   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,307   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,307   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,308   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,308   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,309   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,309   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,310   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,310   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,311   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:35,312   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,312   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,313   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,313   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:35,314   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:35,314   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:35,315   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-19T08:08:35,315   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-19T08:08:35,315   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-19T08:08:35,316   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-19T08:08:35,316   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,317   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,317   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,318   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:35,318   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:35,319   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:35,319   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:35,320   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:35,321   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:35,321   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-04-19T08:08:35,322   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-04-19T08:08:35,322   creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:35,323   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:35,323   copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:35,324   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,324   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,325   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,325   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-04-19T08:08:35,326   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-04-19T08:08:35,327   creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,327   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,328   copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,328   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,329   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,329   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-04-19T08:08:35,330   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-04-19T08:08:35,331   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-19T08:08:35,331   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-19T08:08:35,332   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:35,332   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:35,333   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:35,333   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,334   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,334   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,335   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-19T08:08:35,335   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-19T08:08:35,336   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-19T08:08:35,336   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-19T08:08:35,337   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:35,337   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:35,338   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:35,338   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-19T08:08:35,339   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-19T08:08:35,340   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-19T08:08:35,340   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-19T08:08:35,341   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:35,341   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:35,342   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:35,343   creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-19T08:08:35,343   copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-19T08:08:35,344   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:35,344   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:35,345   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:35,345   creating build/lib/alpaca_eval/evaluators_configs/test
2024-04-19T08:08:35,346   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-04-19T08:08:35,346   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:35,347   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:35,348   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:35,348   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-19T08:08:35,349   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-19T08:08:35,349   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-19T08:08:35,350   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-19T08:08:35,350   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-04-19T08:08:35,351   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-04-19T08:08:35,351   creating build/lib/alpaca_eval/leaderboards
2024-04-19T08:08:35,352   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:35,352   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:35,353   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:35,353   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:35,354   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:35,354   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,355   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,355   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,356   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,356   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,357   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:35,358   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-04-19T08:08:35,358   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-04-19T08:08:35,359   creating build/lib/alpaca_eval/models_configs
2024-04-19T08:08:35,359   creating build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:35,360   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:35,360   copying src/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:35,361   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:35,362   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:35,362   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:35,363   creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:35,363   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:35,364   copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:35,364   creating build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:35,365   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:35,365   copying src/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:35,366   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:35,366   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:35,367   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:35,367   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-04-19T08:08:35,368   copying src/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-04-19T08:08:35,368   creating build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-04-19T08:08:35,369   copying src/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-04-19T08:08:35,369   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-19T08:08:35,370   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-19T08:08:35,370   creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:35,371   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:35,372   copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:35,372   creating build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-04-19T08:08:35,373   copying src/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-04-19T08:08:35,373   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:35,374   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:35,375   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:35,375   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:35,376   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:35,376   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:35,377   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:35,378   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:35,378   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:35,378   creating build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:35,379   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:35,380   copying src/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:35,380   creating build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:35,381   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:35,381   copying src/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:35,381   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:35,382   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:35,383   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:35,383   creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:35,384   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:35,384   copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:35,385   creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:35,385   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:35,386   copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:35,386   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:35,387   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:35,388   copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:35,388   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-19T08:08:35,389   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-19T08:08:35,389   creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-19T08:08:35,390   copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-19T08:08:35,390   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:35,391   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:35,392   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:35,392   creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:35,393   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:35,393   copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:35,394   creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:35,394   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:35,395   copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:35,395   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-19T08:08:35,396   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-19T08:08:35,396   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:35,397   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:35,397   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:35,398   creating build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:35,398   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:35,399   copying src/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:35,399   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:35,400   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:35,400   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:35,401   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:35,401   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:35,402   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:35,402   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:35,403   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:35,403   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:35,404   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-04-19T08:08:35,405   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-04-19T08:08:35,405   creating build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:35,406   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:35,406   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:35,407   copying src/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:35,408   creating build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:35,409   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:35,410   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:35,410   copying src/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:35,410   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:35,411   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:35,411   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:35,412   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:35,412   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:35,413   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:35,413   creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-19T08:08:35,414   copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-19T08:08:35,414   creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-19T08:08:35,415   copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-19T08:08:35,415   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-19T08:08:35,415   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-19T08:08:35,416   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-19T08:08:35,416   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-19T08:08:35,417   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:35,417   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:35,418   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:35,418   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:35,419   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:35,419   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:35,420   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-04-19T08:08:35,420   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-04-19T08:08:35,421   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-04-19T08:08:35,422   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-04-19T08:08:35,422   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-04-19T08:08:35,423   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-04-19T08:08:35,423   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:35,424   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:35,424   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:35,425   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:35,425   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:35,426   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:35,426   creating build/lib/alpaca_eval/models_configs/claude
2024-04-19T08:08:35,427   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-04-19T08:08:35,427   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-04-19T08:08:35,428   creating build/lib/alpaca_eval/models_configs/claude-2
2024-04-19T08:08:35,428   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-04-19T08:08:35,429   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-04-19T08:08:35,429   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-04-19T08:08:35,430   creating build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:35,430   copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:35,431   copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:35,431   creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:35,432   copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:35,432   copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:35,433   creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-19T08:08:35,433   copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-19T08:08:35,434   creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:35,434   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:35,435   copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:35,435   creating build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-04-19T08:08:35,436   copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2
2024-04-19T08:08:35,436   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-19T08:08:35,437   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-19T08:08:35,437   creating build/lib/alpaca_eval/models_configs/cohere
2024-04-19T08:08:35,438   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-04-19T08:08:35,438   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-04-19T08:08:35,439   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:35,439   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:35,440   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:35,440   creating build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-04-19T08:08:35,441   copying src/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/dbrx-instruct
2024-04-19T08:08:35,443   creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:35,444   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:35,446   copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:35,448   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-19T08:08:35,449   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-19T08:08:35,451   creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-19T08:08:35,451   copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-19T08:08:35,453   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-04-19T08:08:35,454   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-04-19T08:08:35,456   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-04-19T08:08:35,457   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-04-19T08:08:35,459   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-19T08:08:35,459   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-19T08:08:35,461   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-19T08:08:35,462   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-19T08:08:35,464   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:35,465   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:35,467   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:35,469   creating build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-04-19T08:08:35,470   copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it
2024-04-19T08:08:35,472   creating build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-04-19T08:08:35,473   copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it
2024-04-19T08:08:35,475   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-19T08:08:35,476   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-19T08:08:35,478   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-19T08:08:35,479   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-19T08:08:35,481   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-19T08:08:35,482   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-19T08:08:35,485   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-19T08:08:35,486   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-19T08:08:35,488   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-19T08:08:35,489   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-19T08:08:35,491   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-19T08:08:35,492   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-19T08:08:35,494   creating build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-19T08:08:35,495   copying src/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-19T08:08:35,496   creating build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-19T08:08:35,497   copying src/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-19T08:08:35,499   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,500   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,502   creating build/lib/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:35,503   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:35,505   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:35,506   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-04-19T08:08:35,507   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-04-19T08:08:35,509   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-04-19T08:08:35,510   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-04-19T08:08:35,512   creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-19T08:08:35,513   copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-19T08:08:35,515   creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-19T08:08:35,516   copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-19T08:08:35,518   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:35,518   copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:35,520   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:35,522   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:35,523   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:35,525   copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:35,527   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:35,528   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:35,530   copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:35,532   creating build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-04-19T08:08:35,533   copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed
2024-04-19T08:08:35,535   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-04-19T08:08:35,536   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-04-19T08:08:35,538   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-04-19T08:08:35,539   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-04-19T08:08:35,541   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-04-19T08:08:35,541   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-04-19T08:08:35,543   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-04-19T08:08:35,544   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-04-19T08:08:35,546   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:35,547   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:35,549   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:35,551   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:35,552   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:35,554   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:35,556   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-19T08:08:35,556   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-19T08:08:35,558   creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:35,559   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:35,561   copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:35,563   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:35,564   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:35,566   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:35,568   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-19T08:08:35,569   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-19T08:08:35,571   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:35,571   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:35,573   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:35,575   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:35,576   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:35,578   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:35,580   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:35,581   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:35,583   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:35,585   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-19T08:08:35,586   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-19T08:08:35,588   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:35,589   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:35,591   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:35,593   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:35,594   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:35,596   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:35,598   creating build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-04-19T08:08:35,598   copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402
2024-04-19T08:08:35,600   creating build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:35,601   copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:35,603   copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:35,605   creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:35,606   copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:35,608   copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:35,610   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:35,611   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:35,613   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:35,615   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-19T08:08:35,616   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-19T08:08:35,618   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:35,619   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:35,621   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:35,623   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:35,624   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:35,626   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:35,628   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:35,629   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:35,632   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:35,633   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:35,634   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:35,637   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:35,639   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:35,640   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:35,642   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:35,644   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:35,645   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:35,647   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:35,649   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:35,650   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:35,652   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:35,654   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:35,654   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:35,656   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:35,658   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:35,659   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:35,661   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:35,663   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-04-19T08:08:35,664   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-04-19T08:08:35,666   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-19T08:08:35,667   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-19T08:08:35,669   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-19T08:08:35,671   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-19T08:08:35,673   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-04-19T08:08:35,674   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-04-19T08:08:35,676   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-04-19T08:08:35,677   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-04-19T08:08:35,679   creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-19T08:08:35,680   copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-19T08:08:35,682   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-19T08:08:35,683   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-19T08:08:35,685   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:35,686   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:35,688   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:35,690   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-19T08:08:35,691   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-19T08:08:35,693   creating build/lib/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:35,694   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:35,696   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:35,697   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:35,698   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:35,700   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:35,702   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:35,703   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:35,705   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:35,707   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:35,708   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:35,710   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:35,712   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-19T08:08:35,712   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-19T08:08:35,715   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-19T08:08:35,716   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-19T08:08:35,718   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-19T08:08:35,719   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-19T08:08:35,721   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-04-19T08:08:35,722   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-04-19T08:08:35,724   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:35,725   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:35,727   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:35,729   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-19T08:08:35,730   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-19T08:08:35,732   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:35,733   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:35,735   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:35,737   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-19T08:08:35,738   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-19T08:08:35,740   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:35,741   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:35,743   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:35,745   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:35,746   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:35,748   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:35,750   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:35,751   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:35,753   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:35,755   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:35,756   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:35,758   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:35,760   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-04-19T08:08:35,761   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-04-19T08:08:35,763   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-19T08:08:35,764   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-19T08:08:35,766   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-19T08:08:35,767   copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-19T08:08:35,769   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-19T08:08:35,770   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-19T08:08:35,772   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:35,773   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:35,775   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:35,777   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-19T08:08:35,778   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-19T08:08:35,780   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-19T08:08:35,781   copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-19T08:08:35,783   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:35,784   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:35,786   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:35,788   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-19T08:08:35,789   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-19T08:08:35,792   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-19T08:08:35,792   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-19T08:08:35,795   creating build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-04-19T08:08:35,796   copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b
2024-04-19T08:08:35,798   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-19T08:08:35,799   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-19T08:08:35,801   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-19T08:08:35,802   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-19T08:08:35,804   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-19T08:08:35,805   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-19T08:08:35,807   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:35,808   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:35,810   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:35,812   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:35,812   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:35,815   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:35,817   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-19T08:08:35,818   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-19T08:08:35,847   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-04-19T08:08:35,847   !!

2024-04-19T08:08:35,849           ********************************************************************************
2024-04-19T08:08:35,849           Please avoid running ``setup.py`` directly.
2024-04-19T08:08:35,850           Instead, use pypa/build, pypa/installer or other
2024-04-19T08:08:35,850           standards-based tools.

2024-04-19T08:08:35,852           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-04-19T08:08:35,852           ********************************************************************************

2024-04-19T08:08:35,853   !!
2024-04-19T08:08:35,854     self.initialize_options()
2024-04-19T08:08:35,874   installing to build/bdist.linux-armv7l/wheel
2024-04-19T08:08:35,874   running install
2024-04-19T08:08:35,898   running install_lib
2024-04-19T08:08:35,924   creating build/bdist.linux-armv7l
2024-04-19T08:08:35,924   creating build/bdist.linux-armv7l/wheel
2024-04-19T08:08:35,926   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:35,927   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:35,931   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-04-19T08:08:35,932   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-19T08:08:35,933   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-04-19T08:08:35,936   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,937   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,939   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-04-19T08:08:35,941   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,942   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,944   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-04-19T08:08:35,946   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-19T08:08:35,947   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-04-19T08:08:35,949   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,950   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,952   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-04-19T08:08:35,954   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-04-19T08:08:35,955   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-04-19T08:08:35,957   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-04-19T08:08:35,958   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-04-19T08:08:35,961   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,961   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,963   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-04-19T08:08:35,966   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,967   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,969   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-04-19T08:08:35,971   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,972   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,974   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-04-19T08:08:35,977   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,978   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,980   copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking
2024-04-19T08:08:35,982   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-19T08:08:35,983   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-04-19T08:08:35,985   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-19T08:08:35,986   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-04-19T08:08:35,989   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-19T08:08:35,989   copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking
2024-04-19T08:08:35,992   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,992   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-04-19T08:08:35,995   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-19T08:08:35,996   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-04-19T08:08:35,998   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:35,999   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:36,001   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-04-19T08:08:36,003   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-19T08:08:36,004   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-04-19T08:08:36,007   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:36,008   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:36,010   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-04-19T08:08:36,012   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-04-19T08:08:36,013   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new
2024-04-19T08:08:36,016   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-19T08:08:36,016   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-04-19T08:08:36,019   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:36,020   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:36,022   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-04-19T08:08:36,024   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,026   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,028   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,029   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,031   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,033   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,035   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,037   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,040   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,042   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,044   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,046   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,048   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,050   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-04-19T08:08:36,053   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-19T08:08:36,054   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-04-19T08:08:36,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-04-19T08:08:36,057   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-04-19T08:08:36,059   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-19T08:08:36,060   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-04-19T08:08:36,062   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:36,063   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:36,065   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-04-19T08:08:36,067   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:36,068   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:36,070   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-04-19T08:08:36,072   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:36,073   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:36,075   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-04-19T08:08:36,077   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:36,078   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:36,080   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-04-19T08:08:36,082   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-19T08:08:36,083   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-04-19T08:08:36,085   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-04-19T08:08:36,087   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:36,088   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:36,090   copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking
2024-04-19T08:08:36,092   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-04-19T08:08:36,093   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-04-19T08:08:36,096   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:36,097   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:36,099   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-04-19T08:08:36,101   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:36,102   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:36,104   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-04-19T08:08:36,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:36,107   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:36,109   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-04-19T08:08:36,111   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-19T08:08:36,112   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-04-19T08:08:36,114   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:36,115   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:36,116   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-04-19T08:08:36,119   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:36,119   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:36,121   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-04-19T08:08:36,123   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,125   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-04-19T08:08:36,126   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,127   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,130   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,131   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,133   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,135   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-04-19T08:08:36,137   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:36,138   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:36,140   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:36,142   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:36,144   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-04-19T08:08:36,147   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-04-19T08:08:36,148   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-04-19T08:08:36,150   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,153   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,156   creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-19T08:08:36,157   copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-19T08:08:36,159   copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-19T08:08:36,161   copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-19T08:08:36,163   copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics
2024-04-19T08:08:36,165   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,168   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,170   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,173   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,175   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,176   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,178   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,180   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,183   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,185   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,187   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,189   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,191   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,194   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,195   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,197   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-04-19T08:08:36,200   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-19T08:08:36,200   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-19T08:08:36,203   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-19T08:08:36,206   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-04-19T08:08:36,208   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-04-19T08:08:36,213   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-04-19T08:08:36,215   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-04-19T08:08:36,216   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-04-19T08:08:36,218   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-04-19T08:08:36,219   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-04-19T08:08:36,222   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-04-19T08:08:36,223   copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it
2024-04-19T08:08:36,225   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:36,227   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:36,229   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-04-19T08:08:36,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-19T08:08:36,232   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16
2024-04-19T08:08:36,234   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-19T08:08:36,235   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5
2024-04-19T08:08:36,237   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:36,238   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:36,240   copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha
2024-04-19T08:08:36,242   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:36,243   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:36,245   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-04-19T08:08:36,247   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-04-19T08:08:36,248   copying build/lib/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1
2024-04-19T08:08:36,250   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:36,251   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:36,253   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-04-19T08:08:36,255   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:36,256   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:36,258   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-04-19T08:08:36,260   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-04-19T08:08:36,261   copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed
2024-04-19T08:08:36,264   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:36,265   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:36,267   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-04-19T08:08:36,270   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-04-19T08:08:36,271   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-04-19T08:08:36,274   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-19T08:08:36,275   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613
2024-04-19T08:08:36,277   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-19T08:08:36,278   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-04-19T08:08:36,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:36,281   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:36,283   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-04-19T08:08:36,285   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-04-19T08:08:36,286   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-04-19T08:08:36,288   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-04-19T08:08:36,289   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-04-19T08:08:36,291   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-19T08:08:36,292   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-04-19T08:08:36,295   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:36,296   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:36,297   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise
2024-04-19T08:08:36,300   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:36,300   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:36,302   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-04-19T08:08:36,304   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:36,305   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:36,307   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-04-19T08:08:36,309   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-04-19T08:08:36,310   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-04-19T08:08:36,313   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:36,314   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:36,316   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-04-19T08:08:36,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:36,319   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:36,321   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-04-19T08:08:36,323   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:36,324   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:36,326   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-04-19T08:08:36,328   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-19T08:08:36,329   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3
2024-04-19T08:08:36,331   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-19T08:08:36,332   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-04-19T08:08:36,334   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-19T08:08:36,335   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-04-19T08:08:36,337   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:36,338   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:36,340   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-04-19T08:08:36,342   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:36,343   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:36,344   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-04-19T08:08:36,347   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:36,348   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:36,349   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-04-19T08:08:36,352   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-19T08:08:36,352   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-04-19T08:08:36,355   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:36,356   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:36,358   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-04-19T08:08:36,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-04-19T08:08:36,361   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-04-19T08:08:36,363   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-04-19T08:08:36,364   copying build/lib/alpaca_eval/models_configs/dbrx-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dbrx-instruct
2024-04-19T08:08:36,366   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-04-19T08:08:36,367   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-04-19T08:08:36,369   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:36,370   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:36,372   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-04-19T08:08:36,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:36,375   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:36,376   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-04-19T08:08:36,379   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:36,379   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:36,381   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified
2024-04-19T08:08:36,383   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-19T08:08:36,384   copying build/lib/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-turbo-2024-04-09
2024-04-19T08:08:36,386   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-19T08:08:36,387   copying build/lib/alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-4-0125-preview
2024-04-19T08:08:36,389   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:36,390   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:36,392   copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM
2024-04-19T08:08:36,394   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-19T08:08:36,395   copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229
2024-04-19T08:08:36,397   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:36,398   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:36,400   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1
2024-04-19T08:08:36,402   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:36,403   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:36,405   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-04-19T08:08:36,407   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-19T08:08:36,408   copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise
2024-04-19T08:08:36,410   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:36,411   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:36,413   copying build/lib/alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Ein-70B-v0.1
2024-04-19T08:08:36,415   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:36,415   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:36,417   copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta
2024-04-19T08:08:36,419   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-04-19T08:08:36,420   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-04-19T08:08:36,422   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-19T08:08:36,423   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose
2024-04-19T08:08:36,425   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-19T08:08:36,426   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-04-19T08:08:36,429   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-19T08:08:36,430   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-04-19T08:08:36,433   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-19T08:08:36,434   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-04-19T08:08:36,436   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:36,438   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:36,440   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-04-19T08:08:36,442   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:36,443   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:36,445   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-04-19T08:08:36,447   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-19T08:08:36,448   copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat
2024-04-19T08:08:36,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:36,451   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:36,453   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-04-19T08:08:36,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:36,456   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:36,457   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-04-19T08:08:36,459   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-19T08:08:36,460   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-04-19T08:08:36,462   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-19T08:08:36,463   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-04-19T08:08:36,465   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:36,466   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:36,468   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-04-19T08:08:36,470   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-19T08:08:36,471   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-04-19T08:08:36,473   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-19T08:08:36,474   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-04-19T08:08:36,476   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:36,477   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:36,479   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-04-19T08:08:36,481   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-19T08:08:36,482   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-04-19T08:08:36,485   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-19T08:08:36,486   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-04-19T08:08:36,488   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:36,489   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:36,491   copying build/lib/alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Conifer-7B-DPO
2024-04-19T08:08:36,493   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-19T08:08:36,494   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-04-19T08:08:36,496   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-04-19T08:08:36,497   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-04-19T08:08:36,499   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-04-19T08:08:36,500   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-04-19T08:08:36,502   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:36,503   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:36,504   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-04-19T08:08:36,507   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-19T08:08:36,508   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-04-19T08:08:36,510   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-19T08:08:36,511   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-04-19T08:08:36,513   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:36,514   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:36,516   copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo
2024-04-19T08:08:36,518   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:36,519   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:36,521   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-04-19T08:08:36,523   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:36,524   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:36,526   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1
2024-04-19T08:08:36,528   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:36,529   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:36,531   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-04-19T08:08:36,533   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-19T08:08:36,534   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-04-19T08:08:36,536   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-19T08:08:36,537   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise
2024-04-19T08:08:36,539   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:36,540   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:36,542   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-04-19T08:08:36,544   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-19T08:08:36,545   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-04-19T08:08:36,547   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-19T08:08:36,548   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-19T08:08:36,550   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-04-19T08:08:36,552   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-04-19T08:08:36,553   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-04-19T08:08:36,555   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-19T08:08:36,556   copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b
2024-04-19T08:08:36,558   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:36,559   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:36,561   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-04-19T08:08:36,563   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:36,564   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:36,566   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1
2024-04-19T08:08:36,568   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-19T08:08:36,569   copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose
2024-04-19T08:08:36,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:36,572   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:36,574   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-04-19T08:08:36,576   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:36,577   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:36,579   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-04-19T08:08:36,581   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-19T08:08:36,582   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-04-19T08:08:36,584   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-19T08:08:36,585   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-04-19T08:08:36,588   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-19T08:08:36,588   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-04-19T08:08:36,591   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-04-19T08:08:36,591   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-04-19T08:08:36,594   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:36,595   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:36,596   copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229
2024-04-19T08:08:36,599   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:36,600   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:36,602   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-04-19T08:08:36,604   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:36,605   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:36,606   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose
2024-04-19T08:08:36,609   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-04-19T08:08:36,610   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-04-19T08:08:36,612   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-19T08:08:36,613   copying build/lib/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1
2024-04-19T08:08:36,615   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-04-19T08:08:36,616   copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2
2024-04-19T08:08:36,619   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:36,620   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:36,621   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-04-19T08:08:36,624   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:36,624   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:36,626   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:36,628   copying build/lib/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229
2024-04-19T08:08:36,630   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:36,631   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:36,633   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16
2024-04-19T08:08:36,635   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-19T08:08:36,636   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-04-19T08:08:36,638   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:36,639   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:36,641   copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat
2024-04-19T08:08:36,643   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:36,644   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:36,646   copying build/lib/alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige2-8B-Chat
2024-04-19T08:08:36,648   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:36,649   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:36,651   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-04-19T08:08:36,653   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-04-19T08:08:36,654   copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it
2024-04-19T08:08:36,656   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-19T08:08:36,657   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-04-19T08:08:36,660   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:36,661   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:36,663   copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise
2024-04-19T08:08:36,664   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-19T08:08:36,665   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5
2024-04-19T08:08:36,668   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:36,669   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:36,671   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-04-19T08:08:36,673   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:36,674   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:36,675   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-04-19T08:08:36,677   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:36,678   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:36,680   copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat
2024-04-19T08:08:36,682   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-04-19T08:08:36,683   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-04-19T08:08:36,685   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:36,686   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:36,688   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-04-19T08:08:36,690   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:36,691   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:36,693   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-04-19T08:08:36,695   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-19T08:08:36,696   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-04-19T08:08:36,698   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-19T08:08:36,699   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-04-19T08:08:36,701   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-19T08:08:36,702   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-04-19T08:08:36,704   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-19T08:08:36,705   copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose
2024-04-19T08:08:36,707   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-19T08:08:36,708   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-04-19T08:08:36,710   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:36,711   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:36,713   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-04-19T08:08:36,715   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:36,716   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:36,718   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-04-19T08:08:36,720   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:36,721   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:36,723   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-04-19T08:08:36,725   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:36,726   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:36,728   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-04-19T08:08:36,730   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-19T08:08:36,731   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-04-19T08:08:36,733   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-19T08:08:36,734   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-04-19T08:08:36,736   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-04-19T08:08:36,737   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct
2024-04-19T08:08:36,739   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:36,740   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:36,742   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:36,744   copying build/lib/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat
2024-04-19T08:08:36,746   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-04-19T08:08:36,747   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-04-19T08:08:36,749   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-04-19T08:08:36,750   copying build/lib/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct
2024-04-19T08:08:36,752   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-04-19T08:08:36,753   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-04-19T08:08:36,755   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:36,756   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:36,758   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-04-19T08:08:36,760   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:36,761   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:36,763   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-04-19T08:08:36,765   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-04-19T08:08:36,766   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-04-19T08:08:36,768   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:36,769   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:36,771   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-04-19T08:08:36,773   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-04-19T08:08:36,774   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-04-19T08:08:36,776   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-04-19T08:08:36,777   copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b
2024-04-19T08:08:36,779   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:36,780   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:36,782   copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose
2024-04-19T08:08:36,785   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:36,786   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:36,788   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise
2024-04-19T08:08:36,790   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:36,791   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:36,792   copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO
2024-04-19T08:08:36,795   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:36,795   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:36,797   copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat
2024-04-19T08:08:36,799   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:36,800   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:36,802   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-04-19T08:08:36,804   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:36,805   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:36,807   copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1
2024-04-19T08:08:36,809   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:36,810   copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:36,812   copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium
2024-04-19T08:08:36,814   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:36,815   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:36,817   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-04-19T08:08:36,819   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-19T08:08:36,820   copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2
2024-04-19T08:08:36,822   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-04-19T08:08:36,823   copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402
2024-04-19T08:08:36,825   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:36,826   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:36,828   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose
2024-04-19T08:08:36,831   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-19T08:08:36,831   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-04-19T08:08:36,834   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-19T08:08:36,834   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-19T08:08:36,836   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-04-19T08:08:36,838   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:36,839   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:36,841   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-04-19T08:08:36,843   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-19T08:08:36,843   copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise
2024-04-19T08:08:36,846   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:36,847   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:36,848   copying build/lib/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1
2024-04-19T08:08:36,851   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:36,851   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:36,853   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-04-19T08:08:36,855   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-19T08:08:36,856   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-04-19T08:08:36,858   running install_egg_info
2024-04-19T08:08:36,888   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.2-py3.11.egg-info
2024-04-19T08:08:36,902   running install_scripts
2024-04-19T08:08:36,942   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.2.dist-info/WHEEL
2024-04-19T08:08:36,945   creating '/tmp/pip-wheel-zjr0uc2t/alpaca_eval-0.6.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-04-19T08:08:36,947   adding 'alpaca_eval/__init__.py'
2024-04-19T08:08:36,950   adding 'alpaca_eval/analyze.py'
2024-04-19T08:08:36,953   adding 'alpaca_eval/completion_parsers.py'
2024-04-19T08:08:36,955   adding 'alpaca_eval/constants.py'
2024-04-19T08:08:36,959   adding 'alpaca_eval/main.py'
2024-04-19T08:08:36,962   adding 'alpaca_eval/plotting.py'
2024-04-19T08:08:36,965   adding 'alpaca_eval/processors.py'
2024-04-19T08:08:36,966   adding 'alpaca_eval/types.py'
2024-04-19T08:08:36,969   adding 'alpaca_eval/utils.py'
2024-04-19T08:08:36,971   adding 'alpaca_eval/annotators/__init__.py'
2024-04-19T08:08:36,976   adding 'alpaca_eval/annotators/base.py'
2024-04-19T08:08:36,978   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-04-19T08:08:36,980   adding 'alpaca_eval/decoders/__init__.py'
2024-04-19T08:08:36,982   adding 'alpaca_eval/decoders/anthropic.py'
2024-04-19T08:08:36,983   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-04-19T08:08:36,985   adding 'alpaca_eval/decoders/cohere.py'
2024-04-19T08:08:36,986   adding 'alpaca_eval/decoders/google.py'
2024-04-19T08:08:36,988   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-04-19T08:08:36,989   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-04-19T08:08:36,991   adding 'alpaca_eval/decoders/jinachat.py'
2024-04-19T08:08:36,993   adding 'alpaca_eval/decoders/openai.py'
2024-04-19T08:08:36,995   adding 'alpaca_eval/decoders/replicate.py'
2024-04-19T08:08:36,996   adding 'alpaca_eval/decoders/vllm_local.py'
2024-04-19T08:08:36,999   adding 'alpaca_eval/evaluators_configs/README.md'
2024-04-19T08:08:37,000   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-04-19T08:08:37,002   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-04-19T08:08:37,003   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-04-19T08:08:37,005   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-04-19T08:08:37,006   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-04-19T08:08:37,008   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-04-19T08:08:37,009   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-04-19T08:08:37,010   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-04-19T08:08:37,012   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-04-19T08:08:37,014   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-04-19T08:08:37,015   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-04-19T08:08:37,017   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-04-19T08:08:37,019   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-04-19T08:08:37,020   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-04-19T08:08:37,022   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-04-19T08:08:37,024   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-04-19T08:08:37,025   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-04-19T08:08:37,027   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-04-19T08:08:37,028   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-04-19T08:08:37,030   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-04-19T08:08:37,032   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-04-19T08:08:37,033   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-04-19T08:08:37,035   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-04-19T08:08:37,036   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-04-19T08:08:37,038   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-04-19T08:08:37,040   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-04-19T08:08:37,041   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-04-19T08:08:37,044   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-04-19T08:08:37,045   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-04-19T08:08:37,047   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-04-19T08:08:37,048   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-04-19T08:08:37,050   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-04-19T08:08:37,052   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-04-19T08:08:37,053   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-04-19T08:08:37,054   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-04-19T08:08:37,056   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-04-19T08:08:37,057   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-04-19T08:08:37,059   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-04-19T08:08:37,060   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-04-19T08:08:37,062   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-04-19T08:08:37,064   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml'
2024-04-19T08:08:37,065   adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt'
2024-04-19T08:08:37,066   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-04-19T08:08:37,068   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-04-19T08:08:37,069   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-04-19T08:08:37,071   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml'
2024-04-19T08:08:37,072   adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt'
2024-04-19T08:08:37,074   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-04-19T08:08:37,075   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-04-19T08:08:37,077   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-04-19T08:08:37,079   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-04-19T08:08:37,080   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-04-19T08:08:37,082   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-04-19T08:08:37,083   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-04-19T08:08:37,085   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-04-19T08:08:37,087   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-04-19T08:08:37,088   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-04-19T08:08:37,090   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-04-19T08:08:37,091   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-04-19T08:08:37,093   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-04-19T08:08:37,095   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-04-19T08:08:37,096   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-04-19T08:08:37,098   adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml'
2024-04-19T08:08:37,100   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-04-19T08:08:37,101   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-04-19T08:08:37,103   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-04-19T08:08:37,104   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-04-19T08:08:37,105   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-04-19T08:08:37,107   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-04-19T08:08:37,109   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-04-19T08:08:37,111   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml'
2024-04-19T08:08:37,114   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-04-19T08:08:37,115   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-04-19T08:08:37,116   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-04-19T08:08:37,117   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-04-19T08:08:37,119   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-04-19T08:08:37,120   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-04-19T08:08:37,121   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv'
2024-04-19T08:08:37,122   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv'
2024-04-19T08:08:37,125   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-04-19T08:08:37,128   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-04-19T08:08:37,129   adding 'alpaca_eval/metrics/__init__.py'
2024-04-19T08:08:37,131   adding 'alpaca_eval/metrics/glm_winrate.py'
2024-04-19T08:08:37,133   adding 'alpaca_eval/metrics/helpers.py'
2024-04-19T08:08:37,134   adding 'alpaca_eval/metrics/winrate.py'
2024-04-19T08:08:37,139   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml'
2024-04-19T08:08:37,140   adding 'alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt'
2024-04-19T08:08:37,142   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml'
2024-04-19T08:08:37,143   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt'
2024-04-19T08:08:37,145   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml'
2024-04-19T08:08:37,146   adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt'
2024-04-19T08:08:37,148   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml'
2024-04-19T08:08:37,149   adding 'alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt'
2024-04-19T08:08:37,150   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-04-19T08:08:37,152   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-04-19T08:08:37,153   adding 'alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml'
2024-04-19T08:08:37,155   adding 'alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml'
2024-04-19T08:08:37,157   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-04-19T08:08:37,159   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml'
2024-04-19T08:08:37,160   adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt'
2024-04-19T08:08:37,162   adding 'alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml'
2024-04-19T08:08:37,163   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-04-19T08:08:37,165   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-04-19T08:08:37,166   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml'
2024-04-19T08:08:37,168   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt'
2024-04-19T08:08:37,170   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml'
2024-04-19T08:08:37,171   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt'
2024-04-19T08:08:37,173   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml'
2024-04-19T08:08:37,174   adding 'alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt'
2024-04-19T08:08:37,176   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml'
2024-04-19T08:08:37,177   adding 'alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt'
2024-04-19T08:08:37,179   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-04-19T08:08:37,180   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-04-19T08:08:37,182   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml'
2024-04-19T08:08:37,183   adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt'
2024-04-19T08:08:37,185   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml'
2024-04-19T08:08:37,185   adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt'
2024-04-19T08:08:37,187   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml'
2024-04-19T08:08:37,188   adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt'
2024-04-19T08:08:37,190   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml'
2024-04-19T08:08:37,191   adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml'
2024-04-19T08:08:37,193   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml'
2024-04-19T08:08:37,194   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt'
2024-04-19T08:08:37,196   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml'
2024-04-19T08:08:37,197   adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt'
2024-04-19T08:08:37,198   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml'
2024-04-19T08:08:37,199   adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt'
2024-04-19T08:08:37,201   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml'
2024-04-19T08:08:37,203   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml'
2024-04-19T08:08:37,204   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt'
2024-04-19T08:08:37,205   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml'
2024-04-19T08:08:37,206   adding 'alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt'
2024-04-19T08:08:37,208   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-04-19T08:08:37,209   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-04-19T08:08:37,211   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-04-19T08:08:37,212   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-04-19T08:08:37,214   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-04-19T08:08:37,215   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-04-19T08:08:37,217   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-04-19T08:08:37,218   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml'
2024-04-19T08:08:37,220   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml'
2024-04-19T08:08:37,221   adding 'alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt'
2024-04-19T08:08:37,222   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml'
2024-04-19T08:08:37,224   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml'
2024-04-19T08:08:37,225   adding 'alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt'
2024-04-19T08:08:37,226   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-04-19T08:08:37,228   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-04-19T08:08:37,229   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-04-19T08:08:37,230   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-04-19T08:08:37,232   adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml'
2024-04-19T08:08:37,234   adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml'
2024-04-19T08:08:37,235   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-04-19T08:08:37,237   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-04-19T08:08:37,239   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-04-19T08:08:37,240   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-04-19T08:08:37,242   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-04-19T08:08:37,243   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-04-19T08:08:37,245   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-04-19T08:08:37,246   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-04-19T08:08:37,248   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-04-19T08:08:37,249   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-04-19T08:08:37,250   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-04-19T08:08:37,252   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-04-19T08:08:37,253   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-04-19T08:08:37,255   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-04-19T08:08:37,256   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-04-19T08:08:37,257   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-04-19T08:08:37,259   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-04-19T08:08:37,260   adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml'
2024-04-19T08:08:37,261   adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt'
2024-04-19T08:08:37,263   adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml'
2024-04-19T08:08:37,264   adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt'
2024-04-19T08:08:37,266   adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml'
2024-04-19T08:08:37,267   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml'
2024-04-19T08:08:37,268   adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt'
2024-04-19T08:08:37,270   adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml'
2024-04-19T08:08:37,272   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-04-19T08:08:37,273   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-04-19T08:08:37,274   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-04-19T08:08:37,276   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-04-19T08:08:37,277   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-04-19T08:08:37,279   adding 'alpaca_eval/models_configs/dbrx-instruct/configs.yaml'
2024-04-19T08:08:37,280   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml'
2024-04-19T08:08:37,281   adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt'
2024-04-19T08:08:37,283   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-04-19T08:08:37,285   adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml'
2024-04-19T08:08:37,286   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-04-19T08:08:37,288   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-04-19T08:08:37,290   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-04-19T08:08:37,291   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-04-19T08:08:37,293   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-04-19T08:08:37,294   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-04-19T08:08:37,296   adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml'
2024-04-19T08:08:37,298   adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml'
2024-04-19T08:08:37,299   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-04-19T08:08:37,301   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml'
2024-04-19T08:08:37,303   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-04-19T08:08:37,305   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml'
2024-04-19T08:08:37,306   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml'
2024-04-19T08:08:37,308   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-04-19T08:08:37,310   adding 'alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml'
2024-04-19T08:08:37,311   adding 'alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml'
2024-04-19T08:08:37,313   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-04-19T08:08:37,314   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-04-19T08:08:37,315   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-04-19T08:08:37,317   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-04-19T08:08:37,318   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-04-19T08:08:37,320   adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml'
2024-04-19T08:08:37,321   adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml'
2024-04-19T08:08:37,323   adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt'
2024-04-19T08:08:37,324   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-04-19T08:08:37,325   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt'
2024-04-19T08:08:37,326   adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml'
2024-04-19T08:08:37,328   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt'
2024-04-19T08:08:37,329   adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml'
2024-04-19T08:08:37,331   adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml'
2024-04-19T08:08:37,332   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-04-19T08:08:37,334   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-04-19T08:08:37,335   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-04-19T08:08:37,337   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-04-19T08:08:37,339   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-04-19T08:08:37,340   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-04-19T08:08:37,341   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-04-19T08:08:37,342   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-04-19T08:08:37,344   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-04-19T08:08:37,345   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml'
2024-04-19T08:08:37,347   adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt'
2024-04-19T08:08:37,348   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-04-19T08:08:37,349   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-04-19T08:08:37,351   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-04-19T08:08:37,353   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-04-19T08:08:37,354   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-04-19T08:08:37,356   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-04-19T08:08:37,357   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-04-19T08:08:37,359   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-04-19T08:08:37,360   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-04-19T08:08:37,361   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-04-19T08:08:37,363   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-04-19T08:08:37,364   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-04-19T08:08:37,366   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-04-19T08:08:37,367   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-04-19T08:08:37,369   adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml'
2024-04-19T08:08:37,371   adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt'
2024-04-19T08:08:37,372   adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml'
2024-04-19T08:08:37,374   adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml'
2024-04-19T08:08:37,375   adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt'
2024-04-19T08:08:37,376   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-04-19T08:08:37,377   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-04-19T08:08:37,379   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-04-19T08:08:37,381   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-04-19T08:08:37,382   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-04-19T08:08:37,384   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-04-19T08:08:37,385   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-04-19T08:08:37,387   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-04-19T08:08:37,389   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-04-19T08:08:37,390   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-04-19T08:08:37,391   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-04-19T08:08:37,393   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-04-19T08:08:37,394   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-04-19T08:08:37,396   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-04-19T08:08:37,397   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-04-19T08:08:37,399   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-04-19T08:08:37,400   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-04-19T08:08:37,402   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-04-19T08:08:37,403   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-04-19T08:08:37,405   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-04-19T08:08:37,406   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-04-19T08:08:37,408   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-04-19T08:08:37,409   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-04-19T08:08:37,411   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-04-19T08:08:37,412   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-04-19T08:08:37,414   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-04-19T08:08:37,415   adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml'
2024-04-19T08:08:37,417   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-04-19T08:08:37,419   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-04-19T08:08:37,420   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-04-19T08:08:37,422   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-04-19T08:08:37,424   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-04-19T08:08:37,426   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-04-19T08:08:37,428   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-04-19T08:08:37,429   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-04-19T08:08:37,431   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-04-19T08:08:37,432   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-04-19T08:08:37,434   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-04-19T08:08:37,435   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-04-19T08:08:37,437   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-04-19T08:08:37,439   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-04-19T08:08:37,440   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-04-19T08:08:37,442   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-04-19T08:08:37,444   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-04-19T08:08:37,445   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-04-19T08:08:37,446   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-04-19T08:08:37,448   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-04-19T08:08:37,449   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-04-19T08:08:37,453   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-04-19T08:08:37,455   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-04-19T08:08:37,456   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-04-19T08:08:37,458   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-04-19T08:08:37,459   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-04-19T08:08:37,461   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-04-19T08:08:37,462   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-04-19T08:08:37,464   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-04-19T08:08:37,465   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-04-19T08:08:37,467   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-04-19T08:08:37,469   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-04-19T08:08:37,471   adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml'
2024-04-19T08:08:37,473   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-04-19T08:08:37,475   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-04-19T08:08:37,476   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-04-19T08:08:37,478   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-04-19T08:08:37,480   adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml'
2024-04-19T08:08:37,482   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-04-19T08:08:37,483   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-04-19T08:08:37,485   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-04-19T08:08:37,486   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-04-19T08:08:37,488   adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml'
2024-04-19T08:08:37,490   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-04-19T08:08:37,491   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-04-19T08:08:37,493   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml'
2024-04-19T08:08:37,495   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-04-19T08:08:37,496   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-04-19T08:08:37,498   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-04-19T08:08:37,499   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-04-19T08:08:37,500   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-04-19T08:08:37,503   adding 'alpaca_eval-0.6.2.dist-info/LICENSE'
2024-04-19T08:08:37,515   adding 'alpaca_eval-0.6.2.dist-info/METADATA'
2024-04-19T08:08:37,517   adding 'alpaca_eval-0.6.2.dist-info/WHEEL'
2024-04-19T08:08:37,518   adding 'alpaca_eval-0.6.2.dist-info/entry_points.txt'
2024-04-19T08:08:37,519   adding 'alpaca_eval-0.6.2.dist-info/top_level.txt'
2024-04-19T08:08:37,525   adding 'alpaca_eval-0.6.2.dist-info/RECORD'
2024-04-19T08:08:37,533   removing build/bdist.linux-armv7l/wheel
2024-04-19T08:08:37,793   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-04-19T08:08:37,798   Created wheel for alpaca-eval: filename=alpaca_eval-0.6.2-py3-none-any.whl size=295700 sha256=f93aa4f39f46ac56b280e9c6249815ad57fb21f6f676abcf76640e872d4a1832
2024-04-19T08:08:37,800   Stored in directory: /tmp/pip-ephem-wheel-cache-2x6ql36u/wheels/8b/9d/ff/171b65a882235f695d084aee7171135fcada602178dd7a5fdc
2024-04-19T08:08:37,836 Successfully built alpaca-eval
2024-04-19T08:08:37,845 Removed build tracker: '/tmp/pip-build-tracker-cbb50yau'