2024-01-10T06:39:07,136 Created temporary directory: /tmp/pip-build-tracker-fqkejeus
2024-01-10T06:39:07,137 Initialized build tracking at /tmp/pip-build-tracker-fqkejeus
2024-01-10T06:39:07,137 Created build tracker: /tmp/pip-build-tracker-fqkejeus
2024-01-10T06:39:07,138 Entered build tracker: /tmp/pip-build-tracker-fqkejeus
2024-01-10T06:39:07,138 Created temporary directory: /tmp/pip-wheel-osqp7oe_
2024-01-10T06:39:07,142 Created temporary directory: /tmp/pip-ephem-wheel-cache-ygov_oj8
2024-01-10T06:39:07,164 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-01-10T06:39:07,167 2 location(s) to search for versions of alpaca-eval:
2024-01-10T06:39:07,167 * https://pypi.org/simple/alpaca-eval/
2024-01-10T06:39:07,167 * https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T06:39:07,168 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-01-10T06:39:07,169 Getting page https://pypi.org/simple/alpaca-eval/
2024-01-10T06:39:07,170 Found index url https://pypi.org/simple/
2024-01-10T06:39:07,389 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-01-10T06:39:07,399   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,400   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-01-10T06:39:07,401   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,402   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-01-10T06:39:07,402   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,403   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-01-10T06:39:07,404   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,405   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-01-10T06:39:07,406   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,407   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-01-10T06:39:07,408   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,409   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-01-10T06:39:07,409   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,410   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-01-10T06:39:07,411   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,412   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-01-10T06:39:07,412   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,413   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-01-10T06:39:07,414   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,415   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-01-10T06:39:07,415   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,416   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-01-10T06:39:07,417   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,418   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-01-10T06:39:07,419   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,420   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-01-10T06:39:07,421   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,422   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-01-10T06:39:07,422   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,423   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-01-10T06:39:07,424   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,424   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-01-10T06:39:07,425   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,426   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-01-10T06:39:07,427   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,428   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-01-10T06:39:07,428   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,429   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-01-10T06:39:07,430   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,431   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-01-10T06:39:07,432   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,433   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-01-10T06:39:07,434   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,434   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-01-10T06:39:07,435   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,436   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-01-10T06:39:07,436   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,437   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-01-10T06:39:07,438   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,439   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-01-10T06:39:07,439   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,440   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-01-10T06:39:07,441   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,442   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-01-10T06:39:07,443 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T06:39:07,443 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T06:39:07,445 Found index url https://www.piwheels.org/simple/
2024-01-10T06:39:07,604 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-01-10T06:39:07,611   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,612   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,613   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,613   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,614   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,614   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,615   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,615   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,616   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,616   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,617   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,617   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,618   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,618   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,619   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,620   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,620   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,621   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,621   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-10T06:39:07,621   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,622   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,623   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-10T06:39:07,623 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-01-10T06:39:07,624 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-01-10T06:39:07,645 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-01-10T06:39:07,663 Collecting alpaca-eval==0.5.1
2024-01-10T06:39:07,665   Created temporary directory: /tmp/pip-unpack-02f2jc5x
2024-01-10T06:39:07,952   Downloading alpaca_eval-0.5.1.tar.gz (331 kB)
2024-01-10T06:39:08,588   Added alpaca-eval==0.5.1 from https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz to build tracker '/tmp/pip-build-tracker-fqkejeus'
2024-01-10T06:39:08,590   Running setup.py (path:/tmp/pip-wheel-osqp7oe_/alpaca-eval_c74c5fb81abe497ea29cac302b42db91/setup.py) egg_info for package alpaca-eval
2024-01-10T06:39:08,591   Created temporary directory: /tmp/pip-pip-egg-info-8my13d15
2024-01-10T06:39:08,591   Preparing metadata (setup.py): started
2024-01-10T06:39:08,593   Running command python setup.py egg_info
2024-01-10T06:39:09,596   running egg_info
2024-01-10T06:39:09,597   creating /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info
2024-01-10T06:39:09,621   writing /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/PKG-INFO
2024-01-10T06:39:09,640   writing dependency_links to /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/dependency_links.txt
2024-01-10T06:39:09,642   writing entry points to /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/entry_points.txt
2024-01-10T06:39:09,650   writing requirements to /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/requires.txt
2024-01-10T06:39:09,651   writing top-level names to /tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/top_level.txt
2024-01-10T06:39:09,653   writing manifest file '/tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T06:39:09,729   reading manifest file '/tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T06:39:09,730   reading manifest template 'MANIFEST.in'
2024-01-10T06:39:09,877   adding license file 'LICENSE'
2024-01-10T06:39:09,886   writing manifest file '/tmp/pip-pip-egg-info-8my13d15/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T06:39:09,994   Preparing metadata (setup.py): finished with status 'done'
2024-01-10T06:39:10,002   Source in /tmp/pip-wheel-osqp7oe_/alpaca-eval_c74c5fb81abe497ea29cac302b42db91 has version 0.5.1, which satisfies requirement alpaca-eval==0.5.1 from https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz
2024-01-10T06:39:10,003   Removed alpaca-eval==0.5.1 from https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz from build tracker '/tmp/pip-build-tracker-fqkejeus'
2024-01-10T06:39:10,017 Created temporary directory: /tmp/pip-unpack-gb9rosjy
2024-01-10T06:39:10,018 Created temporary directory: /tmp/pip-unpack-kd9q39ry
2024-01-10T06:39:10,159 Building wheels for collected packages: alpaca-eval
2024-01-10T06:39:10,163   Created temporary directory: /tmp/pip-wheel-cql6o9ck
2024-01-10T06:39:10,164   Building wheel for alpaca-eval (setup.py): started
2024-01-10T06:39:10,165   Destination directory: /tmp/pip-wheel-cql6o9ck
2024-01-10T06:39:10,166   Running command python setup.py bdist_wheel
2024-01-10T06:39:11,149   running bdist_wheel
2024-01-10T06:39:11,242   running build
2024-01-10T06:39:11,242   running build_py
2024-01-10T06:39:11,269   creating build
2024-01-10T06:39:11,270   creating build/lib
2024-01-10T06:39:11,271   creating build/lib/alpaca_eval
2024-01-10T06:39:11,272   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,274   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,276   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,279   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,280   copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,283   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,285   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,287   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,290   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,292   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-01-10T06:39:11,295   creating build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,296   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,298   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,300   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,302   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,304   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,305   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,307   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,309   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,311   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,313   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,315   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-01-10T06:39:11,318   creating build/lib/alpaca_eval/annotators
2024-01-10T06:39:11,319   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-01-10T06:39:11,321   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-01-10T06:39:11,323   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-01-10T06:39:11,325   running egg_info
2024-01-10T06:39:11,378   writing src/alpaca_eval.egg-info/PKG-INFO
2024-01-10T06:39:11,397   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-01-10T06:39:11,398   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-01-10T06:39:11,407   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-01-10T06:39:11,408   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-01-10T06:39:11,437   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T06:39:11,444   reading manifest template 'MANIFEST.in'
2024-01-10T06:39:11,563   adding license file 'LICENSE'
2024-01-10T06:39:11,576   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-10T06:39:11,579   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-01-10T06:39:11,580   !!

2024-01-10T06:39:11,581           ********************************************************************************
2024-01-10T06:39:11,581           ############################
2024-01-10T06:39:11,582           # Package would be ignored #
2024-01-10T06:39:11,582           ############################
2024-01-10T06:39:11,583           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-01-10T06:39:11,583           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,585           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,585           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-01-10T06:39:11,586           to the `packages` configuration field.

2024-01-10T06:39:11,587           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,588           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,588           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,589           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,590           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,591           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-01-10T06:39:11,591           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-01-10T06:39:11,592           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,592           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,593           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,593           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,594           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,596           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,596                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,597                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,597                 directory, all directories are treated like packages.
2024-01-10T06:39:11,598           ********************************************************************************

2024-01-10T06:39:11,599   !!
2024-01-10T06:39:11,599     check.warn(importable)
2024-01-10T06:39:11,600   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:11,600   !!

2024-01-10T06:39:11,601           ********************************************************************************
2024-01-10T06:39:11,602           ############################
2024-01-10T06:39:11,602           # Package would be ignored #
2024-01-10T06:39:11,602           ############################
2024-01-10T06:39:11,603           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:11,603           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,604           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,604           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-01-10T06:39:11,604           to the `packages` configuration field.

2024-01-10T06:39:11,605           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,606           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,606           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,607           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,607           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,608           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-01-10T06:39:11,609           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-01-10T06:39:11,609           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,610           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,610           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,611           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,612           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,613           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,614                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,614                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,615                 directory, all directories are treated like packages.
2024-01-10T06:39:11,615           ********************************************************************************

2024-01-10T06:39:11,616   !!
2024-01-10T06:39:11,617     check.warn(importable)
2024-01-10T06:39:11,617   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:11,617   !!

2024-01-10T06:39:11,618           ********************************************************************************
2024-01-10T06:39:11,619           ############################
2024-01-10T06:39:11,619           # Package would be ignored #
2024-01-10T06:39:11,620           ############################
2024-01-10T06:39:11,620           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:11,621           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,622           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,622           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-01-10T06:39:11,623           to the `packages` configuration field.

2024-01-10T06:39:11,624           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,624           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,624           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,625           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,626           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,626           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-01-10T06:39:11,627           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-01-10T06:39:11,627           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,627           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,628           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,628           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,629           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,630           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,631                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,631                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,631                 directory, all directories are treated like packages.
2024-01-10T06:39:11,632           ********************************************************************************

2024-01-10T06:39:11,633   !!
2024-01-10T06:39:11,633     check.warn(importable)
2024-01-10T06:39:11,634   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-10T06:39:11,634   !!

2024-01-10T06:39:11,635           ********************************************************************************
2024-01-10T06:39:11,636           ############################
2024-01-10T06:39:11,636           # Package would be ignored #
2024-01-10T06:39:11,637           ############################
2024-01-10T06:39:11,637           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-01-10T06:39:11,637           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,638           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,639           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-01-10T06:39:11,639           to the `packages` configuration field.

2024-01-10T06:39:11,640           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,641           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,641           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,642           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,643           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,644           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-01-10T06:39:11,644           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-01-10T06:39:11,645           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,645           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,646           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,647           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,647           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,648           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,649                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,649                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,649                 directory, all directories are treated like packages.
2024-01-10T06:39:11,650           ********************************************************************************

2024-01-10T06:39:11,650   !!
2024-01-10T06:39:11,651     check.warn(importable)
2024-01-10T06:39:11,651   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:11,651   !!

2024-01-10T06:39:11,652           ********************************************************************************
2024-01-10T06:39:11,653           ############################
2024-01-10T06:39:11,653           # Package would be ignored #
2024-01-10T06:39:11,653           ############################
2024-01-10T06:39:11,654           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-01-10T06:39:11,654           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,655           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,656           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-01-10T06:39:11,656           to the `packages` configuration field.

2024-01-10T06:39:11,657           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,657           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,658           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,659           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,661           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-01-10T06:39:11,662           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-01-10T06:39:11,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,664           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,665           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,666           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,666           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,668           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,668                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,669                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,669                 directory, all directories are treated like packages.
2024-01-10T06:39:11,670           ********************************************************************************

2024-01-10T06:39:11,671   !!
2024-01-10T06:39:11,671     check.warn(importable)
2024-01-10T06:39:11,672   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-01-10T06:39:11,672   !!

2024-01-10T06:39:11,673           ********************************************************************************
2024-01-10T06:39:11,674           ############################
2024-01-10T06:39:11,674           # Package would be ignored #
2024-01-10T06:39:11,674           ############################
2024-01-10T06:39:11,675           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-01-10T06:39:11,675           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,676           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,676           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-01-10T06:39:11,676           to the `packages` configuration field.

2024-01-10T06:39:11,677           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,677           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,678           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,679           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,679           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,680           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-01-10T06:39:11,680           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-01-10T06:39:11,681           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,681           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,682           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,683           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,684           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,685           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,686                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,686                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,687                 directory, all directories are treated like packages.
2024-01-10T06:39:11,687           ********************************************************************************

2024-01-10T06:39:11,688   !!
2024-01-10T06:39:11,689     check.warn(importable)
2024-01-10T06:39:11,689   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-01-10T06:39:11,690   !!

2024-01-10T06:39:11,690           ********************************************************************************
2024-01-10T06:39:11,691           ############################
2024-01-10T06:39:11,691           # Package would be ignored #
2024-01-10T06:39:11,692           ############################
2024-01-10T06:39:11,692           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-01-10T06:39:11,693           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,694           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,694           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-01-10T06:39:11,695           to the `packages` configuration field.

2024-01-10T06:39:11,696           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,697           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,698           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,698           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,699           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-01-10T06:39:11,699           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-01-10T06:39:11,700           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,700           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,700           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,701           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,702           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,703           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,703                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,703                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,704                 directory, all directories are treated like packages.
2024-01-10T06:39:11,704           ********************************************************************************

2024-01-10T06:39:11,705   !!
2024-01-10T06:39:11,706     check.warn(importable)
2024-01-10T06:39:11,706   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-01-10T06:39:11,707   !!

2024-01-10T06:39:11,707           ********************************************************************************
2024-01-10T06:39:11,708           ############################
2024-01-10T06:39:11,709           # Package would be ignored #
2024-01-10T06:39:11,709           ############################
2024-01-10T06:39:11,710           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-01-10T06:39:11,710           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,711           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,712           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-01-10T06:39:11,712           to the `packages` configuration field.

2024-01-10T06:39:11,713           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,714           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,714           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,715           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,716           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,717           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-01-10T06:39:11,717           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-01-10T06:39:11,718           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,718           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,719           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,720           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,721           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,722           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,722                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,723                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,723                 directory, all directories are treated like packages.
2024-01-10T06:39:11,723           ********************************************************************************

2024-01-10T06:39:11,724   !!
2024-01-10T06:39:11,724     check.warn(importable)
2024-01-10T06:39:11,725   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-10T06:39:11,725   !!

2024-01-10T06:39:11,726           ********************************************************************************
2024-01-10T06:39:11,726           ############################
2024-01-10T06:39:11,726           # Package would be ignored #
2024-01-10T06:39:11,727           ############################
2024-01-10T06:39:11,727           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-01-10T06:39:11,727           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,728           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,728           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-01-10T06:39:11,729           to the `packages` configuration field.

2024-01-10T06:39:11,731           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,732           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,732           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,733           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,734           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,736           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-01-10T06:39:11,736           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-01-10T06:39:11,737           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,737           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,738           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,739           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,740           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,741           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,741                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,742                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,742                 directory, all directories are treated like packages.
2024-01-10T06:39:11,743           ********************************************************************************

2024-01-10T06:39:11,744   !!
2024-01-10T06:39:11,744     check.warn(importable)
2024-01-10T06:39:11,745   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-01-10T06:39:11,745   !!

2024-01-10T06:39:11,746           ********************************************************************************
2024-01-10T06:39:11,747           ############################
2024-01-10T06:39:11,747           # Package would be ignored #
2024-01-10T06:39:11,748           ############################
2024-01-10T06:39:11,748           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-01-10T06:39:11,749           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,749           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,750           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-01-10T06:39:11,750           to the `packages` configuration field.

2024-01-10T06:39:11,751           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,751           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,751           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,752           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,753           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,753           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-01-10T06:39:11,754           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-01-10T06:39:11,754           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,754           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,755           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,756           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,757           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,759           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,759                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,760                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,760                 directory, all directories are treated like packages.
2024-01-10T06:39:11,761           ********************************************************************************

2024-01-10T06:39:11,762   !!
2024-01-10T06:39:11,762     check.warn(importable)
2024-01-10T06:39:11,763   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:11,764   !!

2024-01-10T06:39:11,764           ********************************************************************************
2024-01-10T06:39:11,765           ############################
2024-01-10T06:39:11,765           # Package would be ignored #
2024-01-10T06:39:11,766           ############################
2024-01-10T06:39:11,766           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-01-10T06:39:11,767           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,768           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,768           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-01-10T06:39:11,768           to the `packages` configuration field.

2024-01-10T06:39:11,769           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,770           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,770           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,772           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,772           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,774           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-01-10T06:39:11,774           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-01-10T06:39:11,774           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,775           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,775           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,776           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,776           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,777           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,778                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,778                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,778                 directory, all directories are treated like packages.
2024-01-10T06:39:11,779           ********************************************************************************

2024-01-10T06:39:11,779   !!
2024-01-10T06:39:11,780     check.warn(importable)
2024-01-10T06:39:11,780   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:11,781   !!

2024-01-10T06:39:11,782           ********************************************************************************
2024-01-10T06:39:11,782           ############################
2024-01-10T06:39:11,783           # Package would be ignored #
2024-01-10T06:39:11,783           ############################
2024-01-10T06:39:11,784           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-01-10T06:39:11,784           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,785           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,786           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-01-10T06:39:11,786           to the `packages` configuration field.

2024-01-10T06:39:11,787           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,788           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,789           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,790           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,790           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,791           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-01-10T06:39:11,792           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-01-10T06:39:11,792           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,792           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,793           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,794           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,795           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,796           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,797                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,797                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,798                 directory, all directories are treated like packages.
2024-01-10T06:39:11,799           ********************************************************************************

2024-01-10T06:39:11,799   !!
2024-01-10T06:39:11,800     check.warn(importable)
2024-01-10T06:39:11,800   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-10T06:39:11,800   !!

2024-01-10T06:39:11,801           ********************************************************************************
2024-01-10T06:39:11,801           ############################
2024-01-10T06:39:11,802           # Package would be ignored #
2024-01-10T06:39:11,802           ############################
2024-01-10T06:39:11,803           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-01-10T06:39:11,803           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,804           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,804           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-01-10T06:39:11,805           to the `packages` configuration field.

2024-01-10T06:39:11,805           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,806           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,806           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,807           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,808           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,809           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-01-10T06:39:11,809           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-01-10T06:39:11,810           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,810           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,811           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,812           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,813           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,815           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,816                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,816                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,817                 directory, all directories are treated like packages.
2024-01-10T06:39:11,817           ********************************************************************************

2024-01-10T06:39:11,818   !!
2024-01-10T06:39:11,819     check.warn(importable)
2024-01-10T06:39:11,819   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-10T06:39:11,820   !!

2024-01-10T06:39:11,821           ********************************************************************************
2024-01-10T06:39:11,821           ############################
2024-01-10T06:39:11,822           # Package would be ignored #
2024-01-10T06:39:11,822           ############################
2024-01-10T06:39:11,823           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-01-10T06:39:11,823           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,824           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,825           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-01-10T06:39:11,826           to the `packages` configuration field.

2024-01-10T06:39:11,827           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,827           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,827           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,828           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,829           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,830           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-01-10T06:39:11,830           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-01-10T06:39:11,831           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,831           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,831           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,832           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,833           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,834           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,835                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,835                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,836                 directory, all directories are treated like packages.
2024-01-10T06:39:11,836           ********************************************************************************

2024-01-10T06:39:11,837   !!
2024-01-10T06:39:11,838     check.warn(importable)
2024-01-10T06:39:11,839   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-01-10T06:39:11,839   !!

2024-01-10T06:39:11,840           ********************************************************************************
2024-01-10T06:39:11,841           ############################
2024-01-10T06:39:11,841           # Package would be ignored #
2024-01-10T06:39:11,842           ############################
2024-01-10T06:39:11,843           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-01-10T06:39:11,843           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,845           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,845           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-01-10T06:39:11,845           to the `packages` configuration field.

2024-01-10T06:39:11,846           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,847           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,848           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,848           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,849           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,851           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-01-10T06:39:11,851           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-01-10T06:39:11,852           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,852           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,853           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,854           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,855           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,856           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,857                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,857                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,857                 directory, all directories are treated like packages.
2024-01-10T06:39:11,858           ********************************************************************************

2024-01-10T06:39:11,858   !!
2024-01-10T06:39:11,858     check.warn(importable)
2024-01-10T06:39:11,859   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-01-10T06:39:11,859   !!

2024-01-10T06:39:11,860           ********************************************************************************
2024-01-10T06:39:11,860           ############################
2024-01-10T06:39:11,861           # Package would be ignored #
2024-01-10T06:39:11,861           ############################
2024-01-10T06:39:11,861           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-01-10T06:39:11,862           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,863           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,863           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-01-10T06:39:11,864           to the `packages` configuration field.

2024-01-10T06:39:11,865           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,865           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,866           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,867           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,868           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,869           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-01-10T06:39:11,869           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-01-10T06:39:11,870           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,871           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,871           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,872           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,873           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,874           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,875                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,876                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,876                 directory, all directories are treated like packages.
2024-01-10T06:39:11,877           ********************************************************************************

2024-01-10T06:39:11,878   !!
2024-01-10T06:39:11,879     check.warn(importable)
2024-01-10T06:39:11,879   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-01-10T06:39:11,880   !!

2024-01-10T06:39:11,882           ********************************************************************************
2024-01-10T06:39:11,882           ############################
2024-01-10T06:39:11,883           # Package would be ignored #
2024-01-10T06:39:11,883           ############################
2024-01-10T06:39:11,884           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-01-10T06:39:11,884           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,885           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,885           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-01-10T06:39:11,886           to the `packages` configuration field.

2024-01-10T06:39:11,887           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,887           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,887           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,888           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,889           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,890           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-01-10T06:39:11,890           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-01-10T06:39:11,891           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,891           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,892           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,892           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,893           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,895           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,895                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,896                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,896                 directory, all directories are treated like packages.
2024-01-10T06:39:11,897           ********************************************************************************

2024-01-10T06:39:11,898   !!
2024-01-10T06:39:11,898     check.warn(importable)
2024-01-10T06:39:11,899   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-01-10T06:39:11,900   !!

2024-01-10T06:39:11,901           ********************************************************************************
2024-01-10T06:39:11,902           ############################
2024-01-10T06:39:11,902           # Package would be ignored #
2024-01-10T06:39:11,903           ############################
2024-01-10T06:39:11,904           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-01-10T06:39:11,904           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,906           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,906           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-01-10T06:39:11,907           to the `packages` configuration field.

2024-01-10T06:39:11,909           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,909           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,910           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,912           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,914           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,915           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-01-10T06:39:11,915           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-01-10T06:39:11,916           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,916           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,917           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,918           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,919           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,920           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,921                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,921                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,921                 directory, all directories are treated like packages.
2024-01-10T06:39:11,922           ********************************************************************************

2024-01-10T06:39:11,923   !!
2024-01-10T06:39:11,924     check.warn(importable)
2024-01-10T06:39:11,924   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-01-10T06:39:11,925   !!

2024-01-10T06:39:11,926           ********************************************************************************
2024-01-10T06:39:11,926           ############################
2024-01-10T06:39:11,927           # Package would be ignored #
2024-01-10T06:39:11,927           ############################
2024-01-10T06:39:11,928           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-01-10T06:39:11,929           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,930           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,930           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-01-10T06:39:11,931           to the `packages` configuration field.

2024-01-10T06:39:11,932           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,933           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,933           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,935           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,936           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,937           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-01-10T06:39:11,938           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-01-10T06:39:11,939           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,939           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,940           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,942           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,944           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,947           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,948                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,949                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,951                 directory, all directories are treated like packages.
2024-01-10T06:39:11,952           ********************************************************************************

2024-01-10T06:39:11,953   !!
2024-01-10T06:39:11,954     check.warn(importable)
2024-01-10T06:39:11,955   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-01-10T06:39:11,956   !!

2024-01-10T06:39:11,957           ********************************************************************************
2024-01-10T06:39:11,958           ############################
2024-01-10T06:39:11,959           # Package would be ignored #
2024-01-10T06:39:11,960           ############################
2024-01-10T06:39:11,961           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-01-10T06:39:11,961           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,963           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,964           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-01-10T06:39:11,964           to the `packages` configuration field.

2024-01-10T06:39:11,966           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,966           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,967           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,969           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,970           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,971           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-01-10T06:39:11,972           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-01-10T06:39:11,973           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,974           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,975           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:11,977           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:11,978           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:11,981           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:11,982                 even if it does not contain any `.py` files.
2024-01-10T06:39:11,983                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:11,984                 directory, all directories are treated like packages.
2024-01-10T06:39:11,985           ********************************************************************************

2024-01-10T06:39:11,986   !!
2024-01-10T06:39:11,987     check.warn(importable)
2024-01-10T06:39:11,987   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-10T06:39:11,988   !!

2024-01-10T06:39:11,989           ********************************************************************************
2024-01-10T06:39:11,990           ############################
2024-01-10T06:39:11,990           # Package would be ignored #
2024-01-10T06:39:11,991           ############################
2024-01-10T06:39:11,991           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-10T06:39:11,992           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:11,993           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:11,994           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-01-10T06:39:11,994           to the `packages` configuration field.

2024-01-10T06:39:11,995           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:11,995           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:11,995           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:11,996           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:11,997           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:11,997           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-10T06:39:11,998           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-01-10T06:39:11,998           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:11,999           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:11,999           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,000           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,000           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,002           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,002                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,003                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,003                 directory, all directories are treated like packages.
2024-01-10T06:39:12,004           ********************************************************************************

2024-01-10T06:39:12,005   !!
2024-01-10T06:39:12,005     check.warn(importable)
2024-01-10T06:39:12,005   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:12,006   !!

2024-01-10T06:39:12,007           ********************************************************************************
2024-01-10T06:39:12,007           ############################
2024-01-10T06:39:12,008           # Package would be ignored #
2024-01-10T06:39:12,008           ############################
2024-01-10T06:39:12,009           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-01-10T06:39:12,009           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,010           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,011           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-01-10T06:39:12,011           to the `packages` configuration field.

2024-01-10T06:39:12,012           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,012           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,013           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,014           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,015           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,016           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-01-10T06:39:12,017           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-01-10T06:39:12,017           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,018           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,019           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,019           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,020           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,021           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,022                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,022                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,022                 directory, all directories are treated like packages.
2024-01-10T06:39:12,023           ********************************************************************************

2024-01-10T06:39:12,024   !!
2024-01-10T06:39:12,024     check.warn(importable)
2024-01-10T06:39:12,025   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:12,025   !!

2024-01-10T06:39:12,026           ********************************************************************************
2024-01-10T06:39:12,026           ############################
2024-01-10T06:39:12,026           # Package would be ignored #
2024-01-10T06:39:12,027           ############################
2024-01-10T06:39:12,027           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:12,028           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,028           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,029           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-01-10T06:39:12,029           to the `packages` configuration field.

2024-01-10T06:39:12,030           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,031           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,031           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,032           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,033           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,033           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-01-10T06:39:12,034           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-01-10T06:39:12,034           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,035           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,036           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,037           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,038           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,039           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,040                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,041                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,041                 directory, all directories are treated like packages.
2024-01-10T06:39:12,041           ********************************************************************************

2024-01-10T06:39:12,042   !!
2024-01-10T06:39:12,043     check.warn(importable)
2024-01-10T06:39:12,043   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-01-10T06:39:12,044   !!

2024-01-10T06:39:12,045           ********************************************************************************
2024-01-10T06:39:12,046           ############################
2024-01-10T06:39:12,046           # Package would be ignored #
2024-01-10T06:39:12,046           ############################
2024-01-10T06:39:12,047           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-01-10T06:39:12,047           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,048           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,048           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-01-10T06:39:12,049           to the `packages` configuration field.

2024-01-10T06:39:12,049           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,050           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,050           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,054           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,055           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,056           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-01-10T06:39:12,057           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-01-10T06:39:12,057           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,058           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,058           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,059           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,060           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,061           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,062                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,062                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,062                 directory, all directories are treated like packages.
2024-01-10T06:39:12,063           ********************************************************************************

2024-01-10T06:39:12,064   !!
2024-01-10T06:39:12,065     check.warn(importable)
2024-01-10T06:39:12,065   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-01-10T06:39:12,066   !!

2024-01-10T06:39:12,067           ********************************************************************************
2024-01-10T06:39:12,067           ############################
2024-01-10T06:39:12,068           # Package would be ignored #
2024-01-10T06:39:12,068           ############################
2024-01-10T06:39:12,068           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-01-10T06:39:12,069           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,070           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,070           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-01-10T06:39:12,071           to the `packages` configuration field.

2024-01-10T06:39:12,072           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,072           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,073           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,074           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,074           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,075           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-01-10T06:39:12,075           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-01-10T06:39:12,076           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,076           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,077           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,077           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,078           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,079           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,080                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,080                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,080                 directory, all directories are treated like packages.
2024-01-10T06:39:12,081           ********************************************************************************

2024-01-10T06:39:12,082   !!
2024-01-10T06:39:12,082     check.warn(importable)
2024-01-10T06:39:12,082   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-01-10T06:39:12,083   !!

2024-01-10T06:39:12,084           ********************************************************************************
2024-01-10T06:39:12,084           ############################
2024-01-10T06:39:12,085           # Package would be ignored #
2024-01-10T06:39:12,085           ############################
2024-01-10T06:39:12,086           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-01-10T06:39:12,086           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,088           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,088           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-01-10T06:39:12,089           to the `packages` configuration field.

2024-01-10T06:39:12,089           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,090           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,090           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,091           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,092           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,093           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-01-10T06:39:12,094           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-01-10T06:39:12,094           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,095           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,095           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,097           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,098           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,099           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,100                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,100                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,101                 directory, all directories are treated like packages.
2024-01-10T06:39:12,101           ********************************************************************************

2024-01-10T06:39:12,102   !!
2024-01-10T06:39:12,102     check.warn(importable)
2024-01-10T06:39:12,103   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-01-10T06:39:12,103   !!

2024-01-10T06:39:12,104           ********************************************************************************
2024-01-10T06:39:12,104           ############################
2024-01-10T06:39:12,105           # Package would be ignored #
2024-01-10T06:39:12,105           ############################
2024-01-10T06:39:12,106           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-01-10T06:39:12,106           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,107           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,107           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-01-10T06:39:12,108           to the `packages` configuration field.

2024-01-10T06:39:12,109           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,109           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,109           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,110           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,111           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,112           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-01-10T06:39:12,113           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-01-10T06:39:12,113           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,113           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,114           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,115           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,116           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,117           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,117                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,118                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,118                 directory, all directories are treated like packages.
2024-01-10T06:39:12,119           ********************************************************************************

2024-01-10T06:39:12,120   !!
2024-01-10T06:39:12,120     check.warn(importable)
2024-01-10T06:39:12,121   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-01-10T06:39:12,121   !!

2024-01-10T06:39:12,122           ********************************************************************************
2024-01-10T06:39:12,123           ############################
2024-01-10T06:39:12,124           # Package would be ignored #
2024-01-10T06:39:12,124           ############################
2024-01-10T06:39:12,126           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-01-10T06:39:12,127           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,128           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,128           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-01-10T06:39:12,128           to the `packages` configuration field.

2024-01-10T06:39:12,129           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,129           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,130           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,131           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,131           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,132           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-01-10T06:39:12,133           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-01-10T06:39:12,133           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,134           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,134           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,135           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,136           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,137           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,138                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,138                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,138                 directory, all directories are treated like packages.
2024-01-10T06:39:12,139           ********************************************************************************

2024-01-10T06:39:12,140   !!
2024-01-10T06:39:12,140     check.warn(importable)
2024-01-10T06:39:12,141   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:12,141   !!

2024-01-10T06:39:12,142           ********************************************************************************
2024-01-10T06:39:12,142           ############################
2024-01-10T06:39:12,143           # Package would be ignored #
2024-01-10T06:39:12,143           ############################
2024-01-10T06:39:12,144           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-01-10T06:39:12,144           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,145           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,145           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-01-10T06:39:12,146           to the `packages` configuration field.

2024-01-10T06:39:12,147           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,147           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,148           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,149           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,150           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,151           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-01-10T06:39:12,152           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-01-10T06:39:12,152           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,153           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,153           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,154           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,154           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,156           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,156                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,156                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,157                 directory, all directories are treated like packages.
2024-01-10T06:39:12,157           ********************************************************************************

2024-01-10T06:39:12,158   !!
2024-01-10T06:39:12,158     check.warn(importable)
2024-01-10T06:39:12,159   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:12,159   !!

2024-01-10T06:39:12,160           ********************************************************************************
2024-01-10T06:39:12,161           ############################
2024-01-10T06:39:12,161           # Package would be ignored #
2024-01-10T06:39:12,162           ############################
2024-01-10T06:39:12,162           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-01-10T06:39:12,162           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,163           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,164           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-01-10T06:39:12,164           to the `packages` configuration field.

2024-01-10T06:39:12,165           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,166           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,166           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,167           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,168           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,169           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-01-10T06:39:12,169           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-01-10T06:39:12,170           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,170           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,171           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,172           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,173           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,174           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,175                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,175                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,176                 directory, all directories are treated like packages.
2024-01-10T06:39:12,176           ********************************************************************************

2024-01-10T06:39:12,177   !!
2024-01-10T06:39:12,177     check.warn(importable)
2024-01-10T06:39:12,178   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:12,178   !!

2024-01-10T06:39:12,179           ********************************************************************************
2024-01-10T06:39:12,179           ############################
2024-01-10T06:39:12,180           # Package would be ignored #
2024-01-10T06:39:12,180           ############################
2024-01-10T06:39:12,181           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-01-10T06:39:12,181           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,182           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,182           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-01-10T06:39:12,182           to the `packages` configuration field.

2024-01-10T06:39:12,183           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,183           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,184           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,185           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,186           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,187           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-01-10T06:39:12,187           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-01-10T06:39:12,187           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,188           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,188           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,189           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,190           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,192           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,192                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,193                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,195                 directory, all directories are treated like packages.
2024-01-10T06:39:12,195           ********************************************************************************

2024-01-10T06:39:12,196   !!
2024-01-10T06:39:12,197     check.warn(importable)
2024-01-10T06:39:12,197   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-01-10T06:39:12,198   !!

2024-01-10T06:39:12,199           ********************************************************************************
2024-01-10T06:39:12,200           ############################
2024-01-10T06:39:12,200           # Package would be ignored #
2024-01-10T06:39:12,200           ############################
2024-01-10T06:39:12,201           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-01-10T06:39:12,202           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,202           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,203           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-01-10T06:39:12,204           to the `packages` configuration field.

2024-01-10T06:39:12,205           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,205           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,205           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,206           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,207           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,207           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-01-10T06:39:12,208           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-01-10T06:39:12,208           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,208           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,209           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,209           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,210           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,211           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,212                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,212                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,212                 directory, all directories are treated like packages.
2024-01-10T06:39:12,213           ********************************************************************************

2024-01-10T06:39:12,214   !!
2024-01-10T06:39:12,214     check.warn(importable)
2024-01-10T06:39:12,215   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-01-10T06:39:12,215   !!

2024-01-10T06:39:12,216           ********************************************************************************
2024-01-10T06:39:12,217           ############################
2024-01-10T06:39:12,217           # Package would be ignored #
2024-01-10T06:39:12,217           ############################
2024-01-10T06:39:12,218           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-01-10T06:39:12,218           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,219           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,220           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-01-10T06:39:12,220           to the `packages` configuration field.

2024-01-10T06:39:12,221           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,221           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,222           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,223           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,224           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,224           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-01-10T06:39:12,225           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-01-10T06:39:12,225           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,226           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,226           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,228           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,228           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,229           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,230                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,230                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,230                 directory, all directories are treated like packages.
2024-01-10T06:39:12,231           ********************************************************************************

2024-01-10T06:39:12,232   !!
2024-01-10T06:39:12,232     check.warn(importable)
2024-01-10T06:39:12,232   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-10T06:39:12,233   !!

2024-01-10T06:39:12,233           ********************************************************************************
2024-01-10T06:39:12,234           ############################
2024-01-10T06:39:12,234           # Package would be ignored #
2024-01-10T06:39:12,235           ############################
2024-01-10T06:39:12,235           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-01-10T06:39:12,235           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,236           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,237           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-01-10T06:39:12,237           to the `packages` configuration field.

2024-01-10T06:39:12,238           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,238           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,239           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,240           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,241           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,241           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-01-10T06:39:12,242           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-01-10T06:39:12,243           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,243           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,244           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,245           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,245           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,247           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,247                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,248                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,248                 directory, all directories are treated like packages.
2024-01-10T06:39:12,249           ********************************************************************************

2024-01-10T06:39:12,250   !!
2024-01-10T06:39:12,250     check.warn(importable)
2024-01-10T06:39:12,251   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:12,251   !!

2024-01-10T06:39:12,252           ********************************************************************************
2024-01-10T06:39:12,253           ############################
2024-01-10T06:39:12,253           # Package would be ignored #
2024-01-10T06:39:12,253           ############################
2024-01-10T06:39:12,254           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:12,254           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,255           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,255           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-01-10T06:39:12,256           to the `packages` configuration field.

2024-01-10T06:39:12,257           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,257           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,258           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,259           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,260           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,261           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-01-10T06:39:12,261           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-01-10T06:39:12,262           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,263           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,263           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,265           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,266           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,268           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,269                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,269                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,270                 directory, all directories are treated like packages.
2024-01-10T06:39:12,271           ********************************************************************************

2024-01-10T06:39:12,272   !!
2024-01-10T06:39:12,273     check.warn(importable)
2024-01-10T06:39:12,273   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:12,274   !!

2024-01-10T06:39:12,275           ********************************************************************************
2024-01-10T06:39:12,276           ############################
2024-01-10T06:39:12,277           # Package would be ignored #
2024-01-10T06:39:12,277           ############################
2024-01-10T06:39:12,278           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:12,278           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,280           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,281           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-01-10T06:39:12,281           to the `packages` configuration field.

2024-01-10T06:39:12,283           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,283           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,285           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,286           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,287           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,289           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-01-10T06:39:12,290           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-01-10T06:39:12,291           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,292           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,292           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,294           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,295           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,298           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,298                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,299                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,300                 directory, all directories are treated like packages.
2024-01-10T06:39:12,301           ********************************************************************************

2024-01-10T06:39:12,302   !!
2024-01-10T06:39:12,303     check.warn(importable)
2024-01-10T06:39:12,303   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-01-10T06:39:12,304   !!

2024-01-10T06:39:12,306           ********************************************************************************
2024-01-10T06:39:12,306           ############################
2024-01-10T06:39:12,307           # Package would be ignored #
2024-01-10T06:39:12,308           ############################
2024-01-10T06:39:12,308           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-01-10T06:39:12,309           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,311           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,311           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-01-10T06:39:12,312           to the `packages` configuration field.

2024-01-10T06:39:12,314           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,315           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,315           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,317           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,318           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,320           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-01-10T06:39:12,321           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-01-10T06:39:12,322           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,322           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,323           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,324           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,326           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,328           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,329                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,330                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,330                 directory, all directories are treated like packages.
2024-01-10T06:39:12,331           ********************************************************************************

2024-01-10T06:39:12,332   !!
2024-01-10T06:39:12,333     check.warn(importable)
2024-01-10T06:39:12,333   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-01-10T06:39:12,334   !!

2024-01-10T06:39:12,336           ********************************************************************************
2024-01-10T06:39:12,336           ############################
2024-01-10T06:39:12,337           # Package would be ignored #
2024-01-10T06:39:12,338           ############################
2024-01-10T06:39:12,338           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-01-10T06:39:12,339           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,340           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,341           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-01-10T06:39:12,342           to the `packages` configuration field.

2024-01-10T06:39:12,343           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,344           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,344           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,346           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,348           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,349           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-01-10T06:39:12,350           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-01-10T06:39:12,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,351           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,352           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,354           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,356           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,357           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,358                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,358                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,359                 directory, all directories are treated like packages.
2024-01-10T06:39:12,359           ********************************************************************************

2024-01-10T06:39:12,361   !!
2024-01-10T06:39:12,361     check.warn(importable)
2024-01-10T06:39:12,362   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-01-10T06:39:12,362   !!

2024-01-10T06:39:12,363           ********************************************************************************
2024-01-10T06:39:12,364           ############################
2024-01-10T06:39:12,364           # Package would be ignored #
2024-01-10T06:39:12,365           ############################
2024-01-10T06:39:12,365           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-01-10T06:39:12,366           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,367           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,368           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-01-10T06:39:12,368           to the `packages` configuration field.

2024-01-10T06:39:12,369           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,370           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,370           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,371           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,372           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,373           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-01-10T06:39:12,373           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-01-10T06:39:12,374           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,374           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,375           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,376           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,377           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,378           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,379                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,379                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,380                 directory, all directories are treated like packages.
2024-01-10T06:39:12,380           ********************************************************************************

2024-01-10T06:39:12,382   !!
2024-01-10T06:39:12,382     check.warn(importable)
2024-01-10T06:39:12,383   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-01-10T06:39:12,383   !!

2024-01-10T06:39:12,384           ********************************************************************************
2024-01-10T06:39:12,385           ############################
2024-01-10T06:39:12,385           # Package would be ignored #
2024-01-10T06:39:12,386           ############################
2024-01-10T06:39:12,386           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-01-10T06:39:12,387           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,388           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,389           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-01-10T06:39:12,389           to the `packages` configuration field.

2024-01-10T06:39:12,390           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,391           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,391           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,393           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,394           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,395           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-01-10T06:39:12,396           already explicitly excluding 'alpaca_eval.models_configs' via
2024-01-10T06:39:12,397           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,397           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,398           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,399           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,400           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,401           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,402                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,402                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,403                 directory, all directories are treated like packages.
2024-01-10T06:39:12,403           ********************************************************************************

2024-01-10T06:39:12,404   !!
2024-01-10T06:39:12,405     check.warn(importable)
2024-01-10T06:39:12,405   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-10T06:39:12,406   !!

2024-01-10T06:39:12,406           ********************************************************************************
2024-01-10T06:39:12,407           ############################
2024-01-10T06:39:12,407           # Package would be ignored #
2024-01-10T06:39:12,408           ############################
2024-01-10T06:39:12,408           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-01-10T06:39:12,409           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,410           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,410           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-01-10T06:39:12,411           to the `packages` configuration field.

2024-01-10T06:39:12,412           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,412           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,413           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,414           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,415           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,416           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-01-10T06:39:12,416           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-01-10T06:39:12,417           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,417           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,418           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,419           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,420           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,421           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,422                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,423                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,423                 directory, all directories are treated like packages.
2024-01-10T06:39:12,424           ********************************************************************************

2024-01-10T06:39:12,425   !!
2024-01-10T06:39:12,425     check.warn(importable)
2024-01-10T06:39:12,426   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-10T06:39:12,426   !!

2024-01-10T06:39:12,427           ********************************************************************************
2024-01-10T06:39:12,428           ############################
2024-01-10T06:39:12,428           # Package would be ignored #
2024-01-10T06:39:12,429           ############################
2024-01-10T06:39:12,429           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-01-10T06:39:12,429           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,430           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,431           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-01-10T06:39:12,431           to the `packages` configuration field.

2024-01-10T06:39:12,432           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,433           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,433           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,434           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,436           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-01-10T06:39:12,437           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-01-10T06:39:12,437           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,438           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,438           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,440           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,441           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,443           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,443                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,444                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,444                 directory, all directories are treated like packages.
2024-01-10T06:39:12,445           ********************************************************************************

2024-01-10T06:39:12,446   !!
2024-01-10T06:39:12,447     check.warn(importable)
2024-01-10T06:39:12,447   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration.
2024-01-10T06:39:12,448   !!

2024-01-10T06:39:12,449           ********************************************************************************
2024-01-10T06:39:12,450           ############################
2024-01-10T06:39:12,450           # Package would be ignored #
2024-01-10T06:39:12,450           ############################
2024-01-10T06:39:12,451           Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1],
2024-01-10T06:39:12,452           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,453           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,453           package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added
2024-01-10T06:39:12,454           to the `packages` configuration field.

2024-01-10T06:39:12,455           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,456           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,456           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,457           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,458           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,459           If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are
2024-01-10T06:39:12,460           already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via
2024-01-10T06:39:12,460           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,460           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,461           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,462           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,463           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,464           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,464                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,465                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,465                 directory, all directories are treated like packages.
2024-01-10T06:39:12,466           ********************************************************************************

2024-01-10T06:39:12,467   !!
2024-01-10T06:39:12,467     check.warn(importable)
2024-01-10T06:39:12,468   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-01-10T06:39:12,468   !!

2024-01-10T06:39:12,469           ********************************************************************************
2024-01-10T06:39:12,470           ############################
2024-01-10T06:39:12,470           # Package would be ignored #
2024-01-10T06:39:12,471           ############################
2024-01-10T06:39:12,471           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-01-10T06:39:12,472           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,473           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,473           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-01-10T06:39:12,474           to the `packages` configuration field.

2024-01-10T06:39:12,475           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,475           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,476           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,477           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,478           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,479           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-01-10T06:39:12,479           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-01-10T06:39:12,480           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,480           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,481           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,482           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,483           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,485           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,486                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,486                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,487                 directory, all directories are treated like packages.
2024-01-10T06:39:12,487           ********************************************************************************

2024-01-10T06:39:12,488   !!
2024-01-10T06:39:12,489     check.warn(importable)
2024-01-10T06:39:12,489   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-01-10T06:39:12,489   !!

2024-01-10T06:39:12,490           ********************************************************************************
2024-01-10T06:39:12,491           ############################
2024-01-10T06:39:12,491           # Package would be ignored #
2024-01-10T06:39:12,492           ############################
2024-01-10T06:39:12,492           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-01-10T06:39:12,493           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,494           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,494           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-01-10T06:39:12,495           to the `packages` configuration field.

2024-01-10T06:39:12,496           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,496           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,497           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,498           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,499           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,500           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-01-10T06:39:12,500           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-01-10T06:39:12,501           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,501           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,502           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,502           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,503           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,505           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,506                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,506                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,507                 directory, all directories are treated like packages.
2024-01-10T06:39:12,507           ********************************************************************************

2024-01-10T06:39:12,508   !!
2024-01-10T06:39:12,509     check.warn(importable)
2024-01-10T06:39:12,509   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-10T06:39:12,510   !!

2024-01-10T06:39:12,511           ********************************************************************************
2024-01-10T06:39:12,511           ############################
2024-01-10T06:39:12,512           # Package would be ignored #
2024-01-10T06:39:12,513           ############################
2024-01-10T06:39:12,513           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-10T06:39:12,514           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,515           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,515           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-01-10T06:39:12,516           to the `packages` configuration field.

2024-01-10T06:39:12,517           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,517           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,517           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,518           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,519           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,520           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-10T06:39:12,521           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-01-10T06:39:12,521           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,522           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,522           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,523           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,524           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,526           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,526                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,526                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,527                 directory, all directories are treated like packages.
2024-01-10T06:39:12,527           ********************************************************************************

2024-01-10T06:39:12,528   !!
2024-01-10T06:39:12,529     check.warn(importable)
2024-01-10T06:39:12,530   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-01-10T06:39:12,530   !!

2024-01-10T06:39:12,531           ********************************************************************************
2024-01-10T06:39:12,532           ############################
2024-01-10T06:39:12,532           # Package would be ignored #
2024-01-10T06:39:12,533           ############################
2024-01-10T06:39:12,533           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-01-10T06:39:12,534           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,535           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,535           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-01-10T06:39:12,536           to the `packages` configuration field.

2024-01-10T06:39:12,537           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,537           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,538           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,539           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,540           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,541           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-01-10T06:39:12,542           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-01-10T06:39:12,542           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,543           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,543           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,544           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,545           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,546           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,547                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,547                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,548                 directory, all directories are treated like packages.
2024-01-10T06:39:12,548           ********************************************************************************

2024-01-10T06:39:12,549   !!
2024-01-10T06:39:12,550     check.warn(importable)
2024-01-10T06:39:12,550   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-01-10T06:39:12,551   !!

2024-01-10T06:39:12,552           ********************************************************************************
2024-01-10T06:39:12,552           ############################
2024-01-10T06:39:12,553           # Package would be ignored #
2024-01-10T06:39:12,553           ############################
2024-01-10T06:39:12,554           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-01-10T06:39:12,554           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,555           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,556           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-01-10T06:39:12,556           to the `packages` configuration field.

2024-01-10T06:39:12,557           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,558           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,558           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,559           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,560           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,561           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-01-10T06:39:12,562           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-01-10T06:39:12,562           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,563           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,563           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,564           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,565           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,567           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,568                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,568                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,569                 directory, all directories are treated like packages.
2024-01-10T06:39:12,569           ********************************************************************************

2024-01-10T06:39:12,570   !!
2024-01-10T06:39:12,571     check.warn(importable)
2024-01-10T06:39:12,571   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-01-10T06:39:12,572   !!

2024-01-10T06:39:12,573           ********************************************************************************
2024-01-10T06:39:12,574           ############################
2024-01-10T06:39:12,574           # Package would be ignored #
2024-01-10T06:39:12,574           ############################
2024-01-10T06:39:12,575           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-01-10T06:39:12,575           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,576           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,577           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-01-10T06:39:12,577           to the `packages` configuration field.

2024-01-10T06:39:12,578           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,578           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,579           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,580           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,581           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,582           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-01-10T06:39:12,582           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-01-10T06:39:12,583           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,583           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,584           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,585           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,586           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,587           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,588                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,588                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,589                 directory, all directories are treated like packages.
2024-01-10T06:39:12,589           ********************************************************************************

2024-01-10T06:39:12,590   !!
2024-01-10T06:39:12,591     check.warn(importable)
2024-01-10T06:39:12,591   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-10T06:39:12,592   !!

2024-01-10T06:39:12,593           ********************************************************************************
2024-01-10T06:39:12,593           ############################
2024-01-10T06:39:12,594           # Package would be ignored #
2024-01-10T06:39:12,594           ############################
2024-01-10T06:39:12,595           Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1],
2024-01-10T06:39:12,596           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,597           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,597           package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added
2024-01-10T06:39:12,598           to the `packages` configuration field.

2024-01-10T06:39:12,599           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,599           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,600           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,601           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,602           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,603           If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are
2024-01-10T06:39:12,603           already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via
2024-01-10T06:39:12,603           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,604           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,604           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,605           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,606           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,608           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,608                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,609                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,609                 directory, all directories are treated like packages.
2024-01-10T06:39:12,609           ********************************************************************************

2024-01-10T06:39:12,610   !!
2024-01-10T06:39:12,611     check.warn(importable)
2024-01-10T06:39:12,611   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-01-10T06:39:12,612   !!

2024-01-10T06:39:12,613           ********************************************************************************
2024-01-10T06:39:12,614           ############################
2024-01-10T06:39:12,614           # Package would be ignored #
2024-01-10T06:39:12,615           ############################
2024-01-10T06:39:12,615           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-01-10T06:39:12,616           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,617           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,617           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-01-10T06:39:12,618           to the `packages` configuration field.

2024-01-10T06:39:12,619           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,619           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,620           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,621           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,622           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,623           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-01-10T06:39:12,623           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-01-10T06:39:12,624           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,624           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,625           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,626           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,627           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,629           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,629                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,630                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,630                 directory, all directories are treated like packages.
2024-01-10T06:39:12,631           ********************************************************************************

2024-01-10T06:39:12,632   !!
2024-01-10T06:39:12,632     check.warn(importable)
2024-01-10T06:39:12,632   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-10T06:39:12,633   !!

2024-01-10T06:39:12,634           ********************************************************************************
2024-01-10T06:39:12,634           ############################
2024-01-10T06:39:12,635           # Package would be ignored #
2024-01-10T06:39:12,635           ############################
2024-01-10T06:39:12,636           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-01-10T06:39:12,636           but it is absent from setuptools' `packages` configuration.

2024-01-10T06:39:12,637           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-10T06:39:12,638           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-01-10T06:39:12,638           to the `packages` configuration field.

2024-01-10T06:39:12,639           Alternatively, you can also rely on setuptools' discovery methods
2024-01-10T06:39:12,640           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-10T06:39:12,640           instead of `find_packages(...)`/`find:`).

2024-01-10T06:39:12,641           You can read more about "package discovery" on setuptools documentation page:

2024-01-10T06:39:12,642           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-10T06:39:12,643           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-01-10T06:39:12,644           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-01-10T06:39:12,644           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-10T06:39:12,645           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-10T06:39:12,645           combination with a more fine grained `package-data` configuration.

2024-01-10T06:39:12,646           You can read more about "package data files" on setuptools documentation page:

2024-01-10T06:39:12,647           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-10T06:39:12,649           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-10T06:39:12,649                 even if it does not contain any `.py` files.
2024-01-10T06:39:12,650                 On the other hand, currently there is no concept of package data
2024-01-10T06:39:12,650                 directory, all directories are treated like packages.
2024-01-10T06:39:12,651           ********************************************************************************

2024-01-10T06:39:12,652   !!
2024-01-10T06:39:12,653     check.warn(importable)
2024-01-10T06:39:12,653   creating build/lib/alpaca_eval/evaluators_configs
2024-01-10T06:39:12,654   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-01-10T06:39:12,654   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:12,655   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:12,655   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:12,656   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:12,657   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:12,657   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:12,658   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:12,658   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:12,659   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:12,659   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:12,660   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:12,660   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:12,661   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T06:39:12,661   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T06:39:12,662   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T06:39:12,662   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T06:39:12,662   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:12,663   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:12,663   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:12,664   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:12,665   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:12,665   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:12,666   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,666   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,667   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,667   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,668   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,668   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,669   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,669   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,670   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,670   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,671   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,671   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,672   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,672   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:12,673   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:12,673   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:12,674   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:12,674   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:12,675   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:12,675   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:12,676   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T06:39:12,676   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T06:39:12,677   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T06:39:12,677   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T06:39:12,678   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:12,678   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:12,679   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:12,679   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:12,680   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:12,680   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:12,681   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:12,681   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:12,682   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:12,682   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-10T06:39:12,683   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-10T06:39:12,683   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:12,684   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:12,684   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:12,685   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-10T06:39:12,686   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-10T06:39:12,686   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T06:39:12,687   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T06:39:12,687   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-10T06:39:12,688   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-10T06:39:12,688   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T06:39:12,688   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T06:39:12,689   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:12,689   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:12,690   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:12,690   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:12,691   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:12,691   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:12,692   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T06:39:12,692   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T06:39:12,693   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T06:39:12,693   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T06:39:12,694   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:12,694   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:12,695   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:12,695   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T06:39:12,696   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T06:39:12,696   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T06:39:12,697   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T06:39:12,697   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:12,698   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:12,699   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:12,699   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:12,700   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:12,700   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:12,701   creating build/lib/alpaca_eval/evaluators_configs/test
2024-01-10T06:39:12,702   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-01-10T06:39:12,702   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:12,703   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:12,703   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:12,703   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T06:39:12,704   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T06:39:12,704   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T06:39:12,705   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T06:39:12,705   creating build/lib/alpaca_eval/leaderboards
2024-01-10T06:39:12,706   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:12,706   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:12,707   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:12,707   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:12,708   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:12,708   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:12,709   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:12,709   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:12,710   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:12,710   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-01-10T06:39:12,711   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-01-10T06:39:12,711   creating build/lib/alpaca_eval/models_configs
2024-01-10T06:39:12,712   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:12,712   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:12,713   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:12,713   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T06:39:12,714   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T06:39:12,714   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:12,715   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:12,715   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:12,716   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:12,717   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:12,717   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:12,718   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:12,718   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:12,718   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:12,719   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:12,719   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:12,720   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:12,720   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-10T06:39:12,721   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-10T06:39:12,721   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:12,722   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:12,722   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:12,723   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:12,723   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:12,724   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:12,724   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T06:39:12,725   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T06:39:12,725   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T06:39:12,726   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T06:39:12,726   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:12,727   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:12,727   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:12,728   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:12,728   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:12,729   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:12,729   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T06:39:12,730   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T06:39:12,730   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-10T06:39:12,731   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-10T06:39:12,731   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T06:39:12,732   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T06:39:12,733   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:12,733   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:12,734   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:12,734   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:12,735   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:12,735   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:12,736   creating build/lib/alpaca_eval/models_configs/chatgpt
2024-01-10T06:39:12,736   copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt
2024-01-10T06:39:12,737   creating build/lib/alpaca_eval/models_configs/claude
2024-01-10T06:39:12,737   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-01-10T06:39:12,738   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-01-10T06:39:12,738   creating build/lib/alpaca_eval/models_configs/claude-2
2024-01-10T06:39:12,738   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-01-10T06:39:12,739   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-10T06:39:12,739   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-10T06:39:12,740   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T06:39:12,740   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T06:39:12,741   creating build/lib/alpaca_eval/models_configs/cohere
2024-01-10T06:39:12,741   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-01-10T06:39:12,742   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-01-10T06:39:12,742   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:12,743   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:12,743   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:12,744   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T06:39:12,744   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T06:39:12,745   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-01-10T06:39:12,746   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-01-10T06:39:12,746   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T06:39:12,747   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T06:39:12,747   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T06:39:12,748   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T06:39:12,748   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T06:39:12,749   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T06:39:12,749   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:12,750   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:12,751   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:12,751   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T06:39:12,752   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T06:39:12,752   creating build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:12,752   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:12,753   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:12,753   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-10T06:39:12,754   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-10T06:39:12,754   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T06:39:12,755   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T06:39:12,755   creating build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:12,756   copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:12,756   copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:12,757   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-10T06:39:12,757   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-10T06:39:12,757   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-10T06:39:12,758   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-10T06:39:12,758   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T06:39:12,759   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T06:39:12,760   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-10T06:39:12,760   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-10T06:39:12,761   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:12,761   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:12,762   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:12,762   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:12,763   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:12,763   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:12,764   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T06:39:12,764   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T06:39:12,765   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:12,765   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:12,766   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:12,767   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T06:39:12,767   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T06:39:12,768   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:12,768   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:12,769   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:12,769   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:12,770   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:12,770   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:12,771   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:12,771   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:12,772   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:12,772   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T06:39:12,772   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T06:39:12,773   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:12,773   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:12,774   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:12,774   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:12,775   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:12,775   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:12,776   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:12,777   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:12,777   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:12,777   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T06:39:12,778   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T06:39:12,779   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:12,779   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:12,780   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:12,780   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:12,781   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:12,781   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:12,782   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:12,782   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:12,783   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:12,784   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:12,784   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:12,785   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:12,787   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:12,788   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:12,790   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:12,792   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:12,792   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:12,795   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:12,797   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:12,797   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:12,799   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:12,801   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:12,802   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:12,805   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:12,806   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:12,807   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:12,809   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:12,811   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T06:39:12,812   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T06:39:12,814   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T06:39:12,815   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T06:39:12,817   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T06:39:12,818   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T06:39:12,820   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T06:39:12,821   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T06:39:12,823   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T06:39:12,824   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T06:39:12,826   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T06:39:12,827   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T06:39:12,830   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:12,830   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:12,832   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:12,834   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T06:39:12,835   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T06:39:12,837   creating build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:12,838   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:12,839   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:12,841   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:12,842   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:12,844   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:12,846   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:12,846   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:12,848   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:12,850   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:12,851   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:12,853   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:12,854   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T06:39:12,855   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T06:39:12,857   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T06:39:12,858   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T06:39:12,860   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T06:39:12,861   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T06:39:12,863   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-10T06:39:12,864   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-10T06:39:12,866   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:12,867   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:12,869   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:12,871   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T06:39:12,872   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T06:39:12,874   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:12,875   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:12,877   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:12,879   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T06:39:12,880   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T06:39:12,882   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:12,882   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:12,885   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:12,887   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:12,887   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:12,889   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:12,891   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:12,892   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:12,894   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:12,896   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:12,896   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:12,898   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:12,900   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-10T06:39:12,901   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-10T06:39:12,903   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T06:39:12,904   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T06:39:12,906   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T06:39:12,907   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T06:39:12,909   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:12,910   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:12,912   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:12,914   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T06:39:12,915   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T06:39:12,917   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:12,918   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:12,920   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:12,922   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T06:39:12,922   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T06:39:12,924   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T06:39:12,925   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T06:39:12,927   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T06:39:12,928   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T06:39:12,930   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T06:39:12,931   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T06:39:12,933   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:12,934   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:12,936   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:12,938   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:12,939   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:12,941   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:12,942   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T06:39:12,943   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T06:39:12,970   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-01-10T06:39:12,971   !!

2024-01-10T06:39:12,972           ********************************************************************************
2024-01-10T06:39:12,973           Please avoid running ``setup.py`` directly.
2024-01-10T06:39:12,973           Instead, use pypa/build, pypa/installer or other
2024-01-10T06:39:12,974           standards-based tools.

2024-01-10T06:39:12,975           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-01-10T06:39:12,976           ********************************************************************************

2024-01-10T06:39:12,977   !!
2024-01-10T06:39:12,977     self.initialize_options()
2024-01-10T06:39:12,995   installing to build/bdist.linux-armv7l/wheel
2024-01-10T06:39:12,996   running install
2024-01-10T06:39:13,019   running install_lib
2024-01-10T06:39:13,044   creating build/bdist.linux-armv7l
2024-01-10T06:39:13,045   creating build/bdist.linux-armv7l/wheel
2024-01-10T06:39:13,047   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,048   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-01-10T06:39:13,050   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:13,051   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:13,053   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:13,054   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-10T06:39:13,057   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-10T06:39:13,057   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-10T06:39:13,060   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:13,061   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:13,063   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:13,065   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:13,067   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-10T06:39:13,069   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,070   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,073   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,074   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,076   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,078   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,080   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,081   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,083   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,085   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,087   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,089   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,091   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,093   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-10T06:39:13,096   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,099   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T06:39:13,099   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T06:39:13,103   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T06:39:13,105   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-10T06:39:13,107   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,109   copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,113   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-01-10T06:39:13,115   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T06:39:13,116   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T06:39:13,118   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-10T06:39:13,120   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-10T06:39:13,121   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-10T06:39:13,124   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T06:39:13,125   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-10T06:39:13,127   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:13,128   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:13,130   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-10T06:39:13,132   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:13,133   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:13,135   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-10T06:39:13,137   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:13,138   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:13,140   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-10T06:39:13,142   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T06:39:13,143   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-10T06:39:13,145   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T06:39:13,146   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-10T06:39:13,148   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:13,149   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:13,151   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-10T06:39:13,153   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T06:39:13,154   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-10T06:39:13,157   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T06:39:13,158   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-10T06:39:13,160   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T06:39:13,161   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-10T06:39:13,163   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T06:39:13,164   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-10T06:39:13,166   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:13,167   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:13,169   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-10T06:39:13,172   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2024-01-10T06:39:13,173   copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2024-01-10T06:39:13,175   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T06:39:13,176   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-10T06:39:13,178   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:13,179   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:13,181   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-10T06:39:13,183   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:13,184   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:13,185   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-10T06:39:13,188   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:13,188   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:13,190   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-10T06:39:13,192   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:13,193   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:13,195   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-10T06:39:13,197   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T06:39:13,198   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-10T06:39:13,201   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T06:39:13,202   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-10T06:39:13,204   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:13,205   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:13,207   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-10T06:39:13,209   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:13,210   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:13,212   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-10T06:39:13,214   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T06:39:13,215   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-10T06:39:13,217   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T06:39:13,218   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-10T06:39:13,220   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T06:39:13,221   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-10T06:39:13,223   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:13,224   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:13,226   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-10T06:39:13,228   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T06:39:13,229   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-10T06:39:13,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:13,232   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:13,234   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-10T06:39:13,236   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:13,237   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:13,239   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-10T06:39:13,241   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T06:39:13,242   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-10T06:39:13,244   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:13,245   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:13,247   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-10T06:39:13,249   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T06:39:13,250   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-10T06:39:13,253   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T06:39:13,254   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-10T06:39:13,256   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:13,257   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:13,259   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-10T06:39:13,261   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T06:39:13,262   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-10T06:39:13,265   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:13,265   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:13,267   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-10T06:39:13,269   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-10T06:39:13,270   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-10T06:39:13,272   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-10T06:39:13,273   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-10T06:39:13,275   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:13,276   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:13,278   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-10T06:39:13,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T06:39:13,281   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-10T06:39:13,283   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T06:39:13,284   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-10T06:39:13,286   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T06:39:13,287   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-10T06:39:13,289   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:13,290   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:13,292   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-10T06:39:13,294   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T06:39:13,295   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-10T06:39:13,297   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:13,298   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:13,300   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-10T06:39:13,302   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T06:39:13,303   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T06:39:13,305   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-10T06:39:13,307   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T06:39:13,308   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-10T06:39:13,310   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T06:39:13,311   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-10T06:39:13,313   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T06:39:13,314   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-10T06:39:13,316   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-10T06:39:13,317   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-10T06:39:13,319   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T06:39:13,320   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-10T06:39:13,322   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:13,323   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:13,325   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-10T06:39:13,327   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:13,328   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:13,330   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-10T06:39:13,332   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:13,333   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:13,335   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-10T06:39:13,337   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T06:39:13,338   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-10T06:39:13,340   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T06:39:13,341   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-10T06:39:13,343   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:13,344   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:13,346   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-10T06:39:13,348   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-10T06:39:13,349   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-10T06:39:13,351   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-10T06:39:13,352   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-10T06:39:13,354   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T06:39:13,355   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-10T06:39:13,357   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T06:39:13,358   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-10T06:39:13,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:13,361   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:13,362   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-10T06:39:13,365   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:13,365   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:13,367   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-10T06:39:13,369   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:13,370   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:13,372   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-10T06:39:13,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-10T06:39:13,375   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-10T06:39:13,377   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:13,378   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:13,380   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-10T06:39:13,382   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-10T06:39:13,383   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-10T06:39:13,385   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T06:39:13,386   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-10T06:39:13,388   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:13,389   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:13,391   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-10T06:39:13,393   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:13,394   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:13,396   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-10T06:39:13,398   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:13,398   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:13,400   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-10T06:39:13,402   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-10T06:39:13,403   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-10T06:39:13,405   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T06:39:13,406   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-10T06:39:13,408   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:13,409   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:13,411   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-10T06:39:13,412   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:13,413   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:13,415   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-10T06:39:13,417   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:13,418   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:13,420   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-10T06:39:13,422   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:13,423   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:13,425   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-10T06:39:13,427   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T06:39:13,428   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-10T06:39:13,430   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:13,431   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:13,433   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-10T06:39:13,435   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T06:39:13,435   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-10T06:39:13,438   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T06:39:13,438   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-10T06:39:13,441   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:13,441   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:13,443   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-10T06:39:13,446   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:13,446   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:13,448   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-10T06:39:13,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:13,451   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:13,453   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-10T06:39:13,455   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T06:39:13,456   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-10T06:39:13,458   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:13,459   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:13,461   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-10T06:39:13,463   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:13,464   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:13,466   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-10T06:39:13,468   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:13,469   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:13,471   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-10T06:39:13,473   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:13,474   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:13,475   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-10T06:39:13,477   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T06:39:13,478   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-10T06:39:13,480   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-10T06:39:13,481   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-10T06:39:13,483   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:13,484   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:13,486   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-10T06:39:13,488   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:13,488   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:13,490   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-10T06:39:13,492   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:13,493   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:13,495   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-10T06:39:13,497   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-10T06:39:13,498   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-10T06:39:13,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:13,501   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:13,503   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-10T06:39:13,505   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:13,506   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:13,508   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-10T06:39:13,510   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,512   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,514   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,518   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-10T06:39:13,519   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:13,520   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:13,522   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-10T06:39:13,524   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-10T06:39:13,525   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-10T06:39:13,527   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,528   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,530   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,532   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,534   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,536   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,538   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,540   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,542   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,544   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,546   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,548   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,549   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,552   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-10T06:39:13,555   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T06:39:13,556   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-10T06:39:13,558   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:13,559   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:13,561   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-10T06:39:13,563   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:13,564   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:13,566   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-10T06:39:13,568   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T06:39:13,569   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-10T06:39:13,571   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T06:39:13,572   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-10T06:39:13,574   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:13,575   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:13,577   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-10T06:39:13,579   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:13,579   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:13,582   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-10T06:39:13,584   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:13,585   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:13,587   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-10T06:39:13,590   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T06:39:13,590   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-10T06:39:13,593   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:13,594   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:13,596   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-10T06:39:13,598   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-10T06:39:13,599   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-10T06:39:13,601   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:13,602   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:13,604   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-10T06:39:13,607   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-10T06:39:13,608   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-10T06:39:13,609   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-10T06:39:13,612   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-10T06:39:13,612   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-10T06:39:13,614   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:13,615   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:13,617   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-10T06:39:13,619   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T06:39:13,620   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-10T06:39:13,622   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T06:39:13,623   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-10T06:39:13,625   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:13,626   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:13,628   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-10T06:39:13,630   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T06:39:13,631   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-10T06:39:13,634   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T06:39:13,635   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-10T06:39:13,637   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:13,638   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:13,640   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-10T06:39:13,642   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:13,643   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:13,645   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-10T06:39:13,647   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:13,648   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:13,650   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-10T06:39:13,652   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:13,653   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:13,655   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-10T06:39:13,658   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:13,659   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:13,661   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-10T06:39:13,663   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T06:39:13,664   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-10T06:39:13,667   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:13,668   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:13,670   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-10T06:39:13,673   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T06:39:13,674   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-10T06:39:13,677   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:13,678   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:13,680   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-10T06:39:13,682   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T06:39:13,683   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-10T06:39:13,686   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:13,687   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:13,689   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-10T06:39:13,691   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T06:39:13,692   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-10T06:39:13,694   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,697   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-10T06:39:13,699   running install_egg_info
2024-01-10T06:39:13,728   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.1-py3.11.egg-info
2024-01-10T06:39:13,741   running install_scripts
2024-01-10T06:39:13,776   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.1.dist-info/WHEEL
2024-01-10T06:39:13,779   creating '/tmp/pip-wheel-cql6o9ck/alpaca_eval-0.5.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-01-10T06:39:13,781   adding 'alpaca_eval/__init__.py'
2024-01-10T06:39:13,784   adding 'alpaca_eval/analyze.py'
2024-01-10T06:39:13,786   adding 'alpaca_eval/completion_parsers.py'
2024-01-10T06:39:13,788   adding 'alpaca_eval/constants.py'
2024-01-10T06:39:13,791   adding 'alpaca_eval/main.py'
2024-01-10T06:39:13,793   adding 'alpaca_eval/metrics.py'
2024-01-10T06:39:13,795   adding 'alpaca_eval/plotting.py'
2024-01-10T06:39:13,797   adding 'alpaca_eval/processors.py'
2024-01-10T06:39:13,799   adding 'alpaca_eval/types.py'
2024-01-10T06:39:13,801   adding 'alpaca_eval/utils.py'
2024-01-10T06:39:13,803   adding 'alpaca_eval/annotators/__init__.py'
2024-01-10T06:39:13,807   adding 'alpaca_eval/annotators/base.py'
2024-01-10T06:39:13,809   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-01-10T06:39:13,811   adding 'alpaca_eval/decoders/__init__.py'
2024-01-10T06:39:13,813   adding 'alpaca_eval/decoders/anthropic.py'
2024-01-10T06:39:13,815   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-01-10T06:39:13,816   adding 'alpaca_eval/decoders/cohere.py'
2024-01-10T06:39:13,818   adding 'alpaca_eval/decoders/google.py'
2024-01-10T06:39:13,819   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-01-10T06:39:13,821   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-01-10T06:39:13,822   adding 'alpaca_eval/decoders/jinachat.py'
2024-01-10T06:39:13,824   adding 'alpaca_eval/decoders/openai.py'
2024-01-10T06:39:13,826   adding 'alpaca_eval/decoders/replicate.py'
2024-01-10T06:39:13,827   adding 'alpaca_eval/decoders/vllm_local.py'
2024-01-10T06:39:13,830   adding 'alpaca_eval/evaluators_configs/README.md'
2024-01-10T06:39:13,832   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-01-10T06:39:13,833   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-01-10T06:39:13,835   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-01-10T06:39:13,836   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-01-10T06:39:13,838   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-10T06:39:13,839   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-01-10T06:39:13,841   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-01-10T06:39:13,842   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-01-10T06:39:13,844   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-01-10T06:39:13,845   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-01-10T06:39:13,847   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-01-10T06:39:13,848   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-01-10T06:39:13,850   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-10T06:39:13,852   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-01-10T06:39:13,854   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-01-10T06:39:13,855   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-01-10T06:39:13,857   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-01-10T06:39:13,858   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-01-10T06:39:13,859   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-01-10T06:39:13,861   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-01-10T06:39:13,862   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-01-10T06:39:13,864   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-01-10T06:39:13,865   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-01-10T06:39:13,866   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-01-10T06:39:13,868   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-01-10T06:39:13,870   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-01-10T06:39:13,871   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-01-10T06:39:13,873   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-01-10T06:39:13,875   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-01-10T06:39:13,877   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-01-10T06:39:13,878   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-01-10T06:39:13,880   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-01-10T06:39:13,881   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-01-10T06:39:13,883   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-01-10T06:39:13,884   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-01-10T06:39:13,886   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-01-10T06:39:13,887   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-01-10T06:39:13,889   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-01-10T06:39:13,890   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-01-10T06:39:13,892   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-01-10T06:39:13,894   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-01-10T06:39:13,895   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-01-10T06:39:13,897   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-01-10T06:39:13,898   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-10T06:39:13,900   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-01-10T06:39:13,902   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-01-10T06:39:13,905   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-01-10T06:39:13,906   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-01-10T06:39:13,908   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-01-10T06:39:13,909   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-01-10T06:39:13,911   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-01-10T06:39:13,913   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-01-10T06:39:13,915   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-01-10T06:39:13,917   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-01-10T06:39:13,919   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-01-10T06:39:13,922   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-01-10T06:39:13,924   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-01-10T06:39:13,926   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-01-10T06:39:13,929   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-01-10T06:39:13,930   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-01-10T06:39:13,932   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-01-10T06:39:13,933   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-01-10T06:39:13,934   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-01-10T06:39:13,936   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-01-10T06:39:13,938   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-01-10T06:39:13,941   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-01-10T06:39:13,942   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-01-10T06:39:13,943   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-01-10T06:39:13,945   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-01-10T06:39:13,946   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-01-10T06:39:13,948   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-01-10T06:39:13,949   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-01-10T06:39:13,951   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-01-10T06:39:13,955   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-01-10T06:39:13,956   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-01-10T06:39:13,959   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-01-10T06:39:13,961   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-01-10T06:39:13,962   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-01-10T06:39:13,964   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-01-10T06:39:13,966   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-01-10T06:39:13,967   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-01-10T06:39:13,968   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-01-10T06:39:13,970   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-01-10T06:39:13,971   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-01-10T06:39:13,974   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-01-10T06:39:14,196   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-01-10T06:39:14,197   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-01-10T06:39:14,199   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-01-10T06:39:14,200   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-01-10T06:39:14,201   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-01-10T06:39:14,203   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-01-10T06:39:14,204   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-01-10T06:39:14,206   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-01-10T06:39:14,207   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-01-10T06:39:14,208   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-01-10T06:39:14,210   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-01-10T06:39:14,212   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-01-10T06:39:14,213   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-01-10T06:39:14,215   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-01-10T06:39:14,216   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-01-10T06:39:14,218   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-01-10T06:39:14,219   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-01-10T06:39:14,220   adding 'alpaca_eval/models_configs/chatgpt/configs.yaml'
2024-01-10T06:39:14,222   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-01-10T06:39:14,223   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-01-10T06:39:14,224   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-01-10T06:39:14,226   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-01-10T06:39:14,227   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-01-10T06:39:14,229   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-01-10T06:39:14,230   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-01-10T06:39:14,231   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-01-10T06:39:14,232   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-01-10T06:39:14,234   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-01-10T06:39:14,235   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-01-10T06:39:14,237   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-01-10T06:39:14,239   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-01-10T06:39:14,240   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-01-10T06:39:14,242   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-01-10T06:39:14,243   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-01-10T06:39:14,244   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-10T06:39:14,246   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-01-10T06:39:14,247   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-01-10T06:39:14,248   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-01-10T06:39:14,250   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-01-10T06:39:14,251   adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt'
2024-01-10T06:39:14,252   adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml'
2024-01-10T06:39:14,254   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-01-10T06:39:14,255   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-01-10T06:39:14,257   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-01-10T06:39:14,258   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-01-10T06:39:14,260   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-01-10T06:39:14,261   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-01-10T06:39:14,263   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-01-10T06:39:14,264   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-01-10T06:39:14,266   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-01-10T06:39:14,267   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-01-10T06:39:14,268   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-01-10T06:39:14,270   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-01-10T06:39:14,272   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-01-10T06:39:14,273   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-01-10T06:39:14,275   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-01-10T06:39:14,276   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-01-10T06:39:14,277   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-01-10T06:39:14,279   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-01-10T06:39:14,280   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-01-10T06:39:14,282   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-01-10T06:39:14,283   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-01-10T06:39:14,285   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-01-10T06:39:14,286   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-01-10T06:39:14,287   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-01-10T06:39:14,288   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-01-10T06:39:14,290   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-01-10T06:39:14,292   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-01-10T06:39:14,293   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-01-10T06:39:14,294   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-01-10T06:39:14,295   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-01-10T06:39:14,297   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-01-10T06:39:14,298   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-01-10T06:39:14,299   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-01-10T06:39:14,301   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-01-10T06:39:14,302   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-01-10T06:39:14,304   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-01-10T06:39:14,306   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-01-10T06:39:14,307   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-01-10T06:39:14,308   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-01-10T06:39:14,310   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-01-10T06:39:14,311   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-01-10T06:39:14,313   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-01-10T06:39:14,314   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-01-10T06:39:14,315   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-01-10T06:39:14,317   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-01-10T06:39:14,319   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-01-10T06:39:14,320   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-01-10T06:39:14,321   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-01-10T06:39:14,323   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-01-10T06:39:14,324   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-01-10T06:39:14,326   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-01-10T06:39:14,328   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-01-10T06:39:14,329   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-01-10T06:39:14,331   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-01-10T06:39:14,332   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-01-10T06:39:14,334   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-01-10T06:39:14,335   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-01-10T06:39:14,337   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-01-10T06:39:14,338   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-01-10T06:39:14,340   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-01-10T06:39:14,341   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-01-10T06:39:14,342   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-01-10T06:39:14,344   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-01-10T06:39:14,346   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-01-10T06:39:14,347   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-01-10T06:39:14,349   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-01-10T06:39:14,350   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-01-10T06:39:14,352   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-01-10T06:39:14,353   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-01-10T06:39:14,354   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-01-10T06:39:14,356   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-01-10T06:39:14,357   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-01-10T06:39:14,358   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-01-10T06:39:14,360   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-01-10T06:39:14,361   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-01-10T06:39:14,362   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-01-10T06:39:14,363   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-01-10T06:39:14,365   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-01-10T06:39:14,366   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-01-10T06:39:14,368   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-01-10T06:39:14,370   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-01-10T06:39:14,371   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-01-10T06:39:14,373   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-01-10T06:39:14,374   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-01-10T06:39:14,375   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-01-10T06:39:14,377   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-01-10T06:39:14,378   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-01-10T06:39:14,380   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-01-10T06:39:14,381   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-01-10T06:39:14,383   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-01-10T06:39:14,384   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-01-10T06:39:14,386   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-01-10T06:39:14,387   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-01-10T06:39:14,389   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-01-10T06:39:14,390   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-01-10T06:39:14,391   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-01-10T06:39:14,394   adding 'alpaca_eval-0.5.1.dist-info/LICENSE'
2024-01-10T06:39:14,405   adding 'alpaca_eval-0.5.1.dist-info/METADATA'
2024-01-10T06:39:14,406   adding 'alpaca_eval-0.5.1.dist-info/WHEEL'
2024-01-10T06:39:14,407   adding 'alpaca_eval-0.5.1.dist-info/entry_points.txt'
2024-01-10T06:39:14,408   adding 'alpaca_eval-0.5.1.dist-info/top_level.txt'
2024-01-10T06:39:14,412   adding 'alpaca_eval-0.5.1.dist-info/RECORD'
2024-01-10T06:39:14,419   removing build/bdist.linux-armv7l/wheel
2024-01-10T06:39:14,650   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-01-10T06:39:14,655   Created wheel for alpaca-eval: filename=alpaca_eval-0.5.1-py3-none-any.whl size=230155 sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65
2024-01-10T06:39:14,656   Stored in directory: /tmp/pip-ephem-wheel-cache-ygov_oj8/wheels/8d/d1/90/41106dfcbba68b61bb1a5b834de354f371162a5b10b1c75bc4
2024-01-10T06:39:14,686 Successfully built alpaca-eval
2024-01-10T06:39:14,694 Removed build tracker: '/tmp/pip-build-tracker-fqkejeus'