2024-03-20T03:49:57,056 Created temporary directory: /tmp/pip-build-tracker-0jia3bmj 2024-03-20T03:49:57,058 Initialized build tracking at /tmp/pip-build-tracker-0jia3bmj 2024-03-20T03:49:57,058 Created build tracker: /tmp/pip-build-tracker-0jia3bmj 2024-03-20T03:49:57,059 Entered build tracker: /tmp/pip-build-tracker-0jia3bmj 2024-03-20T03:49:57,060 Created temporary directory: /tmp/pip-wheel-7axvqz1c 2024-03-20T03:49:57,063 Created temporary directory: /tmp/pip-ephem-wheel-cache-_h_tbtpq 2024-03-20T03:49:57,088 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-20T03:49:57,092 2 location(s) to search for versions of alpaca-eval: 2024-03-20T03:49:57,092 * https://pypi.org/simple/alpaca-eval/ 2024-03-20T03:49:57,092 * https://www.piwheels.org/simple/alpaca-eval/ 2024-03-20T03:49:57,093 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2024-03-20T03:49:57,093 Getting page https://pypi.org/simple/alpaca-eval/ 2024-03-20T03:49:57,095 Found index url https://pypi.org/simple/ 2024-03-20T03:49:57,318 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2024-03-20T03:49:57,330 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,331 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2024-03-20T03:49:57,332 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,333 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2024-03-20T03:49:57,333 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,335 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2024-03-20T03:49:57,335 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,336 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2024-03-20T03:49:57,337 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,338 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2024-03-20T03:49:57,339 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,340 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2024-03-20T03:49:57,341 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,342 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2024-03-20T03:49:57,343 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,344 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2024-03-20T03:49:57,345 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,346 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2024-03-20T03:49:57,346 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,347 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2024-03-20T03:49:57,348 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,349 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2024-03-20T03:49:57,350 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,351 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2024-03-20T03:49:57,352 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,353 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2024-03-20T03:49:57,354 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,355 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2024-03-20T03:49:57,355 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,356 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2024-03-20T03:49:57,357 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,357 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2024-03-20T03:49:57,358 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,359 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2024-03-20T03:49:57,360 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,361 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2024-03-20T03:49:57,361 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,362 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2024-03-20T03:49:57,363 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,364 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2024-03-20T03:49:57,365 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,366 Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2 2024-03-20T03:49:57,367 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,367 Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3 2024-03-20T03:49:57,368 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,369 Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4 2024-03-20T03:49:57,369 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,370 Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5 2024-03-20T03:49:57,371 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,372 Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6 2024-03-20T03:49:57,373 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,374 Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0 2024-03-20T03:49:57,374 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,375 Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1 2024-03-20T03:49:57,376 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,377 Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2 2024-03-20T03:49:57,378 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/c5/fd50a3126e6f0752c6ee6f406edc79585f5c6b68c76365c5d35aa32c675c/alpaca_eval-0.5.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,379 Found link https://files.pythonhosted.org/packages/66/6e/5b3b57dcfb28c61a5d0cbce3ad779c33a854558e2f973fab749a0693046a/alpaca_eval-0.5.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.3 2024-03-20T03:49:57,379 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b7/85/4319a4362221b12262bb92c2341ae7243237d35d99d19692d279b55bfb69/alpaca_eval-0.5.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,380 Found link https://files.pythonhosted.org/packages/44/5c/d3929e0e711b9a90a7959bc456fc62e8de29037989280993fdc77711df98/alpaca_eval-0.5.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.4 2024-03-20T03:49:57,381 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/82/d0/e249da2e02481e28f8ae203caa91907e413fe368b21e13d84b1e0833cbd7/alpaca_eval-0.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,381 Found link https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.6 2024-03-20T03:49:57,382 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2024-03-20T03:49:57,383 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2024-03-20T03:49:57,384 Found index url https://www.piwheels.org/simple/ 2024-03-20T03:49:57,603 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2024-03-20T03:49:57,611 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.4-py3-none-any.whl#sha256=a0f8535ecaf407cb62a473abae852656b9ee46b9917802a9ed3814fe22639785 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,612 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.3-py3-none-any.whl#sha256=35930f87a182347defc4133271b1411fc77fe815f0f9a737a9d7727cd5438189 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,613 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.2-py3-none-any.whl#sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,613 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,614 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,615 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,616 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,617 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,618 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,618 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,619 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,619 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,620 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,620 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,621 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,621 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,622 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,623 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,623 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,624 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,624 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,625 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,626 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2024-03-20T03:49:57,626 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,627 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,627 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2024-03-20T03:49:57,628 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2024-03-20T03:49:57,629 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2024-03-20T03:49:57,650 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2024-03-20T03:49:57,668 Collecting alpaca-eval==0.6 2024-03-20T03:49:57,671 Created temporary directory: /tmp/pip-unpack-12gs51cr 2024-03-20T03:49:57,890 Downloading alpaca_eval-0.6.tar.gz (363 kB) 2024-03-20T03:49:59,133 Added alpaca-eval==0.6 from https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz to build tracker '/tmp/pip-build-tracker-0jia3bmj' 2024-03-20T03:49:59,135 Running setup.py (path:/tmp/pip-wheel-7axvqz1c/alpaca-eval_a231f3387337420c930c456f3a9010e3/setup.py) egg_info for package alpaca-eval 2024-03-20T03:49:59,136 Created temporary directory: /tmp/pip-pip-egg-info-wickrss7 2024-03-20T03:49:59,137 Preparing metadata (setup.py): started 2024-03-20T03:49:59,138 Running command python setup.py egg_info 2024-03-20T03:50:00,431 running egg_info 2024-03-20T03:50:00,432 creating /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info 2024-03-20T03:50:00,457 writing /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/PKG-INFO 2024-03-20T03:50:00,478 writing dependency_links to /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/dependency_links.txt 2024-03-20T03:50:00,479 writing entry points to /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/entry_points.txt 2024-03-20T03:50:00,488 writing requirements to /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/requires.txt 2024-03-20T03:50:00,490 writing top-level names to /tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/top_level.txt 2024-03-20T03:50:00,492 writing manifest file '/tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/SOURCES.txt' 2024-03-20T03:50:00,580 reading manifest file '/tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/SOURCES.txt' 2024-03-20T03:50:00,582 reading manifest template 'MANIFEST.in' 2024-03-20T03:50:01,040 adding license file 'LICENSE' 2024-03-20T03:50:01,052 writing manifest file '/tmp/pip-pip-egg-info-wickrss7/alpaca_eval.egg-info/SOURCES.txt' 2024-03-20T03:50:01,171 Preparing metadata (setup.py): finished with status 'done' 2024-03-20T03:50:01,184 Source in /tmp/pip-wheel-7axvqz1c/alpaca-eval_a231f3387337420c930c456f3a9010e3 has version 0.6, which satisfies requirement alpaca-eval==0.6 from https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz 2024-03-20T03:50:01,185 Removed alpaca-eval==0.6 from https://files.pythonhosted.org/packages/fd/be/5625495fcb0b4c7b7accc048c88b7c7f59035e3b473e9c3e010632d22810/alpaca_eval-0.6.tar.gz from build tracker '/tmp/pip-build-tracker-0jia3bmj' 2024-03-20T03:50:01,206 Created temporary directory: /tmp/pip-unpack-jz2hdt77 2024-03-20T03:50:01,207 Created temporary directory: /tmp/pip-unpack-1zgro19_ 2024-03-20T03:50:01,361 Building wheels for collected packages: alpaca-eval 2024-03-20T03:50:01,366 Created temporary directory: /tmp/pip-wheel-pkiqhpbp 2024-03-20T03:50:01,367 Building wheel for alpaca-eval (setup.py): started 2024-03-20T03:50:01,368 Destination directory: /tmp/pip-wheel-pkiqhpbp 2024-03-20T03:50:01,369 Running command python setup.py bdist_wheel 2024-03-20T03:50:02,465 running bdist_wheel 2024-03-20T03:50:02,567 running build 2024-03-20T03:50:02,567 running build_py 2024-03-20T03:50:02,597 creating build 2024-03-20T03:50:02,598 creating build/lib 2024-03-20T03:50:02,599 creating build/lib/alpaca_eval 2024-03-20T03:50:02,601 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,603 copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,606 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,609 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,613 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,616 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,619 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,623 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,630 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2024-03-20T03:50:02,636 creating build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,637 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,640 copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,643 copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,645 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,648 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,651 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,653 copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,656 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,659 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,662 copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,665 copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders 2024-03-20T03:50:02,668 creating build/lib/alpaca_eval/metrics 2024-03-20T03:50:02,670 copying src/alpaca_eval/metrics/winrate.py -> build/lib/alpaca_eval/metrics 2024-03-20T03:50:02,672 copying src/alpaca_eval/metrics/__init__.py -> build/lib/alpaca_eval/metrics 2024-03-20T03:50:02,675 copying src/alpaca_eval/metrics/helpers.py -> build/lib/alpaca_eval/metrics 2024-03-20T03:50:02,679 copying src/alpaca_eval/metrics/glm_winrate.py -> build/lib/alpaca_eval/metrics 2024-03-20T03:50:02,684 creating build/lib/alpaca_eval/annotators 2024-03-20T03:50:02,685 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2024-03-20T03:50:02,688 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2024-03-20T03:50:02,692 copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators 2024-03-20T03:50:02,697 running egg_info 2024-03-20T03:50:02,760 writing src/alpaca_eval.egg-info/PKG-INFO 2024-03-20T03:50:02,785 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2024-03-20T03:50:02,787 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2024-03-20T03:50:02,796 writing requirements to src/alpaca_eval.egg-info/requires.txt 2024-03-20T03:50:02,798 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2024-03-20T03:50:02,832 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2024-03-20T03:50:02,842 reading manifest template 'MANIFEST.in' 2024-03-20T03:50:04,041 adding license file 'LICENSE' 2024-03-20T03:50:04,071 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2024-03-20T03:50:04,084 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2024-03-20T03:50:04,085 !! 2024-03-20T03:50:04,087 ******************************************************************************** 2024-03-20T03:50:04,087 ############################ 2024-03-20T03:50:04,090 # Package would be ignored # 2024-03-20T03:50:04,090 ############################ 2024-03-20T03:50:04,091 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2024-03-20T03:50:04,092 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,093 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,094 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2024-03-20T03:50:04,098 to the `packages` configuration field. 2024-03-20T03:50:04,103 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,104 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,104 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,110 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,111 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,112 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2024-03-20T03:50:04,113 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2024-03-20T03:50:04,114 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,114 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,115 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,122 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,127 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,129 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,130 even if it does not contain any `.py` files. 2024-03-20T03:50:04,131 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,132 directory, all directories are treated like packages. 2024-03-20T03:50:04,132 ******************************************************************************** 2024-03-20T03:50:04,134 !! 2024-03-20T03:50:04,135 check.warn(importable) 2024-03-20T03:50:04,136 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:04,137 !! 2024-03-20T03:50:04,139 ******************************************************************************** 2024-03-20T03:50:04,140 ############################ 2024-03-20T03:50:04,140 # Package would be ignored # 2024-03-20T03:50:04,141 ############################ 2024-03-20T03:50:04,141 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:04,142 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,143 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,144 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added 2024-03-20T03:50:04,144 to the `packages` configuration field. 2024-03-20T03:50:04,146 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,146 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,150 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,151 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,153 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,155 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are 2024-03-20T03:50:04,155 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via 2024-03-20T03:50:04,158 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,162 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,162 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,164 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,165 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,167 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,168 even if it does not contain any `.py` files. 2024-03-20T03:50:04,169 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,170 directory, all directories are treated like packages. 2024-03-20T03:50:04,170 ******************************************************************************** 2024-03-20T03:50:04,173 !! 2024-03-20T03:50:04,174 check.warn(importable) 2024-03-20T03:50:04,175 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:04,176 !! 2024-03-20T03:50:04,178 ******************************************************************************** 2024-03-20T03:50:04,178 ############################ 2024-03-20T03:50:04,179 # Package would be ignored # 2024-03-20T03:50:04,180 ############################ 2024-03-20T03:50:04,180 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:04,181 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,182 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,186 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added 2024-03-20T03:50:04,186 to the `packages` configuration field. 2024-03-20T03:50:04,188 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,189 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,190 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,191 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,193 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,194 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are 2024-03-20T03:50:04,195 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via 2024-03-20T03:50:04,196 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,197 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,197 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,206 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,207 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,210 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,211 even if it does not contain any `.py` files. 2024-03-20T03:50:04,212 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,212 directory, all directories are treated like packages. 2024-03-20T03:50:04,213 ******************************************************************************** 2024-03-20T03:50:04,214 !! 2024-03-20T03:50:04,215 check.warn(importable) 2024-03-20T03:50:04,216 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration. 2024-03-20T03:50:04,216 !! 2024-03-20T03:50:04,218 ******************************************************************************** 2024-03-20T03:50:04,219 ############################ 2024-03-20T03:50:04,219 # Package would be ignored # 2024-03-20T03:50:04,221 ############################ 2024-03-20T03:50:04,222 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1], 2024-03-20T03:50:04,222 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,224 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,226 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added 2024-03-20T03:50:04,226 to the `packages` configuration field. 2024-03-20T03:50:04,228 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,229 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,230 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,231 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,235 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,237 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are 2024-03-20T03:50:04,238 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via 2024-03-20T03:50:04,238 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,239 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,240 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,242 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,244 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,246 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,247 even if it does not contain any `.py` files. 2024-03-20T03:50:04,247 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,248 directory, all directories are treated like packages. 2024-03-20T03:50:04,249 ******************************************************************************** 2024-03-20T03:50:04,250 !! 2024-03-20T03:50:04,251 check.warn(importable) 2024-03-20T03:50:04,251 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:04,252 !! 2024-03-20T03:50:04,253 ******************************************************************************** 2024-03-20T03:50:04,254 ############################ 2024-03-20T03:50:04,255 # Package would be ignored # 2024-03-20T03:50:04,255 ############################ 2024-03-20T03:50:04,256 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2024-03-20T03:50:04,258 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,259 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,260 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2024-03-20T03:50:04,261 to the `packages` configuration field. 2024-03-20T03:50:04,262 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,263 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,264 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,266 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,267 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,269 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2024-03-20T03:50:04,270 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2024-03-20T03:50:04,271 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,272 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,273 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,279 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,286 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,288 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,289 even if it does not contain any `.py` files. 2024-03-20T03:50:04,289 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,290 directory, all directories are treated like packages. 2024-03-20T03:50:04,291 ******************************************************************************** 2024-03-20T03:50:04,293 !! 2024-03-20T03:50:04,295 check.warn(importable) 2024-03-20T03:50:04,296 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration. 2024-03-20T03:50:04,296 !! 2024-03-20T03:50:04,300 ******************************************************************************** 2024-03-20T03:50:04,301 ############################ 2024-03-20T03:50:04,302 # Package would be ignored # 2024-03-20T03:50:04,304 ############################ 2024-03-20T03:50:04,305 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1], 2024-03-20T03:50:04,306 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,314 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,314 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added 2024-03-20T03:50:04,315 to the `packages` configuration field. 2024-03-20T03:50:04,317 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,318 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,318 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,320 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,322 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,324 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are 2024-03-20T03:50:04,325 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via 2024-03-20T03:50:04,325 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,326 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,327 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,328 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,330 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,332 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,332 even if it does not contain any `.py` files. 2024-03-20T03:50:04,333 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,334 directory, all directories are treated like packages. 2024-03-20T03:50:04,334 ******************************************************************************** 2024-03-20T03:50:04,336 !! 2024-03-20T03:50:04,336 check.warn(importable) 2024-03-20T03:50:04,337 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration. 2024-03-20T03:50:04,338 !! 2024-03-20T03:50:04,339 ******************************************************************************** 2024-03-20T03:50:04,340 ############################ 2024-03-20T03:50:04,341 # Package would be ignored # 2024-03-20T03:50:04,341 ############################ 2024-03-20T03:50:04,342 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1], 2024-03-20T03:50:04,343 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,344 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,345 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added 2024-03-20T03:50:04,346 to the `packages` configuration field. 2024-03-20T03:50:04,347 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,348 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,349 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,351 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,354 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,356 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are 2024-03-20T03:50:04,356 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via 2024-03-20T03:50:04,357 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,357 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,358 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,359 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,360 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,363 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,363 even if it does not contain any `.py` files. 2024-03-20T03:50:04,364 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,365 directory, all directories are treated like packages. 2024-03-20T03:50:04,366 ******************************************************************************** 2024-03-20T03:50:04,370 !! 2024-03-20T03:50:04,371 check.warn(importable) 2024-03-20T03:50:04,372 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2024-03-20T03:50:04,373 !! 2024-03-20T03:50:04,374 ******************************************************************************** 2024-03-20T03:50:04,375 ############################ 2024-03-20T03:50:04,375 # Package would be ignored # 2024-03-20T03:50:04,376 ############################ 2024-03-20T03:50:04,377 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2024-03-20T03:50:04,378 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,379 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,380 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2024-03-20T03:50:04,380 to the `packages` configuration field. 2024-03-20T03:50:04,382 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,383 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,384 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,386 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,388 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,394 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2024-03-20T03:50:04,394 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2024-03-20T03:50:04,395 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,396 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,397 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,398 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,400 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,402 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,403 even if it does not contain any `.py` files. 2024-03-20T03:50:04,404 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,405 directory, all directories are treated like packages. 2024-03-20T03:50:04,406 ******************************************************************************** 2024-03-20T03:50:04,407 !! 2024-03-20T03:50:04,408 check.warn(importable) 2024-03-20T03:50:04,408 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration. 2024-03-20T03:50:04,409 !! 2024-03-20T03:50:04,411 ******************************************************************************** 2024-03-20T03:50:04,411 ############################ 2024-03-20T03:50:04,412 # Package would be ignored # 2024-03-20T03:50:04,413 ############################ 2024-03-20T03:50:04,413 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1], 2024-03-20T03:50:04,414 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,415 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,416 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added 2024-03-20T03:50:04,417 to the `packages` configuration field. 2024-03-20T03:50:04,418 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,419 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,420 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,422 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,423 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,425 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are 2024-03-20T03:50:04,426 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via 2024-03-20T03:50:04,427 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,428 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,429 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,430 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,432 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,434 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,435 even if it does not contain any `.py` files. 2024-03-20T03:50:04,436 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,437 directory, all directories are treated like packages. 2024-03-20T03:50:04,437 ******************************************************************************** 2024-03-20T03:50:04,439 !! 2024-03-20T03:50:04,440 check.warn(importable) 2024-03-20T03:50:04,440 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2024-03-20T03:50:04,441 !! 2024-03-20T03:50:04,443 ******************************************************************************** 2024-03-20T03:50:04,444 ############################ 2024-03-20T03:50:04,445 # Package would be ignored # 2024-03-20T03:50:04,445 ############################ 2024-03-20T03:50:04,446 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2024-03-20T03:50:04,447 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,449 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,450 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2024-03-20T03:50:04,450 to the `packages` configuration field. 2024-03-20T03:50:04,452 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,452 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,453 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,454 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,456 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,457 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2024-03-20T03:50:04,457 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2024-03-20T03:50:04,462 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,462 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,463 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,464 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,465 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,467 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,468 even if it does not contain any `.py` files. 2024-03-20T03:50:04,469 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,469 directory, all directories are treated like packages. 2024-03-20T03:50:04,470 ******************************************************************************** 2024-03-20T03:50:04,472 !! 2024-03-20T03:50:04,473 check.warn(importable) 2024-03-20T03:50:04,473 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:04,474 !! 2024-03-20T03:50:04,476 ******************************************************************************** 2024-03-20T03:50:04,476 ############################ 2024-03-20T03:50:04,477 # Package would be ignored # 2024-03-20T03:50:04,478 ############################ 2024-03-20T03:50:04,478 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2024-03-20T03:50:04,479 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,480 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,481 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2024-03-20T03:50:04,482 to the `packages` configuration field. 2024-03-20T03:50:04,483 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,484 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,485 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,486 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,487 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,489 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2024-03-20T03:50:04,489 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2024-03-20T03:50:04,490 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,491 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,492 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,493 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,494 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,496 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,496 even if it does not contain any `.py` files. 2024-03-20T03:50:04,497 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,498 directory, all directories are treated like packages. 2024-03-20T03:50:04,499 ******************************************************************************** 2024-03-20T03:50:04,500 !! 2024-03-20T03:50:04,501 check.warn(importable) 2024-03-20T03:50:04,501 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:04,502 !! 2024-03-20T03:50:04,504 ******************************************************************************** 2024-03-20T03:50:04,504 ############################ 2024-03-20T03:50:04,505 # Package would be ignored # 2024-03-20T03:50:04,506 ############################ 2024-03-20T03:50:04,507 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2024-03-20T03:50:04,507 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,509 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,509 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2024-03-20T03:50:04,510 to the `packages` configuration field. 2024-03-20T03:50:04,511 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,512 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,512 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,514 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,515 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,516 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2024-03-20T03:50:04,517 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2024-03-20T03:50:04,518 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,518 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,519 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,521 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,522 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,524 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,524 even if it does not contain any `.py` files. 2024-03-20T03:50:04,525 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,526 directory, all directories are treated like packages. 2024-03-20T03:50:04,526 ******************************************************************************** 2024-03-20T03:50:04,528 !! 2024-03-20T03:50:04,528 check.warn(importable) 2024-03-20T03:50:04,529 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration. 2024-03-20T03:50:04,530 !! 2024-03-20T03:50:04,531 ******************************************************************************** 2024-03-20T03:50:04,532 ############################ 2024-03-20T03:50:04,533 # Package would be ignored # 2024-03-20T03:50:04,533 ############################ 2024-03-20T03:50:04,534 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1], 2024-03-20T03:50:04,536 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,537 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,538 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added 2024-03-20T03:50:04,538 to the `packages` configuration field. 2024-03-20T03:50:04,540 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,540 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,541 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,542 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,543 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,545 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are 2024-03-20T03:50:04,546 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via 2024-03-20T03:50:04,546 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,547 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,548 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,549 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,550 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,552 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,553 even if it does not contain any `.py` files. 2024-03-20T03:50:04,554 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,554 directory, all directories are treated like packages. 2024-03-20T03:50:04,555 ******************************************************************************** 2024-03-20T03:50:04,557 !! 2024-03-20T03:50:04,558 check.warn(importable) 2024-03-20T03:50:04,558 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration. 2024-03-20T03:50:04,559 !! 2024-03-20T03:50:04,560 ******************************************************************************** 2024-03-20T03:50:04,561 ############################ 2024-03-20T03:50:04,562 # Package would be ignored # 2024-03-20T03:50:04,562 ############################ 2024-03-20T03:50:04,563 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1], 2024-03-20T03:50:04,564 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,565 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,566 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added 2024-03-20T03:50:04,566 to the `packages` configuration field. 2024-03-20T03:50:04,568 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,569 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,570 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,571 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,572 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,573 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are 2024-03-20T03:50:04,574 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via 2024-03-20T03:50:04,575 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,575 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,576 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,577 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,578 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,580 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,581 even if it does not contain any `.py` files. 2024-03-20T03:50:04,581 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,582 directory, all directories are treated like packages. 2024-03-20T03:50:04,583 ******************************************************************************** 2024-03-20T03:50:04,584 !! 2024-03-20T03:50:04,585 check.warn(importable) 2024-03-20T03:50:04,585 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2024-03-20T03:50:04,586 !! 2024-03-20T03:50:04,587 ******************************************************************************** 2024-03-20T03:50:04,588 ############################ 2024-03-20T03:50:04,588 # Package would be ignored # 2024-03-20T03:50:04,589 ############################ 2024-03-20T03:50:04,589 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2024-03-20T03:50:04,590 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,591 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,592 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2024-03-20T03:50:04,593 to the `packages` configuration field. 2024-03-20T03:50:04,594 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,594 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,595 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,596 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,597 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,599 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2024-03-20T03:50:04,599 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2024-03-20T03:50:04,600 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,601 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,601 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,603 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,606 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,608 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,609 even if it does not contain any `.py` files. 2024-03-20T03:50:04,609 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,610 directory, all directories are treated like packages. 2024-03-20T03:50:04,611 ******************************************************************************** 2024-03-20T03:50:04,612 !! 2024-03-20T03:50:04,613 check.warn(importable) 2024-03-20T03:50:04,613 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2024-03-20T03:50:04,615 !! 2024-03-20T03:50:04,616 ******************************************************************************** 2024-03-20T03:50:04,617 ############################ 2024-03-20T03:50:04,617 # Package would be ignored # 2024-03-20T03:50:04,622 ############################ 2024-03-20T03:50:04,622 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2024-03-20T03:50:04,623 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,624 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,625 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2024-03-20T03:50:04,626 to the `packages` configuration field. 2024-03-20T03:50:04,633 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,634 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,635 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,636 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,637 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,639 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2024-03-20T03:50:04,639 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2024-03-20T03:50:04,640 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,641 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,641 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,643 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,644 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,646 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,647 even if it does not contain any `.py` files. 2024-03-20T03:50:04,648 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,649 directory, all directories are treated like packages. 2024-03-20T03:50:04,649 ******************************************************************************** 2024-03-20T03:50:04,651 !! 2024-03-20T03:50:04,652 check.warn(importable) 2024-03-20T03:50:04,653 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2024-03-20T03:50:04,653 !! 2024-03-20T03:50:04,655 ******************************************************************************** 2024-03-20T03:50:04,655 ############################ 2024-03-20T03:50:04,656 # Package would be ignored # 2024-03-20T03:50:04,657 ############################ 2024-03-20T03:50:04,658 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2024-03-20T03:50:04,659 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,660 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,660 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2024-03-20T03:50:04,661 to the `packages` configuration field. 2024-03-20T03:50:04,662 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,663 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,665 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,666 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,668 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2024-03-20T03:50:04,668 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2024-03-20T03:50:04,669 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,669 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,670 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,672 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,674 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,676 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,677 even if it does not contain any `.py` files. 2024-03-20T03:50:04,678 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,679 directory, all directories are treated like packages. 2024-03-20T03:50:04,680 ******************************************************************************** 2024-03-20T03:50:04,682 !! 2024-03-20T03:50:04,682 check.warn(importable) 2024-03-20T03:50:04,683 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration. 2024-03-20T03:50:04,684 !! 2024-03-20T03:50:04,685 ******************************************************************************** 2024-03-20T03:50:04,686 ############################ 2024-03-20T03:50:04,687 # Package would be ignored # 2024-03-20T03:50:04,688 ############################ 2024-03-20T03:50:04,688 Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1], 2024-03-20T03:50:04,689 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,691 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,691 package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added 2024-03-20T03:50:04,692 to the `packages` configuration field. 2024-03-20T03:50:04,693 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,694 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,695 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,696 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,698 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,699 If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are 2024-03-20T03:50:04,700 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via 2024-03-20T03:50:04,701 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,702 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,703 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,704 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,705 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,707 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,707 even if it does not contain any `.py` files. 2024-03-20T03:50:04,708 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,708 directory, all directories are treated like packages. 2024-03-20T03:50:04,709 ******************************************************************************** 2024-03-20T03:50:04,710 !! 2024-03-20T03:50:04,711 check.warn(importable) 2024-03-20T03:50:04,712 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is absent from the `packages` configuration. 2024-03-20T03:50:04,712 !! 2024-03-20T03:50:04,714 ******************************************************************************** 2024-03-20T03:50:04,715 ############################ 2024-03-20T03:50:04,715 # Package would be ignored # 2024-03-20T03:50:04,716 ############################ 2024-03-20T03:50:04,717 Python recognizes 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' as an importable package[^1], 2024-03-20T03:50:04,717 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,719 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,719 package, please make sure that 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' is explicitly added 2024-03-20T03:50:04,720 to the `packages` configuration field. 2024-03-20T03:50:04,721 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,722 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,723 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,726 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,727 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,728 If you don't want 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' to be distributed and are 2024-03-20T03:50:04,730 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_3_opus_ranking' via 2024-03-20T03:50:04,730 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,731 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,732 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,733 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,735 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,737 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,738 even if it does not contain any `.py` files. 2024-03-20T03:50:04,739 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,739 directory, all directories are treated like packages. 2024-03-20T03:50:04,740 ******************************************************************************** 2024-03-20T03:50:04,743 !! 2024-03-20T03:50:04,743 check.warn(importable) 2024-03-20T03:50:04,744 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2024-03-20T03:50:04,744 !! 2024-03-20T03:50:04,746 ******************************************************************************** 2024-03-20T03:50:04,746 ############################ 2024-03-20T03:50:04,748 # Package would be ignored # 2024-03-20T03:50:04,748 ############################ 2024-03-20T03:50:04,749 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2024-03-20T03:50:04,749 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,750 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,751 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2024-03-20T03:50:04,752 to the `packages` configuration field. 2024-03-20T03:50:04,753 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,754 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,754 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,756 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,757 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,762 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2024-03-20T03:50:04,763 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2024-03-20T03:50:04,764 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,767 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,768 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,770 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,772 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,774 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,775 even if it does not contain any `.py` files. 2024-03-20T03:50:04,776 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,776 directory, all directories are treated like packages. 2024-03-20T03:50:04,777 ******************************************************************************** 2024-03-20T03:50:04,778 !! 2024-03-20T03:50:04,779 check.warn(importable) 2024-03-20T03:50:04,780 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2024-03-20T03:50:04,781 !! 2024-03-20T03:50:04,782 ******************************************************************************** 2024-03-20T03:50:04,783 ############################ 2024-03-20T03:50:04,783 # Package would be ignored # 2024-03-20T03:50:04,784 ############################ 2024-03-20T03:50:04,785 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2024-03-20T03:50:04,786 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,787 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,788 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2024-03-20T03:50:04,788 to the `packages` configuration field. 2024-03-20T03:50:04,795 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,795 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,796 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,797 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,798 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,799 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2024-03-20T03:50:04,800 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2024-03-20T03:50:04,800 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,801 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,802 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,803 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,804 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,807 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,807 even if it does not contain any `.py` files. 2024-03-20T03:50:04,808 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,809 directory, all directories are treated like packages. 2024-03-20T03:50:04,810 ******************************************************************************** 2024-03-20T03:50:04,811 !! 2024-03-20T03:50:04,812 check.warn(importable) 2024-03-20T03:50:04,812 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2024-03-20T03:50:04,813 !! 2024-03-20T03:50:04,815 ******************************************************************************** 2024-03-20T03:50:04,815 ############################ 2024-03-20T03:50:04,816 # Package would be ignored # 2024-03-20T03:50:04,816 ############################ 2024-03-20T03:50:04,817 Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1], 2024-03-20T03:50:04,818 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,819 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,820 package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added 2024-03-20T03:50:04,821 to the `packages` configuration field. 2024-03-20T03:50:04,822 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,823 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,824 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,825 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,827 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,829 If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are 2024-03-20T03:50:04,829 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via 2024-03-20T03:50:04,830 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,831 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,831 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,833 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,834 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,836 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,837 even if it does not contain any `.py` files. 2024-03-20T03:50:04,837 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,838 directory, all directories are treated like packages. 2024-03-20T03:50:04,839 ******************************************************************************** 2024-03-20T03:50:04,840 !! 2024-03-20T03:50:04,841 check.warn(importable) 2024-03-20T03:50:04,841 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:04,842 !! 2024-03-20T03:50:04,843 ******************************************************************************** 2024-03-20T03:50:04,844 ############################ 2024-03-20T03:50:04,845 # Package would be ignored # 2024-03-20T03:50:04,845 ############################ 2024-03-20T03:50:04,846 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2024-03-20T03:50:04,847 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,848 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,849 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2024-03-20T03:50:04,849 to the `packages` configuration field. 2024-03-20T03:50:04,851 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,852 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,853 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,854 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,856 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,858 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2024-03-20T03:50:04,858 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2024-03-20T03:50:04,859 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,860 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,861 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,862 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,863 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,865 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,866 even if it does not contain any `.py` files. 2024-03-20T03:50:04,867 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,868 directory, all directories are treated like packages. 2024-03-20T03:50:04,868 ******************************************************************************** 2024-03-20T03:50:04,870 !! 2024-03-20T03:50:04,871 check.warn(importable) 2024-03-20T03:50:04,871 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:04,872 !! 2024-03-20T03:50:04,874 ******************************************************************************** 2024-03-20T03:50:04,874 ############################ 2024-03-20T03:50:04,876 # Package would be ignored # 2024-03-20T03:50:04,877 ############################ 2024-03-20T03:50:04,877 Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:04,878 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,879 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,880 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added 2024-03-20T03:50:04,881 to the `packages` configuration field. 2024-03-20T03:50:04,882 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,882 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,883 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,885 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,886 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,888 If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are 2024-03-20T03:50:04,888 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via 2024-03-20T03:50:04,889 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,890 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,891 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,892 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,893 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,896 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,896 even if it does not contain any `.py` files. 2024-03-20T03:50:04,897 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,898 directory, all directories are treated like packages. 2024-03-20T03:50:04,899 ******************************************************************************** 2024-03-20T03:50:04,900 !! 2024-03-20T03:50:04,901 check.warn(importable) 2024-03-20T03:50:04,902 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration. 2024-03-20T03:50:04,903 !! 2024-03-20T03:50:04,905 ******************************************************************************** 2024-03-20T03:50:04,906 ############################ 2024-03-20T03:50:04,906 # Package would be ignored # 2024-03-20T03:50:04,907 ############################ 2024-03-20T03:50:04,908 Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1], 2024-03-20T03:50:04,908 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,910 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,911 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added 2024-03-20T03:50:04,911 to the `packages` configuration field. 2024-03-20T03:50:04,913 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,913 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,914 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,916 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,918 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,920 If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are 2024-03-20T03:50:04,921 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via 2024-03-20T03:50:04,922 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,923 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,924 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,925 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,927 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,929 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,929 even if it does not contain any `.py` files. 2024-03-20T03:50:04,930 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,931 directory, all directories are treated like packages. 2024-03-20T03:50:04,931 ******************************************************************************** 2024-03-20T03:50:04,933 !! 2024-03-20T03:50:04,933 check.warn(importable) 2024-03-20T03:50:04,942 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration. 2024-03-20T03:50:04,943 !! 2024-03-20T03:50:04,944 ******************************************************************************** 2024-03-20T03:50:04,945 ############################ 2024-03-20T03:50:04,946 # Package would be ignored # 2024-03-20T03:50:04,947 ############################ 2024-03-20T03:50:04,949 Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1], 2024-03-20T03:50:04,950 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,951 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,952 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added 2024-03-20T03:50:04,953 to the `packages` configuration field. 2024-03-20T03:50:04,955 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,956 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,957 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,958 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,960 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,961 If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are 2024-03-20T03:50:04,962 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via 2024-03-20T03:50:04,963 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,963 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,964 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,965 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,967 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,969 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,969 even if it does not contain any `.py` files. 2024-03-20T03:50:04,970 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,970 directory, all directories are treated like packages. 2024-03-20T03:50:04,972 ******************************************************************************** 2024-03-20T03:50:04,973 !! 2024-03-20T03:50:04,974 check.warn(importable) 2024-03-20T03:50:04,975 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration. 2024-03-20T03:50:04,975 !! 2024-03-20T03:50:04,977 ******************************************************************************** 2024-03-20T03:50:04,977 ############################ 2024-03-20T03:50:04,978 # Package would be ignored # 2024-03-20T03:50:04,978 ############################ 2024-03-20T03:50:04,979 Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1], 2024-03-20T03:50:04,980 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:04,981 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:04,982 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added 2024-03-20T03:50:04,983 to the `packages` configuration field. 2024-03-20T03:50:04,984 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:04,985 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:04,986 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:04,987 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:04,988 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:04,990 If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are 2024-03-20T03:50:04,990 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via 2024-03-20T03:50:04,991 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:04,992 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:04,992 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:04,994 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:04,995 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:04,997 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:04,997 even if it does not contain any `.py` files. 2024-03-20T03:50:04,998 On the other hand, currently there is no concept of package data 2024-03-20T03:50:04,999 directory, all directories are treated like packages. 2024-03-20T03:50:04,999 ******************************************************************************** 2024-03-20T03:50:05,001 !! 2024-03-20T03:50:05,002 check.warn(importable) 2024-03-20T03:50:05,003 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration. 2024-03-20T03:50:05,003 !! 2024-03-20T03:50:05,005 ******************************************************************************** 2024-03-20T03:50:05,006 ############################ 2024-03-20T03:50:05,007 # Package would be ignored # 2024-03-20T03:50:05,008 ############################ 2024-03-20T03:50:05,009 Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1], 2024-03-20T03:50:05,010 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,012 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,013 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added 2024-03-20T03:50:05,013 to the `packages` configuration field. 2024-03-20T03:50:05,015 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,016 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,016 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,018 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,019 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,020 If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are 2024-03-20T03:50:05,021 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via 2024-03-20T03:50:05,022 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,023 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,023 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,024 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,025 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,027 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,028 even if it does not contain any `.py` files. 2024-03-20T03:50:05,028 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,029 directory, all directories are treated like packages. 2024-03-20T03:50:05,030 ******************************************************************************** 2024-03-20T03:50:05,031 !! 2024-03-20T03:50:05,032 check.warn(importable) 2024-03-20T03:50:05,032 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2024-03-20T03:50:05,033 !! 2024-03-20T03:50:05,034 ******************************************************************************** 2024-03-20T03:50:05,035 ############################ 2024-03-20T03:50:05,036 # Package would be ignored # 2024-03-20T03:50:05,036 ############################ 2024-03-20T03:50:05,037 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2024-03-20T03:50:05,038 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,039 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,040 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2024-03-20T03:50:05,041 to the `packages` configuration field. 2024-03-20T03:50:05,044 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,080 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,081 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,083 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,085 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,087 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2024-03-20T03:50:05,088 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2024-03-20T03:50:05,089 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,090 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,091 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,093 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,094 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,098 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,099 even if it does not contain any `.py` files. 2024-03-20T03:50:05,100 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,101 directory, all directories are treated like packages. 2024-03-20T03:50:05,320 ******************************************************************************** 2024-03-20T03:50:05,321 !! 2024-03-20T03:50:05,322 check.warn(importable) 2024-03-20T03:50:05,323 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:05,324 !! 2024-03-20T03:50:05,326 ******************************************************************************** 2024-03-20T03:50:05,327 ############################ 2024-03-20T03:50:05,328 # Package would be ignored # 2024-03-20T03:50:05,329 ############################ 2024-03-20T03:50:05,330 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2024-03-20T03:50:05,331 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,333 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,334 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2024-03-20T03:50:05,335 to the `packages` configuration field. 2024-03-20T03:50:05,337 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,337 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,338 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,340 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,342 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,344 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2024-03-20T03:50:05,344 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2024-03-20T03:50:05,345 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,346 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,347 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,349 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,351 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,354 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,354 even if it does not contain any `.py` files. 2024-03-20T03:50:05,355 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,356 directory, all directories are treated like packages. 2024-03-20T03:50:05,357 ******************************************************************************** 2024-03-20T03:50:05,359 !! 2024-03-20T03:50:05,359 check.warn(importable) 2024-03-20T03:50:05,360 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:05,362 !! 2024-03-20T03:50:05,363 ******************************************************************************** 2024-03-20T03:50:05,364 ############################ 2024-03-20T03:50:05,364 # Package would be ignored # 2024-03-20T03:50:05,365 ############################ 2024-03-20T03:50:05,366 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2024-03-20T03:50:05,367 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,369 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,369 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2024-03-20T03:50:05,370 to the `packages` configuration field. 2024-03-20T03:50:05,372 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,373 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,373 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,375 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,376 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,378 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2024-03-20T03:50:05,379 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2024-03-20T03:50:05,379 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,380 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,381 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,383 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,384 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,387 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,388 even if it does not contain any `.py` files. 2024-03-20T03:50:05,389 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,390 directory, all directories are treated like packages. 2024-03-20T03:50:05,391 ******************************************************************************** 2024-03-20T03:50:05,393 !! 2024-03-20T03:50:05,394 check.warn(importable) 2024-03-20T03:50:05,395 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:05,396 !! 2024-03-20T03:50:05,397 ******************************************************************************** 2024-03-20T03:50:05,398 ############################ 2024-03-20T03:50:05,399 # Package would be ignored # 2024-03-20T03:50:05,400 ############################ 2024-03-20T03:50:05,401 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2024-03-20T03:50:05,401 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,403 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,404 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2024-03-20T03:50:05,404 to the `packages` configuration field. 2024-03-20T03:50:05,405 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,406 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,407 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,408 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,409 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,410 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2024-03-20T03:50:05,410 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2024-03-20T03:50:05,411 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,411 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,412 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,412 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,413 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,415 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,415 even if it does not contain any `.py` files. 2024-03-20T03:50:05,416 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,417 directory, all directories are treated like packages. 2024-03-20T03:50:05,417 ******************************************************************************** 2024-03-20T03:50:05,418 !! 2024-03-20T03:50:05,419 check.warn(importable) 2024-03-20T03:50:05,420 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2024-03-20T03:50:05,420 !! 2024-03-20T03:50:05,422 ******************************************************************************** 2024-03-20T03:50:05,423 ############################ 2024-03-20T03:50:05,424 # Package would be ignored # 2024-03-20T03:50:05,424 ############################ 2024-03-20T03:50:05,425 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2024-03-20T03:50:05,426 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,427 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,428 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2024-03-20T03:50:05,428 to the `packages` configuration field. 2024-03-20T03:50:05,430 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,431 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,431 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,433 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,434 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,435 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2024-03-20T03:50:05,436 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2024-03-20T03:50:05,436 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,437 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,437 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,439 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,440 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,442 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,442 even if it does not contain any `.py` files. 2024-03-20T03:50:05,443 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,443 directory, all directories are treated like packages. 2024-03-20T03:50:05,444 ******************************************************************************** 2024-03-20T03:50:05,445 !! 2024-03-20T03:50:05,445 check.warn(importable) 2024-03-20T03:50:05,446 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2024-03-20T03:50:05,447 !! 2024-03-20T03:50:05,448 ******************************************************************************** 2024-03-20T03:50:05,448 ############################ 2024-03-20T03:50:05,449 # Package would be ignored # 2024-03-20T03:50:05,449 ############################ 2024-03-20T03:50:05,450 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2024-03-20T03:50:05,450 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,452 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,452 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2024-03-20T03:50:05,452 to the `packages` configuration field. 2024-03-20T03:50:05,454 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,454 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,455 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,456 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,457 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,462 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2024-03-20T03:50:05,463 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2024-03-20T03:50:05,463 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,464 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,465 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,466 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,467 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,469 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,469 even if it does not contain any `.py` files. 2024-03-20T03:50:05,470 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,471 directory, all directories are treated like packages. 2024-03-20T03:50:05,471 ******************************************************************************** 2024-03-20T03:50:05,473 !! 2024-03-20T03:50:05,473 check.warn(importable) 2024-03-20T03:50:05,474 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2024-03-20T03:50:05,475 !! 2024-03-20T03:50:05,476 ******************************************************************************** 2024-03-20T03:50:05,477 ############################ 2024-03-20T03:50:05,478 # Package would be ignored # 2024-03-20T03:50:05,478 ############################ 2024-03-20T03:50:05,479 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2024-03-20T03:50:05,480 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,481 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,481 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2024-03-20T03:50:05,482 to the `packages` configuration field. 2024-03-20T03:50:05,483 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,483 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,484 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,485 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,486 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,487 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2024-03-20T03:50:05,488 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2024-03-20T03:50:05,488 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,489 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,489 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,491 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,492 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,494 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,495 even if it does not contain any `.py` files. 2024-03-20T03:50:05,496 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,496 directory, all directories are treated like packages. 2024-03-20T03:50:05,497 ******************************************************************************** 2024-03-20T03:50:05,498 !! 2024-03-20T03:50:05,499 check.warn(importable) 2024-03-20T03:50:05,500 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:05,501 !! 2024-03-20T03:50:05,502 ******************************************************************************** 2024-03-20T03:50:05,503 ############################ 2024-03-20T03:50:05,503 # Package would be ignored # 2024-03-20T03:50:05,504 ############################ 2024-03-20T03:50:05,505 Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:05,505 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,507 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,507 package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added 2024-03-20T03:50:05,508 to the `packages` configuration field. 2024-03-20T03:50:05,509 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,510 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,511 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,512 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,513 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,515 If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are 2024-03-20T03:50:05,516 already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via 2024-03-20T03:50:05,517 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,517 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,518 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,519 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,520 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,522 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,523 even if it does not contain any `.py` files. 2024-03-20T03:50:05,523 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,524 directory, all directories are treated like packages. 2024-03-20T03:50:05,525 ******************************************************************************** 2024-03-20T03:50:05,526 !! 2024-03-20T03:50:05,527 check.warn(importable) 2024-03-20T03:50:05,528 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:05,528 !! 2024-03-20T03:50:05,529 ******************************************************************************** 2024-03-20T03:50:05,530 ############################ 2024-03-20T03:50:05,531 # Package would be ignored # 2024-03-20T03:50:05,531 ############################ 2024-03-20T03:50:05,532 Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:05,533 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,534 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,534 package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added 2024-03-20T03:50:05,535 to the `packages` configuration field. 2024-03-20T03:50:05,537 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,537 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,538 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,539 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,540 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,542 If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are 2024-03-20T03:50:05,542 already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via 2024-03-20T03:50:05,543 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,543 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,544 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,545 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,547 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,549 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,549 even if it does not contain any `.py` files. 2024-03-20T03:50:05,550 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,551 directory, all directories are treated like packages. 2024-03-20T03:50:05,552 ******************************************************************************** 2024-03-20T03:50:05,553 !! 2024-03-20T03:50:05,553 check.warn(importable) 2024-03-20T03:50:05,554 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2024-03-20T03:50:05,554 !! 2024-03-20T03:50:05,555 ******************************************************************************** 2024-03-20T03:50:05,556 ############################ 2024-03-20T03:50:05,556 # Package would be ignored # 2024-03-20T03:50:05,557 ############################ 2024-03-20T03:50:05,557 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2024-03-20T03:50:05,558 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,559 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,560 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2024-03-20T03:50:05,560 to the `packages` configuration field. 2024-03-20T03:50:05,561 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,562 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,562 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,563 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,565 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,566 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2024-03-20T03:50:05,566 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2024-03-20T03:50:05,567 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,568 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,568 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,570 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,571 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,573 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,574 even if it does not contain any `.py` files. 2024-03-20T03:50:05,574 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,575 directory, all directories are treated like packages. 2024-03-20T03:50:05,576 ******************************************************************************** 2024-03-20T03:50:05,577 !! 2024-03-20T03:50:05,577 check.warn(importable) 2024-03-20T03:50:05,578 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration. 2024-03-20T03:50:05,578 !! 2024-03-20T03:50:05,580 ******************************************************************************** 2024-03-20T03:50:05,580 ############################ 2024-03-20T03:50:05,581 # Package would be ignored # 2024-03-20T03:50:05,582 ############################ 2024-03-20T03:50:05,582 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1], 2024-03-20T03:50:05,583 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,585 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,586 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added 2024-03-20T03:50:05,586 to the `packages` configuration field. 2024-03-20T03:50:05,588 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,588 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,589 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,590 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,591 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,593 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are 2024-03-20T03:50:05,593 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via 2024-03-20T03:50:05,594 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,595 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,595 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,597 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,599 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,601 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,601 even if it does not contain any `.py` files. 2024-03-20T03:50:05,602 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,603 directory, all directories are treated like packages. 2024-03-20T03:50:05,603 ******************************************************************************** 2024-03-20T03:50:05,605 !! 2024-03-20T03:50:05,606 check.warn(importable) 2024-03-20T03:50:05,606 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2024-03-20T03:50:05,607 !! 2024-03-20T03:50:05,608 ******************************************************************************** 2024-03-20T03:50:05,609 ############################ 2024-03-20T03:50:05,610 # Package would be ignored # 2024-03-20T03:50:05,610 ############################ 2024-03-20T03:50:05,611 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2024-03-20T03:50:05,612 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,614 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,614 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2024-03-20T03:50:05,615 to the `packages` configuration field. 2024-03-20T03:50:05,616 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,617 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,618 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,619 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,621 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,622 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2024-03-20T03:50:05,623 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2024-03-20T03:50:05,624 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,624 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,626 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,627 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,628 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,630 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,630 even if it does not contain any `.py` files. 2024-03-20T03:50:05,631 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,631 directory, all directories are treated like packages. 2024-03-20T03:50:05,632 ******************************************************************************** 2024-03-20T03:50:05,634 !! 2024-03-20T03:50:05,634 check.warn(importable) 2024-03-20T03:50:05,635 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2024-03-20T03:50:05,635 !! 2024-03-20T03:50:05,637 ******************************************************************************** 2024-03-20T03:50:05,638 ############################ 2024-03-20T03:50:05,638 # Package would be ignored # 2024-03-20T03:50:05,639 ############################ 2024-03-20T03:50:05,640 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2024-03-20T03:50:05,640 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,642 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,643 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2024-03-20T03:50:05,644 to the `packages` configuration field. 2024-03-20T03:50:05,645 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,645 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,646 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,648 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,649 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,651 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2024-03-20T03:50:05,652 already explicitly excluding 'alpaca_eval.models_configs' via 2024-03-20T03:50:05,652 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,653 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,653 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,655 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,656 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,658 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,659 even if it does not contain any `.py` files. 2024-03-20T03:50:05,660 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,660 directory, all directories are treated like packages. 2024-03-20T03:50:05,661 ******************************************************************************** 2024-03-20T03:50:05,662 !! 2024-03-20T03:50:05,664 check.warn(importable) 2024-03-20T03:50:05,664 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration. 2024-03-20T03:50:05,665 !! 2024-03-20T03:50:05,666 ******************************************************************************** 2024-03-20T03:50:05,667 ############################ 2024-03-20T03:50:05,668 # Package would be ignored # 2024-03-20T03:50:05,668 ############################ 2024-03-20T03:50:05,669 Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1], 2024-03-20T03:50:05,670 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,671 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,672 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added 2024-03-20T03:50:05,672 to the `packages` configuration field. 2024-03-20T03:50:05,673 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,674 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,674 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,675 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,677 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,678 If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are 2024-03-20T03:50:05,679 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via 2024-03-20T03:50:05,680 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,680 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,681 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,682 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,683 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,685 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,686 even if it does not contain any `.py` files. 2024-03-20T03:50:05,686 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,687 directory, all directories are treated like packages. 2024-03-20T03:50:05,687 ******************************************************************************** 2024-03-20T03:50:05,689 !! 2024-03-20T03:50:05,689 check.warn(importable) 2024-03-20T03:50:05,697 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration. 2024-03-20T03:50:05,698 !! 2024-03-20T03:50:05,699 ******************************************************************************** 2024-03-20T03:50:05,700 ############################ 2024-03-20T03:50:05,700 # Package would be ignored # 2024-03-20T03:50:05,701 ############################ 2024-03-20T03:50:05,701 Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1], 2024-03-20T03:50:05,702 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,703 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,704 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added 2024-03-20T03:50:05,705 to the `packages` configuration field. 2024-03-20T03:50:05,706 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,706 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,707 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,709 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,710 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,711 If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are 2024-03-20T03:50:05,712 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via 2024-03-20T03:50:05,713 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,714 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,714 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,715 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,716 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,718 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,719 even if it does not contain any `.py` files. 2024-03-20T03:50:05,719 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,720 directory, all directories are treated like packages. 2024-03-20T03:50:05,720 ******************************************************************************** 2024-03-20T03:50:05,721 !! 2024-03-20T03:50:05,722 check.warn(importable) 2024-03-20T03:50:05,723 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2024-03-20T03:50:05,723 !! 2024-03-20T03:50:05,725 ******************************************************************************** 2024-03-20T03:50:05,725 ############################ 2024-03-20T03:50:05,726 # Package would be ignored # 2024-03-20T03:50:05,726 ############################ 2024-03-20T03:50:05,727 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2024-03-20T03:50:05,727 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,729 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,729 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2024-03-20T03:50:05,730 to the `packages` configuration field. 2024-03-20T03:50:05,731 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,736 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,736 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,738 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,739 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,740 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2024-03-20T03:50:05,741 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2024-03-20T03:50:05,742 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,742 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,743 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,757 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,759 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,761 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,762 even if it does not contain any `.py` files. 2024-03-20T03:50:05,763 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,764 directory, all directories are treated like packages. 2024-03-20T03:50:05,766 ******************************************************************************** 2024-03-20T03:50:05,768 !! 2024-03-20T03:50:05,768 check.warn(importable) 2024-03-20T03:50:05,769 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2024-03-20T03:50:05,770 !! 2024-03-20T03:50:05,772 ******************************************************************************** 2024-03-20T03:50:05,773 ############################ 2024-03-20T03:50:05,774 # Package would be ignored # 2024-03-20T03:50:05,775 ############################ 2024-03-20T03:50:05,776 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2024-03-20T03:50:05,777 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,779 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,780 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2024-03-20T03:50:05,781 to the `packages` configuration field. 2024-03-20T03:50:05,783 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,783 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,784 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,786 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,787 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,789 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2024-03-20T03:50:05,789 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2024-03-20T03:50:05,790 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,791 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,792 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,869 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,871 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,873 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,873 even if it does not contain any `.py` files. 2024-03-20T03:50:05,874 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,874 directory, all directories are treated like packages. 2024-03-20T03:50:05,875 ******************************************************************************** 2024-03-20T03:50:05,877 !! 2024-03-20T03:50:05,878 check.warn(importable) 2024-03-20T03:50:05,878 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2024-03-20T03:50:05,879 !! 2024-03-20T03:50:05,880 ******************************************************************************** 2024-03-20T03:50:05,881 ############################ 2024-03-20T03:50:05,882 # Package would be ignored # 2024-03-20T03:50:05,882 ############################ 2024-03-20T03:50:05,883 Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1], 2024-03-20T03:50:05,884 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,885 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,886 package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added 2024-03-20T03:50:05,887 to the `packages` configuration field. 2024-03-20T03:50:05,888 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,888 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,889 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,890 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,891 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,893 If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are 2024-03-20T03:50:05,893 already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via 2024-03-20T03:50:05,894 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,895 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,896 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,897 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,899 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,900 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,901 even if it does not contain any `.py` files. 2024-03-20T03:50:05,902 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,903 directory, all directories are treated like packages. 2024-03-20T03:50:05,904 ******************************************************************************** 2024-03-20T03:50:05,905 !! 2024-03-20T03:50:05,906 check.warn(importable) 2024-03-20T03:50:05,907 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2024-03-20T03:50:05,907 !! 2024-03-20T03:50:05,909 ******************************************************************************** 2024-03-20T03:50:05,909 ############################ 2024-03-20T03:50:05,910 # Package would be ignored # 2024-03-20T03:50:05,911 ############################ 2024-03-20T03:50:05,911 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2024-03-20T03:50:05,912 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,913 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,914 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2024-03-20T03:50:05,915 to the `packages` configuration field. 2024-03-20T03:50:05,916 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,917 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,918 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,919 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,920 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,921 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2024-03-20T03:50:05,922 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2024-03-20T03:50:05,923 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,924 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,925 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,927 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,929 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,931 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,931 even if it does not contain any `.py` files. 2024-03-20T03:50:05,932 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,933 directory, all directories are treated like packages. 2024-03-20T03:50:05,934 ******************************************************************************** 2024-03-20T03:50:05,935 !! 2024-03-20T03:50:05,935 check.warn(importable) 2024-03-20T03:50:05,936 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration. 2024-03-20T03:50:05,937 !! 2024-03-20T03:50:05,939 ******************************************************************************** 2024-03-20T03:50:05,940 ############################ 2024-03-20T03:50:05,940 # Package would be ignored # 2024-03-20T03:50:05,941 ############################ 2024-03-20T03:50:05,942 Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1], 2024-03-20T03:50:05,942 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,944 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,944 package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added 2024-03-20T03:50:05,945 to the `packages` configuration field. 2024-03-20T03:50:05,946 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,947 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,947 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,948 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,949 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,950 If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are 2024-03-20T03:50:05,951 already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via 2024-03-20T03:50:05,951 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,952 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,953 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,954 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,955 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,957 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,958 even if it does not contain any `.py` files. 2024-03-20T03:50:05,958 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,959 directory, all directories are treated like packages. 2024-03-20T03:50:05,959 ******************************************************************************** 2024-03-20T03:50:05,961 !! 2024-03-20T03:50:05,961 check.warn(importable) 2024-03-20T03:50:05,962 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration. 2024-03-20T03:50:05,962 !! 2024-03-20T03:50:05,964 ******************************************************************************** 2024-03-20T03:50:05,965 ############################ 2024-03-20T03:50:05,965 # Package would be ignored # 2024-03-20T03:50:05,966 ############################ 2024-03-20T03:50:05,966 Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1], 2024-03-20T03:50:05,967 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,968 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,968 package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added 2024-03-20T03:50:05,969 to the `packages` configuration field. 2024-03-20T03:50:05,970 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,970 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,971 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,972 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,973 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,974 If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are 2024-03-20T03:50:05,975 already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via 2024-03-20T03:50:05,976 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:05,976 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:05,976 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:05,977 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:05,978 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:05,980 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:05,980 even if it does not contain any `.py` files. 2024-03-20T03:50:05,981 On the other hand, currently there is no concept of package data 2024-03-20T03:50:05,982 directory, all directories are treated like packages. 2024-03-20T03:50:05,982 ******************************************************************************** 2024-03-20T03:50:05,983 !! 2024-03-20T03:50:05,984 check.warn(importable) 2024-03-20T03:50:05,984 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_concise' is absent from the `packages` configuration. 2024-03-20T03:50:05,985 !! 2024-03-20T03:50:05,986 ******************************************************************************** 2024-03-20T03:50:05,987 ############################ 2024-03-20T03:50:05,987 # Package would be ignored # 2024-03-20T03:50:05,988 ############################ 2024-03-20T03:50:05,988 Python recognizes 'alpaca_eval.models_configs.gpt4_0613_concise' as an importable package[^1], 2024-03-20T03:50:05,989 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:05,991 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:05,991 package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_concise' is explicitly added 2024-03-20T03:50:05,992 to the `packages` configuration field. 2024-03-20T03:50:05,993 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:05,994 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:05,995 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:05,996 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:05,998 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:05,999 If you don't want 'alpaca_eval.models_configs.gpt4_0613_concise' to be distributed and are 2024-03-20T03:50:05,999 already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_concise' via 2024-03-20T03:50:06,000 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,000 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,001 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,002 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,003 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,004 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,005 even if it does not contain any `.py` files. 2024-03-20T03:50:06,006 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,007 directory, all directories are treated like packages. 2024-03-20T03:50:06,008 ******************************************************************************** 2024-03-20T03:50:06,008 !! 2024-03-20T03:50:06,009 check.warn(importable) 2024-03-20T03:50:06,009 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613_verbose' is absent from the `packages` configuration. 2024-03-20T03:50:06,010 !! 2024-03-20T03:50:06,011 ******************************************************************************** 2024-03-20T03:50:06,011 ############################ 2024-03-20T03:50:06,012 # Package would be ignored # 2024-03-20T03:50:06,012 ############################ 2024-03-20T03:50:06,013 Python recognizes 'alpaca_eval.models_configs.gpt4_0613_verbose' as an importable package[^1], 2024-03-20T03:50:06,013 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,014 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,015 package, please make sure that 'alpaca_eval.models_configs.gpt4_0613_verbose' is explicitly added 2024-03-20T03:50:06,016 to the `packages` configuration field. 2024-03-20T03:50:06,017 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,018 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,018 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,019 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,021 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,022 If you don't want 'alpaca_eval.models_configs.gpt4_0613_verbose' to be distributed and are 2024-03-20T03:50:06,022 already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613_verbose' via 2024-03-20T03:50:06,023 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,023 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,024 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,025 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,026 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,028 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,029 even if it does not contain any `.py` files. 2024-03-20T03:50:06,029 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,030 directory, all directories are treated like packages. 2024-03-20T03:50:06,031 ******************************************************************************** 2024-03-20T03:50:06,032 !! 2024-03-20T03:50:06,032 check.warn(importable) 2024-03-20T03:50:06,033 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration. 2024-03-20T03:50:06,033 !! 2024-03-20T03:50:06,034 ******************************************************************************** 2024-03-20T03:50:06,035 ############################ 2024-03-20T03:50:06,036 # Package would be ignored # 2024-03-20T03:50:06,036 ############################ 2024-03-20T03:50:06,036 Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1], 2024-03-20T03:50:06,037 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,038 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,039 package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added 2024-03-20T03:50:06,040 to the `packages` configuration field. 2024-03-20T03:50:06,042 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,043 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,044 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,046 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,048 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,049 If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are 2024-03-20T03:50:06,050 already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via 2024-03-20T03:50:06,051 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,051 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,052 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,053 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,055 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,056 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,057 even if it does not contain any `.py` files. 2024-03-20T03:50:06,058 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,058 directory, all directories are treated like packages. 2024-03-20T03:50:06,059 ******************************************************************************** 2024-03-20T03:50:06,060 !! 2024-03-20T03:50:06,061 check.warn(importable) 2024-03-20T03:50:06,061 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is absent from the `packages` configuration. 2024-03-20T03:50:06,062 !! 2024-03-20T03:50:06,063 ******************************************************************************** 2024-03-20T03:50:06,063 ############################ 2024-03-20T03:50:06,064 # Package would be ignored # 2024-03-20T03:50:06,065 ############################ 2024-03-20T03:50:06,065 Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_concise' as an importable package[^1], 2024-03-20T03:50:06,066 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,067 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,068 package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_concise' is explicitly added 2024-03-20T03:50:06,068 to the `packages` configuration field. 2024-03-20T03:50:06,070 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,070 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,071 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,072 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,073 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,075 If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_concise' to be distributed and are 2024-03-20T03:50:06,075 already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_concise' via 2024-03-20T03:50:06,076 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,076 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,077 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,078 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,079 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,081 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,081 even if it does not contain any `.py` files. 2024-03-20T03:50:06,082 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,082 directory, all directories are treated like packages. 2024-03-20T03:50:06,083 ******************************************************************************** 2024-03-20T03:50:06,084 !! 2024-03-20T03:50:06,084 check.warn(importable) 2024-03-20T03:50:06,085 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is absent from the `packages` configuration. 2024-03-20T03:50:06,086 !! 2024-03-20T03:50:06,087 ******************************************************************************** 2024-03-20T03:50:06,088 ############################ 2024-03-20T03:50:06,088 # Package would be ignored # 2024-03-20T03:50:06,089 ############################ 2024-03-20T03:50:06,090 Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' as an importable package[^1], 2024-03-20T03:50:06,090 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,092 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,092 package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' is explicitly added 2024-03-20T03:50:06,093 to the `packages` configuration field. 2024-03-20T03:50:06,094 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,094 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,095 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,096 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,098 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,099 If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' to be distributed and are 2024-03-20T03:50:06,099 already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview_verbose' via 2024-03-20T03:50:06,100 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,101 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,102 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,103 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,104 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,105 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,106 even if it does not contain any `.py` files. 2024-03-20T03:50:06,107 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,108 directory, all directories are treated like packages. 2024-03-20T03:50:06,108 ******************************************************************************** 2024-03-20T03:50:06,110 !! 2024-03-20T03:50:06,111 check.warn(importable) 2024-03-20T03:50:06,111 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_gamed' is absent from the `packages` configuration. 2024-03-20T03:50:06,112 !! 2024-03-20T03:50:06,114 ******************************************************************************** 2024-03-20T03:50:06,114 ############################ 2024-03-20T03:50:06,117 # Package would be ignored # 2024-03-20T03:50:06,118 ############################ 2024-03-20T03:50:06,119 Python recognizes 'alpaca_eval.models_configs.gpt4_gamed' as an importable package[^1], 2024-03-20T03:50:06,126 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,127 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,128 package, please make sure that 'alpaca_eval.models_configs.gpt4_gamed' is explicitly added 2024-03-20T03:50:06,138 to the `packages` configuration field. 2024-03-20T03:50:06,142 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,143 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,144 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,146 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,147 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,149 If you don't want 'alpaca_eval.models_configs.gpt4_gamed' to be distributed and are 2024-03-20T03:50:06,149 already explicitly excluding 'alpaca_eval.models_configs.gpt4_gamed' via 2024-03-20T03:50:06,150 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,152 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,153 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,155 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,156 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,158 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,159 even if it does not contain any `.py` files. 2024-03-20T03:50:06,160 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,161 directory, all directories are treated like packages. 2024-03-20T03:50:06,162 ******************************************************************************** 2024-03-20T03:50:06,163 !! 2024-03-20T03:50:06,170 check.warn(importable) 2024-03-20T03:50:06,170 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration. 2024-03-20T03:50:06,171 !! 2024-03-20T03:50:06,173 ******************************************************************************** 2024-03-20T03:50:06,174 ############################ 2024-03-20T03:50:06,175 # Package would be ignored # 2024-03-20T03:50:06,175 ############################ 2024-03-20T03:50:06,176 Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1], 2024-03-20T03:50:06,177 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,178 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,179 package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added 2024-03-20T03:50:06,180 to the `packages` configuration field. 2024-03-20T03:50:06,181 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,182 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,183 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,185 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,187 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,190 If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are 2024-03-20T03:50:06,191 already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via 2024-03-20T03:50:06,191 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,192 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,193 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,194 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,196 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,199 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,200 even if it does not contain any `.py` files. 2024-03-20T03:50:06,201 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,202 directory, all directories are treated like packages. 2024-03-20T03:50:06,203 ******************************************************************************** 2024-03-20T03:50:06,205 !! 2024-03-20T03:50:06,205 check.warn(importable) 2024-03-20T03:50:06,207 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2024-03-20T03:50:06,207 !! 2024-03-20T03:50:06,209 ******************************************************************************** 2024-03-20T03:50:06,210 ############################ 2024-03-20T03:50:06,211 # Package would be ignored # 2024-03-20T03:50:06,212 ############################ 2024-03-20T03:50:06,226 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2024-03-20T03:50:06,235 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,246 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,247 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2024-03-20T03:50:06,255 to the `packages` configuration field. 2024-03-20T03:50:06,262 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,263 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,264 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,265 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,283 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,295 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2024-03-20T03:50:06,296 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2024-03-20T03:50:06,297 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,298 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,299 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,301 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,305 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,308 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,309 even if it does not contain any `.py` files. 2024-03-20T03:50:06,311 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,314 directory, all directories are treated like packages. 2024-03-20T03:50:06,322 ******************************************************************************** 2024-03-20T03:50:06,324 !! 2024-03-20T03:50:06,325 check.warn(importable) 2024-03-20T03:50:06,326 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2024-03-20T03:50:06,334 !! 2024-03-20T03:50:06,336 ******************************************************************************** 2024-03-20T03:50:06,337 ############################ 2024-03-20T03:50:06,338 # Package would be ignored # 2024-03-20T03:50:06,339 ############################ 2024-03-20T03:50:06,340 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2024-03-20T03:50:06,342 but it is absent from setuptools' `packages` configuration. 2024-03-20T03:50:06,344 This leads to an ambiguous overall configuration. If you want to distribute this 2024-03-20T03:50:06,345 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2024-03-20T03:50:06,346 to the `packages` configuration field. 2024-03-20T03:50:06,358 Alternatively, you can also rely on setuptools' discovery methods 2024-03-20T03:50:06,359 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-03-20T03:50:06,360 instead of `find_packages(...)`/`find:`). 2024-03-20T03:50:06,362 You can read more about "package discovery" on setuptools documentation page: 2024-03-20T03:50:06,367 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-03-20T03:50:06,369 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2024-03-20T03:50:06,369 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2024-03-20T03:50:06,394 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-03-20T03:50:06,396 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-03-20T03:50:06,397 combination with a more fine grained `package-data` configuration. 2024-03-20T03:50:06,404 You can read more about "package data files" on setuptools documentation page: 2024-03-20T03:50:06,406 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-03-20T03:50:06,428 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-03-20T03:50:06,429 even if it does not contain any `.py` files. 2024-03-20T03:50:06,430 On the other hand, currently there is no concept of package data 2024-03-20T03:50:06,431 directory, all directories are treated like packages. 2024-03-20T03:50:06,432 ******************************************************************************** 2024-03-20T03:50:06,442 !! 2024-03-20T03:50:06,444 check.warn(importable) 2024-03-20T03:50:06,445 creating build/lib/alpaca_eval/evaluators_configs 2024-03-20T03:50:06,446 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2024-03-20T03:50:06,447 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:06,448 copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:06,449 copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:06,450 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:06,453 copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:06,458 copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:06,459 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:06,459 copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:06,460 copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:06,461 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:06,462 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:06,463 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:06,466 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2024-03-20T03:50:06,467 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2024-03-20T03:50:06,468 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2024-03-20T03:50:06,469 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2024-03-20T03:50:06,470 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:06,471 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:06,472 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:06,472 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:06,474 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:06,475 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:06,476 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,477 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,478 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,478 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,479 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,480 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,481 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,481 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,482 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,483 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,484 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,485 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,486 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,487 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:06,488 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:06,489 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:06,490 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:06,490 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:06,491 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:06,492 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:06,493 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2024-03-20T03:50:06,494 copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2024-03-20T03:50:06,495 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2024-03-20T03:50:06,496 copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2024-03-20T03:50:06,496 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:06,497 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:06,498 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:06,500 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:06,501 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:06,502 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:06,503 creating build/lib/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:06,504 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:06,505 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:06,506 creating build/lib/alpaca_eval/evaluators_configs/claude_2 2024-03-20T03:50:06,507 copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2 2024-03-20T03:50:06,507 creating build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:06,508 copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:06,509 copying src/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:06,509 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:06,518 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:06,519 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:06,520 creating build/lib/alpaca_eval/evaluators_configs/cohere 2024-03-20T03:50:06,521 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2024-03-20T03:50:06,521 creating build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:06,522 copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:06,530 copying src/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:06,531 creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2024-03-20T03:50:06,531 copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2024-03-20T03:50:06,533 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2024-03-20T03:50:06,534 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2024-03-20T03:50:06,534 creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo 2024-03-20T03:50:06,535 copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo 2024-03-20T03:50:06,536 creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:06,537 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:06,537 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:06,538 creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:06,539 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:06,540 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:06,540 creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob 2024-03-20T03:50:06,541 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob 2024-03-20T03:50:06,543 creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob 2024-03-20T03:50:06,543 copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob 2024-03-20T03:50:06,544 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:06,545 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:06,546 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:06,546 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2024-03-20T03:50:06,547 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2024-03-20T03:50:06,548 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2024-03-20T03:50:06,549 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2024-03-20T03:50:06,550 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:06,550 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:06,552 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:06,552 creating build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking 2024-03-20T03:50:06,553 copying src/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking 2024-03-20T03:50:06,554 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:06,555 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:06,555 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:06,556 creating build/lib/alpaca_eval/evaluators_configs/test 2024-03-20T03:50:06,557 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2024-03-20T03:50:06,558 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:06,558 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:06,559 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:06,560 creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo 2024-03-20T03:50:06,562 copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo 2024-03-20T03:50:06,562 creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo 2024-03-20T03:50:06,563 copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo 2024-03-20T03:50:06,564 creating build/lib/alpaca_eval/leaderboards 2024-03-20T03:50:06,565 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:06,565 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:06,566 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:06,567 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:06,568 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:06,569 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,570 copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,571 copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,572 copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,573 copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,578 copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:06,579 creating build/lib/alpaca_eval/leaderboards/evaluators 2024-03-20T03:50:06,586 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2024-03-20T03:50:06,586 creating build/lib/alpaca_eval/models_configs 2024-03-20T03:50:06,587 creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:06,588 copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:06,590 copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:06,598 creating build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:06,599 copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:06,600 copying src/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:06,600 creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:06,601 copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:06,602 copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:06,603 creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2 2024-03-20T03:50:06,604 copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2 2024-03-20T03:50:06,610 creating build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:06,610 copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:06,611 copying src/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:06,612 creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:06,613 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:06,614 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:06,615 creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:06,616 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:06,617 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:06,618 creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:06,619 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:06,619 copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:06,620 creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:06,631 copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:06,632 copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:06,750 creating build/lib/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:06,884 copying src/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:07,003 copying src/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:07,066 creating build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:07,143 copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:07,260 copying src/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:07,420 creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:07,592 copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:07,596 copying src/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:07,598 creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2 2024-03-20T03:50:07,667 copying src/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2 2024-03-20T03:50:07,772 creating build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16 2024-03-20T03:50:07,773 copying src/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16 2024-03-20T03:50:07,775 creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:07,776 copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:07,830 copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:08,009 creating build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:08,142 copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:08,570 copying src/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:08,689 creating build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:08,691 copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:08,692 copying src/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:08,693 creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:08,694 copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:08,695 copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:08,695 creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:08,697 copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:08,698 copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:08,698 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:08,699 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:08,700 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:08,701 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2024-03-20T03:50:08,702 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2024-03-20T03:50:08,703 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:08,704 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:08,705 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:08,706 creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:08,707 copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:08,708 copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:08,709 creating build/lib/alpaca_eval/models_configs/alpaca-7b_concise 2024-03-20T03:50:08,710 copying src/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_concise 2024-03-20T03:50:08,713 creating build/lib/alpaca_eval/models_configs/alpaca-7b_verbose 2024-03-20T03:50:08,715 copying src/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b_verbose 2024-03-20T03:50:08,719 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2024-03-20T03:50:08,721 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2024-03-20T03:50:08,726 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2024-03-20T03:50:08,728 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2024-03-20T03:50:08,733 creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:08,735 copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:08,739 copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:08,743 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:08,745 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:08,750 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:08,753 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2024-03-20T03:50:08,755 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2024-03-20T03:50:08,760 creating build/lib/alpaca_eval/models_configs/bedrock_claude 2024-03-20T03:50:08,761 copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude 2024-03-20T03:50:08,764 creating build/lib/alpaca_eval/models_configs/bedrock_claude_2 2024-03-20T03:50:08,766 copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2 2024-03-20T03:50:08,769 creating build/lib/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:08,770 copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:08,774 copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:08,778 creating build/lib/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:08,779 copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:08,783 copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:08,786 creating build/lib/alpaca_eval/models_configs/claude 2024-03-20T03:50:08,787 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2024-03-20T03:50:08,790 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2024-03-20T03:50:08,793 creating build/lib/alpaca_eval/models_configs/claude-2 2024-03-20T03:50:08,795 copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2 2024-03-20T03:50:08,798 creating build/lib/alpaca_eval/models_configs/claude-2.1 2024-03-20T03:50:08,800 copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1 2024-03-20T03:50:08,803 creating build/lib/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:08,805 copying src/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:08,808 copying src/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:08,811 creating build/lib/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:08,813 copying src/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:08,816 copying src/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:08,819 creating build/lib/alpaca_eval/models_configs/claude-3-opus-20240229 2024-03-20T03:50:08,820 copying src/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-opus-20240229 2024-03-20T03:50:08,828 creating build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:08,829 copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:08,832 copying src/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:08,835 creating build/lib/alpaca_eval/models_configs/claude-instant-1.2 2024-03-20T03:50:08,837 copying src/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-instant-1.2 2024-03-20T03:50:08,840 creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2024-03-20T03:50:08,842 copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2024-03-20T03:50:08,845 creating build/lib/alpaca_eval/models_configs/cohere 2024-03-20T03:50:08,846 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2024-03-20T03:50:08,849 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2024-03-20T03:50:08,851 creating build/lib/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:08,853 copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:08,861 copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:08,864 creating build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:08,865 copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:08,869 copying src/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:08,872 creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0 2024-03-20T03:50:08,873 copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0 2024-03-20T03:50:08,877 creating build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b 2024-03-20T03:50:08,878 copying src/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b 2024-03-20T03:50:08,881 creating build/lib/alpaca_eval/models_configs/evo-7b 2024-03-20T03:50:08,882 copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b 2024-03-20T03:50:08,885 creating build/lib/alpaca_eval/models_configs/evo-v2-7b 2024-03-20T03:50:08,887 copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b 2024-03-20T03:50:08,890 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2024-03-20T03:50:08,891 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2024-03-20T03:50:08,894 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2024-03-20T03:50:08,896 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2024-03-20T03:50:08,899 creating build/lib/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:08,900 copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:08,903 copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:08,906 creating build/lib/alpaca_eval/models_configs/gemma-2b-it 2024-03-20T03:50:08,908 copying src/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-2b-it 2024-03-20T03:50:08,911 creating build/lib/alpaca_eval/models_configs/gemma-7b-it 2024-03-20T03:50:08,912 copying src/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/lib/alpaca_eval/models_configs/gemma-7b-it 2024-03-20T03:50:08,915 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301 2024-03-20T03:50:08,917 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301 2024-03-20T03:50:08,920 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613 2024-03-20T03:50:08,922 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613 2024-03-20T03:50:08,926 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106 2024-03-20T03:50:08,927 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106 2024-03-20T03:50:08,935 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise 2024-03-20T03:50:08,936 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise 2024-03-20T03:50:08,940 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose 2024-03-20T03:50:08,941 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose 2024-03-20T03:50:08,944 creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613 2024-03-20T03:50:08,945 copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613 2024-03-20T03:50:08,948 creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2024-03-20T03:50:08,950 copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2024-03-20T03:50:08,953 creating build/lib/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:08,954 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:08,958 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:08,961 creating build/lib/alpaca_eval/models_configs/gpt4_0314 2024-03-20T03:50:08,963 copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314 2024-03-20T03:50:08,966 creating build/lib/alpaca_eval/models_configs/gpt4_0613 2024-03-20T03:50:08,967 copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613 2024-03-20T03:50:08,971 creating build/lib/alpaca_eval/models_configs/gpt4_0613_concise 2024-03-20T03:50:08,972 copying src/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_concise 2024-03-20T03:50:08,976 creating build/lib/alpaca_eval/models_configs/gpt4_0613_verbose 2024-03-20T03:50:08,977 copying src/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613_verbose 2024-03-20T03:50:08,980 creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:08,981 copying src/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:08,984 copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:08,987 creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:08,989 copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:08,993 copying src/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:08,998 creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:09,000 copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:09,003 copying src/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:09,005 creating build/lib/alpaca_eval/models_configs/gpt4_gamed 2024-03-20T03:50:09,007 copying src/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_gamed 2024-03-20T03:50:09,010 creating build/lib/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,012 copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,015 copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,017 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2024-03-20T03:50:09,019 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2024-03-20T03:50:09,022 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2024-03-20T03:50:09,024 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2024-03-20T03:50:09,027 creating build/lib/alpaca_eval/models_configs/guanaco-33b-api 2024-03-20T03:50:09,028 copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api 2024-03-20T03:50:09,031 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2024-03-20T03:50:09,033 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2024-03-20T03:50:09,036 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:09,037 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:09,041 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:09,045 creating build/lib/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:09,048 copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:09,052 copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:09,055 creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2024-03-20T03:50:09,056 copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2024-03-20T03:50:09,060 creating build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,061 copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,065 copying src/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,068 creating build/lib/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:09,069 copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:09,073 copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:09,076 creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2024-03-20T03:50:09,077 copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2024-03-20T03:50:09,080 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,082 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,085 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,088 creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:09,090 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:09,093 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:09,096 creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:09,097 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:09,101 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:09,104 creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b 2024-03-20T03:50:09,105 copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b 2024-03-20T03:50:09,108 creating build/lib/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,110 copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,113 copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,116 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:09,118 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:09,121 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:09,125 creating build/lib/alpaca_eval/models_configs/mistral-large-2402 2024-03-20T03:50:09,126 copying src/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-large-2402 2024-03-20T03:50:09,130 creating build/lib/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,131 copying src/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,134 copying src/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,137 creating build/lib/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,139 copying src/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,143 copying src/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/lib/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,148 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:09,151 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:09,154 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:09,157 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2024-03-20T03:50:09,159 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2024-03-20T03:50:09,162 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:09,163 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:09,167 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:09,170 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:09,171 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:09,175 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:09,177 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:09,179 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:09,182 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:09,185 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,186 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,188 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,191 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:09,192 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:09,194 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:09,197 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:09,198 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:09,202 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:09,204 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,206 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,209 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,212 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:09,213 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:09,216 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:09,219 creating build/lib/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:09,220 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:09,224 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:09,226 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2024-03-20T03:50:09,228 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2024-03-20T03:50:09,234 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2024-03-20T03:50:09,236 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2024-03-20T03:50:09,238 creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2024-03-20T03:50:09,239 copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2024-03-20T03:50:09,242 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2024-03-20T03:50:09,243 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2024-03-20T03:50:09,246 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2024-03-20T03:50:09,247 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2024-03-20T03:50:09,249 creating build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat 2024-03-20T03:50:09,251 copying src/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat 2024-03-20T03:50:09,253 creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b 2024-03-20T03:50:09,254 copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b 2024-03-20T03:50:09,256 creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:09,257 copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:09,260 copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:09,262 creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta 2024-03-20T03:50:09,263 copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta 2024-03-20T03:50:09,266 creating build/lib/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:09,267 copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:09,270 copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:09,272 creating build/lib/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,273 copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,276 copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,278 creating build/lib/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:09,279 copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:09,282 copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:09,284 creating build/lib/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,285 copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,288 copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,291 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2024-03-20T03:50:09,292 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2024-03-20T03:50:09,295 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2024-03-20T03:50:09,296 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2024-03-20T03:50:09,299 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2024-03-20T03:50:09,301 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2024-03-20T03:50:09,304 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2024-03-20T03:50:09,305 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2024-03-20T03:50:09,307 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:09,309 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:09,313 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:09,316 creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b 2024-03-20T03:50:09,317 copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b 2024-03-20T03:50:09,320 creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,321 copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,324 copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,327 creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b 2024-03-20T03:50:09,328 copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b 2024-03-20T03:50:09,331 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:09,332 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:09,334 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:09,337 creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,338 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,340 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,343 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,344 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,346 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,349 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:09,350 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:09,352 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:09,355 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2024-03-20T03:50:09,356 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2024-03-20T03:50:09,358 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2024-03-20T03:50:09,360 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2024-03-20T03:50:09,362 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5 2024-03-20T03:50:09,364 copying src/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5 2024-03-20T03:50:09,366 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2024-03-20T03:50:09,368 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2024-03-20T03:50:09,370 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,371 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,375 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,377 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2024-03-20T03:50:09,379 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2024-03-20T03:50:09,381 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5 2024-03-20T03:50:09,382 copying src/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5 2024-03-20T03:50:09,384 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:09,385 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:09,388 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:09,391 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2024-03-20T03:50:09,392 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2024-03-20T03:50:09,394 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2024-03-20T03:50:09,395 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2024-03-20T03:50:09,397 creating build/lib/alpaca_eval/models_configs/wizardlm-70b 2024-03-20T03:50:09,398 copying src/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-70b 2024-03-20T03:50:09,400 creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2024-03-20T03:50:09,402 copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2024-03-20T03:50:09,404 creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2024-03-20T03:50:09,405 copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2024-03-20T03:50:09,408 creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3 2024-03-20T03:50:09,409 copying src/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3 2024-03-20T03:50:09,412 creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:09,413 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:09,415 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:09,417 creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:09,420 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:09,423 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:09,425 creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2024-03-20T03:50:09,426 copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2024-03-20T03:50:09,462 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-03-20T03:50:09,463 !! 2024-03-20T03:50:09,464 ******************************************************************************** 2024-03-20T03:50:09,465 Please avoid running ``setup.py`` directly. 2024-03-20T03:50:09,465 Instead, use pypa/build, pypa/installer or other 2024-03-20T03:50:09,466 standards-based tools. 2024-03-20T03:50:09,467 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-03-20T03:50:09,468 ******************************************************************************** 2024-03-20T03:50:09,469 !! 2024-03-20T03:50:09,469 self.initialize_options() 2024-03-20T03:50:09,489 installing to build/bdist.linux-armv7l/wheel 2024-03-20T03:50:09,489 running install 2024-03-20T03:50:09,513 running install_lib 2024-03-20T03:50:09,540 creating build/bdist.linux-armv7l 2024-03-20T03:50:09,540 creating build/bdist.linux-armv7l/wheel 2024-03-20T03:50:09,543 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,544 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,547 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2024-03-20T03:50:09,549 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,550 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,553 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,555 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,559 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,561 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2 2024-03-20T03:50:09,564 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:09,565 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:09,568 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:09,571 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:09,573 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2024-03-20T03:50:09,576 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2024-03-20T03:50:09,577 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2024-03-20T03:50:09,580 copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,583 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,586 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,590 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,591 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,595 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,596 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,600 copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,602 copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,604 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,607 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,609 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,611 copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,614 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,616 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,618 copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,621 copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2024-03-20T03:50:09,624 creating build/bdist.linux-armv7l/wheel/alpaca_eval/metrics 2024-03-20T03:50:09,625 copying build/lib/alpaca_eval/metrics/winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics 2024-03-20T03:50:09,627 copying build/lib/alpaca_eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics 2024-03-20T03:50:09,629 copying build/lib/alpaca_eval/metrics/helpers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics 2024-03-20T03:50:09,632 copying build/lib/alpaca_eval/metrics/glm_winrate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/metrics 2024-03-20T03:50:09,635 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2024-03-20T03:50:09,636 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2024-03-20T03:50:09,638 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2024-03-20T03:50:09,641 copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2024-03-20T03:50:09,645 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,647 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:09,654 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2024-03-20T03:50:09,656 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b 2024-03-20T03:50:09,657 copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b 2024-03-20T03:50:09,660 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:09,661 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:09,663 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_concise 2024-03-20T03:50:09,666 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2 2024-03-20T03:50:09,667 copying build/lib/alpaca_eval/models_configs/claude-instant-1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-instant-1.2 2024-03-20T03:50:09,670 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,671 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,674 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2024-03-20T03:50:09,676 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613 2024-03-20T03:50:09,677 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0613 2024-03-20T03:50:09,680 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2024-03-20T03:50:09,682 copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2024-03-20T03:50:09,685 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:09,686 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:09,688 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose 2024-03-20T03:50:09,691 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2024-03-20T03:50:09,692 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2024-03-20T03:50:09,695 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:09,696 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:09,699 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise 2024-03-20T03:50:09,702 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:09,704 copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:09,707 copying build/lib/alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-sonnet-20240229 2024-03-20T03:50:09,710 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2024-03-20T03:50:09,711 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2024-03-20T03:50:09,715 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2024-03-20T03:50:09,716 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2024-03-20T03:50:09,719 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose 2024-03-20T03:50:09,720 copying build/lib/alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_verbose 2024-03-20T03:50:09,723 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2024-03-20T03:50:09,724 copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2024-03-20T03:50:09,727 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b 2024-03-20T03:50:09,728 copying build/lib/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b 2024-03-20T03:50:09,731 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2024-03-20T03:50:09,732 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2024-03-20T03:50:09,734 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2024-03-20T03:50:09,737 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:09,738 copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:09,741 copying build/lib/alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deepseek-llm-67b-chat 2024-03-20T03:50:09,743 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2024-03-20T03:50:09,745 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2024-03-20T03:50:09,748 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise 2024-03-20T03:50:09,749 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise 2024-03-20T03:50:09,751 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,752 copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,755 copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2024-03-20T03:50:09,757 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,758 copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,761 copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2024-03-20T03:50:09,763 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,764 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,766 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2024-03-20T03:50:09,769 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2024-03-20T03:50:09,770 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2024-03-20T03:50:09,773 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,774 copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,776 copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b 2024-03-20T03:50:09,779 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2024-03-20T03:50:09,780 copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2024-03-20T03:50:09,783 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1 2024-03-20T03:50:09,784 copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1 2024-03-20T03:50:09,786 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it 2024-03-20T03:50:09,787 copying build/lib/alpaca_eval/models_configs/gemma-2b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-2b-it 2024-03-20T03:50:09,790 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2024-03-20T03:50:09,791 copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2024-03-20T03:50:09,794 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,795 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,797 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2024-03-20T03:50:09,800 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,801 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,803 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2024-03-20T03:50:09,806 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314 2024-03-20T03:50:09,807 copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314 2024-03-20T03:50:09,810 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it 2024-03-20T03:50:09,811 copying build/lib/alpaca_eval/models_configs/gemma-7b-it/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemma-7b-it 2024-03-20T03:50:09,814 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:09,815 copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:09,817 copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified 2024-03-20T03:50:09,820 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2024-03-20T03:50:09,821 copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2024-03-20T03:50:09,824 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,825 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,827 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2024-03-20T03:50:09,830 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,831 copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,834 copying build/lib/alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-orpo-beta 2024-03-20T03:50:09,836 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2024-03-20T03:50:09,838 copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2024-03-20T03:50:09,841 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,842 copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,845 copying build/lib/alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/internlm2-chat-20b-ppo 2024-03-20T03:50:09,849 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:09,850 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:09,853 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2024-03-20T03:50:09,856 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,857 copying build/lib/alpaca_eval/models_configs/mistral-medium/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,860 copying build/lib/alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-medium 2024-03-20T03:50:09,863 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:09,864 copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:09,867 copying build/lib/alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Starling-LM-7B-alpha 2024-03-20T03:50:09,871 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,873 copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,876 copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b 2024-03-20T03:50:09,879 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat 2024-03-20T03:50:09,880 copying build/lib/alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-Yi-34B-Chat 2024-03-20T03:50:09,884 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:09,886 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:09,889 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2024-03-20T03:50:09,892 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:09,894 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:09,897 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2024-03-20T03:50:09,901 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:09,903 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:09,907 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2024-03-20T03:50:09,910 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2024-03-20T03:50:09,912 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2024-03-20T03:50:09,916 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,917 copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,920 copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo 2024-03-20T03:50:09,924 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2024-03-20T03:50:09,926 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2024-03-20T03:50:09,929 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2024-03-20T03:50:09,933 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise 2024-03-20T03:50:09,934 copying build/lib/alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613_concise 2024-03-20T03:50:09,938 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2024-03-20T03:50:09,939 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2024-03-20T03:50:09,944 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2024-03-20T03:50:09,945 copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2024-03-20T03:50:09,949 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2024-03-20T03:50:09,951 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2024-03-20T03:50:09,954 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2 2024-03-20T03:50:09,956 copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2 2024-03-20T03:50:09,959 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta 2024-03-20T03:50:09,961 copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta 2024-03-20T03:50:09,964 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,966 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,968 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2024-03-20T03:50:09,970 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:09,972 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:09,974 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2024-03-20T03:50:09,977 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0 2024-03-20T03:50:09,978 copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0 2024-03-20T03:50:09,981 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2024-03-20T03:50:09,982 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2024-03-20T03:50:09,986 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:09,987 copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:09,990 copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1 2024-03-20T03:50:09,993 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:09,994 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:09,996 copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1 2024-03-20T03:50:09,999 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:10,000 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:10,002 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2024-03-20T03:50:10,004 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:10,005 copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:10,007 copying build/lib/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1 2024-03-20T03:50:10,009 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16 2024-03-20T03:50:10,010 copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16 2024-03-20T03:50:10,013 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:10,014 copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:10,016 copying build/lib/alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Samba-CoE-v0.1 2024-03-20T03:50:10,018 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301 2024-03-20T03:50:10,019 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301 2024-03-20T03:50:10,022 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:10,023 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:10,025 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2024-03-20T03:50:10,028 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2024-03-20T03:50:10,029 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2024-03-20T03:50:10,031 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2024-03-20T03:50:10,032 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2024-03-20T03:50:10,035 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:10,036 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:10,038 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2024-03-20T03:50:10,041 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5 2024-03-20T03:50:10,042 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.5 2024-03-20T03:50:10,044 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b 2024-03-20T03:50:10,045 copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b 2024-03-20T03:50:10,048 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229 2024-03-20T03:50:10,049 copying build/lib/alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-3-opus-20240229 2024-03-20T03:50:10,052 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2024-03-20T03:50:10,053 copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2024-03-20T03:50:10,056 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:10,057 copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:10,059 copying build/lib/alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen1.5-72B-Chat 2024-03-20T03:50:10,062 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2 2024-03-20T03:50:10,063 copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2 2024-03-20T03:50:10,065 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2024-03-20T03:50:10,066 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2024-03-20T03:50:10,069 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b 2024-03-20T03:50:10,069 copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b 2024-03-20T03:50:10,072 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:10,073 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:10,075 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2024-03-20T03:50:10,078 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:10,079 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:10,081 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2024-03-20T03:50:10,083 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:10,084 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:10,086 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2024-03-20T03:50:10,089 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:10,090 copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:10,092 copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B 2024-03-20T03:50:10,095 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2024-03-20T03:50:10,096 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2024-03-20T03:50:10,099 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:10,100 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:10,102 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2024-03-20T03:50:10,105 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:10,106 copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:10,108 copying build/lib/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM 2024-03-20T03:50:10,111 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed 2024-03-20T03:50:10,112 copying build/lib/alpaca_eval/models_configs/gpt4_gamed/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_gamed 2024-03-20T03:50:10,114 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:10,115 copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:10,118 copying build/lib/alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Qwen-14B-Chat 2024-03-20T03:50:10,121 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise 2024-03-20T03:50:10,122 copying build/lib/alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_concise 2024-03-20T03:50:10,124 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose 2024-03-20T03:50:10,126 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose 2024-03-20T03:50:10,129 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:10,130 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:10,132 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2024-03-20T03:50:10,135 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2024-03-20T03:50:10,136 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2024-03-20T03:50:10,139 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402 2024-03-20T03:50:10,140 copying build/lib/alpaca_eval/models_configs/mistral-large-2402/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/mistral-large-2402 2024-03-20T03:50:10,144 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:10,145 copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:10,148 copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16 2024-03-20T03:50:10,150 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:10,151 copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:10,154 copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft 2024-03-20T03:50:10,156 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b 2024-03-20T03:50:10,157 copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b 2024-03-20T03:50:10,161 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613 2024-03-20T03:50:10,162 copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613 2024-03-20T03:50:10,165 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:10,166 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:10,169 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview_verbose 2024-03-20T03:50:10,171 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:10,172 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:10,175 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2024-03-20T03:50:10,178 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose 2024-03-20T03:50:10,179 copying build/lib/alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b_verbose 2024-03-20T03:50:10,182 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:10,183 copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:10,185 copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified 2024-03-20T03:50:10,187 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:10,188 copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:10,190 copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2024-03-20T03:50:10,192 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2024-03-20T03:50:10,193 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2024-03-20T03:50:10,196 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:10,197 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:10,200 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2024-03-20T03:50:10,202 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2024-03-20T03:50:10,202 copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2024-03-20T03:50:10,205 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:10,205 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:10,207 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2024-03-20T03:50:10,209 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:10,210 copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:10,212 copying build/lib/alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_verbose 2024-03-20T03:50:10,214 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:10,215 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:10,218 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2024-03-20T03:50:10,221 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2024-03-20T03:50:10,222 copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2024-03-20T03:50:10,225 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:10,226 copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:10,229 copying build/lib/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO 2024-03-20T03:50:10,232 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2024-03-20T03:50:10,233 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2024-03-20T03:50:10,236 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:10,237 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:10,240 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2024-03-20T03:50:10,244 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:10,245 copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:10,249 copying build/lib/alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1_concise 2024-03-20T03:50:10,253 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:10,254 copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:10,256 copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2 2024-03-20T03:50:10,259 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:10,260 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:10,262 copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview 2024-03-20T03:50:10,265 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:10,266 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:10,269 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2024-03-20T03:50:10,271 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:10,272 copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:10,274 copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2024-03-20T03:50:10,277 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:10,278 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:10,280 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2024-03-20T03:50:10,283 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2024-03-20T03:50:10,284 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2024-03-20T03:50:10,287 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2024-03-20T03:50:10,288 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2024-03-20T03:50:10,290 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613 2024-03-20T03:50:10,291 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613 2024-03-20T03:50:10,294 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:10,295 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:10,297 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2024-03-20T03:50:10,300 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:10,301 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:10,303 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2024-03-20T03:50:10,306 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5 2024-03-20T03:50:10,307 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.5 2024-03-20T03:50:10,310 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:10,311 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:10,314 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2024-03-20T03:50:10,316 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:10,317 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:10,320 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2024-03-20T03:50:10,322 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2024-03-20T03:50:10,323 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2024-03-20T03:50:10,326 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:10,327 copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:10,330 copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b 2024-03-20T03:50:10,332 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2024-03-20T03:50:10,333 copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2024-03-20T03:50:10,336 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:10,337 copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:10,340 copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro 2024-03-20T03:50:10,343 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106 2024-03-20T03:50:10,344 copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106 2024-03-20T03:50:10,347 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:10,348 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:10,351 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2024-03-20T03:50:10,354 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:10,355 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:10,358 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2024-03-20T03:50:10,361 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2024-03-20T03:50:10,362 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2024-03-20T03:50:10,365 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2024-03-20T03:50:10,366 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2024-03-20T03:50:10,370 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2024-03-20T03:50:10,371 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2024-03-20T03:50:10,374 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2024-03-20T03:50:10,375 copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2024-03-20T03:50:10,378 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:10,379 copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:10,382 copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b 2024-03-20T03:50:10,384 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2024-03-20T03:50:10,385 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2024-03-20T03:50:10,388 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2024-03-20T03:50:10,389 copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2024-03-20T03:50:10,392 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:10,393 copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:10,395 copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat 2024-03-20T03:50:10,397 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b 2024-03-20T03:50:10,398 copying build/lib/alpaca_eval/models_configs/wizardlm-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-70b 2024-03-20T03:50:10,401 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3 2024-03-20T03:50:10,402 copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.3 2024-03-20T03:50:10,405 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2024-03-20T03:50:10,406 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2024-03-20T03:50:10,408 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2024-03-20T03:50:10,409 copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2024-03-20T03:50:10,412 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2024-03-20T03:50:10,414 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:10,415 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:10,417 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2024-03-20T03:50:10,420 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:10,421 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:10,422 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2024-03-20T03:50:10,425 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:10,426 copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:10,428 copying build/lib/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking 2024-03-20T03:50:10,431 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,432 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,434 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,436 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,439 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,442 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,445 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,448 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,451 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,453 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,455 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,458 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,460 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,463 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2024-03-20T03:50:10,466 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:10,467 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:10,470 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2024-03-20T03:50:10,473 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:10,474 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:10,476 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2024-03-20T03:50:10,478 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob 2024-03-20T03:50:10,479 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob 2024-03-20T03:50:10,482 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo 2024-03-20T03:50:10,483 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo 2024-03-20T03:50:10,486 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:10,487 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:10,490 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2024-03-20T03:50:10,493 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:10,494 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:10,498 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf 2024-03-20T03:50:10,504 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:10,505 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:10,508 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf 2024-03-20T03:50:10,511 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2024-03-20T03:50:10,511 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2024-03-20T03:50:10,514 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:10,515 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:10,517 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2024-03-20T03:50:10,519 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:10,521 copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:10,523 copying build/lib/alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_3_opus_ranking 2024-03-20T03:50:10,525 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2024-03-20T03:50:10,526 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2024-03-20T03:50:10,528 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2024-03-20T03:50:10,529 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2024-03-20T03:50:10,533 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2024-03-20T03:50:10,534 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2024-03-20T03:50:10,537 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:10,538 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:10,540 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2024-03-20T03:50:10,543 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2024-03-20T03:50:10,543 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2024-03-20T03:50:10,546 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:10,547 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:10,549 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2024-03-20T03:50:10,551 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:10,552 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:10,554 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo 2024-03-20T03:50:10,556 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:10,557 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:10,559 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn 2024-03-20T03:50:10,561 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2024-03-20T03:50:10,562 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2024-03-20T03:50:10,565 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob 2024-03-20T03:50:10,566 copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob 2024-03-20T03:50:10,569 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:10,570 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:10,572 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2024-03-20T03:50:10,575 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo 2024-03-20T03:50:10,576 copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo 2024-03-20T03:50:10,579 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2024-03-20T03:50:10,580 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2024-03-20T03:50:10,582 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2024-03-20T03:50:10,583 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2024-03-20T03:50:10,585 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2024-03-20T03:50:10,588 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2024-03-20T03:50:10,589 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2024-03-20T03:50:10,591 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo 2024-03-20T03:50:10,592 copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo 2024-03-20T03:50:10,594 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:10,596 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:10,598 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn 2024-03-20T03:50:10,601 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:10,601 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:10,604 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo 2024-03-20T03:50:10,606 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:10,607 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:10,609 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2024-03-20T03:50:10,611 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:10,612 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:10,614 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2024-03-20T03:50:10,617 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2024-03-20T03:50:10,618 copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2024-03-20T03:50:10,620 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:10,621 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:10,623 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2024-03-20T03:50:10,626 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking 2024-03-20T03:50:10,627 copying build/lib/alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/mistral-large-2402_ranking 2024-03-20T03:50:10,630 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2024-03-20T03:50:10,632 copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2024-03-20T03:50:10,635 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2024-03-20T03:50:10,639 running install_egg_info 2024-03-20T03:50:10,677 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.6-py3.11.egg-info 2024-03-20T03:50:10,699 running install_scripts 2024-03-20T03:50:10,833 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.6.dist-info/WHEEL 2024-03-20T03:50:10,836 creating '/tmp/pip-wheel-pkiqhpbp/alpaca_eval-0.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-20T03:50:10,838 adding 'alpaca_eval/__init__.py' 2024-03-20T03:50:10,841 adding 'alpaca_eval/analyze.py' 2024-03-20T03:50:10,844 adding 'alpaca_eval/completion_parsers.py' 2024-03-20T03:50:10,846 adding 'alpaca_eval/constants.py' 2024-03-20T03:50:10,849 adding 'alpaca_eval/main.py' 2024-03-20T03:50:10,853 adding 'alpaca_eval/plotting.py' 2024-03-20T03:50:10,855 adding 'alpaca_eval/processors.py' 2024-03-20T03:50:10,857 adding 'alpaca_eval/types.py' 2024-03-20T03:50:10,860 adding 'alpaca_eval/utils.py' 2024-03-20T03:50:10,862 adding 'alpaca_eval/annotators/__init__.py' 2024-03-20T03:50:10,866 adding 'alpaca_eval/annotators/base.py' 2024-03-20T03:50:10,869 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2024-03-20T03:50:10,871 adding 'alpaca_eval/decoders/__init__.py' 2024-03-20T03:50:10,873 adding 'alpaca_eval/decoders/anthropic.py' 2024-03-20T03:50:10,874 adding 'alpaca_eval/decoders/bedrock_anthropic.py' 2024-03-20T03:50:10,876 adding 'alpaca_eval/decoders/cohere.py' 2024-03-20T03:50:10,878 adding 'alpaca_eval/decoders/google.py' 2024-03-20T03:50:10,880 adding 'alpaca_eval/decoders/huggingface_api.py' 2024-03-20T03:50:10,881 adding 'alpaca_eval/decoders/huggingface_local.py' 2024-03-20T03:50:10,883 adding 'alpaca_eval/decoders/jinachat.py' 2024-03-20T03:50:10,885 adding 'alpaca_eval/decoders/openai.py' 2024-03-20T03:50:10,887 adding 'alpaca_eval/decoders/replicate.py' 2024-03-20T03:50:10,888 adding 'alpaca_eval/decoders/vllm_local.py' 2024-03-20T03:50:10,891 adding 'alpaca_eval/evaluators_configs/README.md' 2024-03-20T03:50:10,893 adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt' 2024-03-20T03:50:10,894 adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml' 2024-03-20T03:50:10,896 adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt' 2024-03-20T03:50:10,897 adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml' 2024-03-20T03:50:10,899 adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt' 2024-03-20T03:50:10,900 adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml' 2024-03-20T03:50:10,902 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2024-03-20T03:50:10,904 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2024-03-20T03:50:10,905 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml' 2024-03-20T03:50:10,907 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml' 2024-03-20T03:50:10,909 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2024-03-20T03:50:10,910 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2024-03-20T03:50:10,912 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt' 2024-03-20T03:50:10,913 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml' 2024-03-20T03:50:10,915 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2024-03-20T03:50:10,917 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2024-03-20T03:50:10,918 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2024-03-20T03:50:10,920 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2024-03-20T03:50:10,921 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2024-03-20T03:50:10,923 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2024-03-20T03:50:10,924 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2024-03-20T03:50:10,926 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2024-03-20T03:50:10,928 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2024-03-20T03:50:10,929 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2024-03-20T03:50:10,930 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2024-03-20T03:50:10,932 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2024-03-20T03:50:10,933 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2024-03-20T03:50:10,936 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2024-03-20T03:50:10,937 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2024-03-20T03:50:10,938 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2024-03-20T03:50:10,940 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2024-03-20T03:50:10,941 adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml' 2024-03-20T03:50:10,944 adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml' 2024-03-20T03:50:10,945 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2024-03-20T03:50:10,946 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2024-03-20T03:50:10,948 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2024-03-20T03:50:10,950 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2024-03-20T03:50:10,952 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2024-03-20T03:50:10,953 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2024-03-20T03:50:10,955 adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml' 2024-03-20T03:50:10,957 adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml' 2024-03-20T03:50:10,958 adding 'alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt' 2024-03-20T03:50:10,960 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2024-03-20T03:50:10,961 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2024-03-20T03:50:10,963 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2024-03-20T03:50:10,965 adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml' 2024-03-20T03:50:10,967 adding 'alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt' 2024-03-20T03:50:10,968 adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml' 2024-03-20T03:50:10,970 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2024-03-20T03:50:10,971 adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml' 2024-03-20T03:50:10,973 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt' 2024-03-20T03:50:10,974 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml' 2024-03-20T03:50:10,976 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt' 2024-03-20T03:50:10,977 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml' 2024-03-20T03:50:10,978 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml' 2024-03-20T03:50:10,980 adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml' 2024-03-20T03:50:10,982 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2024-03-20T03:50:10,983 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2024-03-20T03:50:10,985 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2024-03-20T03:50:10,987 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2024-03-20T03:50:10,989 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2024-03-20T03:50:10,990 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2024-03-20T03:50:10,992 adding 'alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml' 2024-03-20T03:50:10,994 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2024-03-20T03:50:10,995 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2024-03-20T03:50:10,997 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2024-03-20T03:50:10,999 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2024-03-20T03:50:11,001 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2024-03-20T03:50:11,003 adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml' 2024-03-20T03:50:11,005 adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml' 2024-03-20T03:50:11,009 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2024-03-20T03:50:11,011 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2024-03-20T03:50:11,013 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2024-03-20T03:50:11,015 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2024-03-20T03:50:11,018 adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv' 2024-03-20T03:50:11,020 adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv' 2024-03-20T03:50:11,022 adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv' 2024-03-20T03:50:11,024 adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv' 2024-03-20T03:50:11,026 adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv' 2024-03-20T03:50:11,029 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2024-03-20T03:50:11,030 adding 'alpaca_eval/metrics/__init__.py' 2024-03-20T03:50:11,033 adding 'alpaca_eval/metrics/glm_winrate.py' 2024-03-20T03:50:11,035 adding 'alpaca_eval/metrics/helpers.py' 2024-03-20T03:50:11,036 adding 'alpaca_eval/metrics/winrate.py' 2024-03-20T03:50:11,040 adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml' 2024-03-20T03:50:11,042 adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt' 2024-03-20T03:50:11,043 adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml' 2024-03-20T03:50:11,045 adding 'alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt' 2024-03-20T03:50:11,047 adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml' 2024-03-20T03:50:11,048 adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt' 2024-03-20T03:50:11,050 adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml' 2024-03-20T03:50:11,052 adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml' 2024-03-20T03:50:11,053 adding 'alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt' 2024-03-20T03:50:11,055 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml' 2024-03-20T03:50:11,056 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt' 2024-03-20T03:50:11,058 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml' 2024-03-20T03:50:11,059 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt' 2024-03-20T03:50:11,061 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml' 2024-03-20T03:50:11,062 adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt' 2024-03-20T03:50:11,064 adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml' 2024-03-20T03:50:11,065 adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt' 2024-03-20T03:50:11,067 adding 'alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml' 2024-03-20T03:50:11,069 adding 'alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt' 2024-03-20T03:50:11,070 adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml' 2024-03-20T03:50:11,071 adding 'alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt' 2024-03-20T03:50:11,073 adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml' 2024-03-20T03:50:11,074 adding 'alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt' 2024-03-20T03:50:11,076 adding 'alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml' 2024-03-20T03:50:11,078 adding 'alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml' 2024-03-20T03:50:11,080 adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml' 2024-03-20T03:50:11,081 adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt' 2024-03-20T03:50:11,083 adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml' 2024-03-20T03:50:11,084 adding 'alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt' 2024-03-20T03:50:11,086 adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml' 2024-03-20T03:50:11,087 adding 'alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt' 2024-03-20T03:50:11,089 adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml' 2024-03-20T03:50:11,090 adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt' 2024-03-20T03:50:11,092 adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml' 2024-03-20T03:50:11,093 adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt' 2024-03-20T03:50:11,095 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2024-03-20T03:50:11,096 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2024-03-20T03:50:11,098 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2024-03-20T03:50:11,099 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2024-03-20T03:50:11,100 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2024-03-20T03:50:11,102 adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml' 2024-03-20T03:50:11,103 adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt' 2024-03-20T03:50:11,105 adding 'alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml' 2024-03-20T03:50:11,107 adding 'alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml' 2024-03-20T03:50:11,109 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2024-03-20T03:50:11,110 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2024-03-20T03:50:11,112 adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml' 2024-03-20T03:50:11,113 adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt' 2024-03-20T03:50:11,114 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2024-03-20T03:50:11,115 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2024-03-20T03:50:11,117 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2024-03-20T03:50:11,119 adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml' 2024-03-20T03:50:11,120 adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml' 2024-03-20T03:50:11,122 adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml' 2024-03-20T03:50:11,123 adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt' 2024-03-20T03:50:11,125 adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml' 2024-03-20T03:50:11,126 adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt' 2024-03-20T03:50:11,127 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2024-03-20T03:50:11,128 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2024-03-20T03:50:11,130 adding 'alpaca_eval/models_configs/claude-2/configs.yaml' 2024-03-20T03:50:11,132 adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml' 2024-03-20T03:50:11,134 adding 'alpaca_eval/models_configs/claude-2.1_concise/configs.yaml' 2024-03-20T03:50:11,135 adding 'alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt' 2024-03-20T03:50:11,136 adding 'alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml' 2024-03-20T03:50:11,138 adding 'alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt' 2024-03-20T03:50:11,139 adding 'alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml' 2024-03-20T03:50:11,141 adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml' 2024-03-20T03:50:11,142 adding 'alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt' 2024-03-20T03:50:11,144 adding 'alpaca_eval/models_configs/claude-instant-1.2/configs.yaml' 2024-03-20T03:50:11,145 adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml' 2024-03-20T03:50:11,147 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2024-03-20T03:50:11,148 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2024-03-20T03:50:11,150 adding 'alpaca_eval/models_configs/cut-13b/configs.yaml' 2024-03-20T03:50:11,151 adding 'alpaca_eval/models_configs/cut-13b/prompt.txt' 2024-03-20T03:50:11,153 adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml' 2024-03-20T03:50:11,154 adding 'alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt' 2024-03-20T03:50:11,156 adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml' 2024-03-20T03:50:11,158 adding 'alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml' 2024-03-20T03:50:11,160 adding 'alpaca_eval/models_configs/evo-7b/configs.yaml' 2024-03-20T03:50:11,162 adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml' 2024-03-20T03:50:11,164 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2024-03-20T03:50:11,166 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2024-03-20T03:50:11,167 adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml' 2024-03-20T03:50:11,169 adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt' 2024-03-20T03:50:11,170 adding 'alpaca_eval/models_configs/gemma-2b-it/configs.yaml' 2024-03-20T03:50:11,173 adding 'alpaca_eval/models_configs/gemma-7b-it/configs.yaml' 2024-03-20T03:50:11,175 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml' 2024-03-20T03:50:11,176 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml' 2024-03-20T03:50:11,178 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml' 2024-03-20T03:50:11,180 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml' 2024-03-20T03:50:11,181 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml' 2024-03-20T03:50:11,183 adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml' 2024-03-20T03:50:11,185 adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml' 2024-03-20T03:50:11,187 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2024-03-20T03:50:11,188 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2024-03-20T03:50:11,190 adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml' 2024-03-20T03:50:11,192 adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml' 2024-03-20T03:50:11,193 adding 'alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml' 2024-03-20T03:50:11,195 adding 'alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml' 2024-03-20T03:50:11,197 adding 'alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt' 2024-03-20T03:50:11,198 adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml' 2024-03-20T03:50:11,200 adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt' 2024-03-20T03:50:11,201 adding 'alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml' 2024-03-20T03:50:11,203 adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt' 2024-03-20T03:50:11,204 adding 'alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml' 2024-03-20T03:50:11,206 adding 'alpaca_eval/models_configs/gpt4_gamed/configs.yaml' 2024-03-20T03:50:11,208 adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt' 2024-03-20T03:50:11,209 adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml' 2024-03-20T03:50:11,211 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2024-03-20T03:50:11,213 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2024-03-20T03:50:11,215 adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml' 2024-03-20T03:50:11,216 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2024-03-20T03:50:11,218 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2024-03-20T03:50:11,219 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2024-03-20T03:50:11,221 adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml' 2024-03-20T03:50:11,222 adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt' 2024-03-20T03:50:11,223 adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml' 2024-03-20T03:50:11,225 adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml' 2024-03-20T03:50:11,226 adding 'alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt' 2024-03-20T03:50:11,229 adding 'alpaca_eval/models_configs/jina-chat/configs.yaml' 2024-03-20T03:50:11,230 adding 'alpaca_eval/models_configs/jina-chat/prompt.txt' 2024-03-20T03:50:11,232 adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml' 2024-03-20T03:50:11,233 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml' 2024-03-20T03:50:11,234 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt' 2024-03-20T03:50:11,236 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml' 2024-03-20T03:50:11,237 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt' 2024-03-20T03:50:11,239 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml' 2024-03-20T03:50:11,240 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt' 2024-03-20T03:50:11,242 adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml' 2024-03-20T03:50:11,244 adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml' 2024-03-20T03:50:11,246 adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt' 2024-03-20T03:50:11,248 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2024-03-20T03:50:11,249 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2024-03-20T03:50:11,250 adding 'alpaca_eval/models_configs/mistral-large-2402/configs.yaml' 2024-03-20T03:50:11,252 adding 'alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt' 2024-03-20T03:50:11,253 adding 'alpaca_eval/models_configs/mistral-medium/configs.yaml' 2024-03-20T03:50:11,255 adding 'alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml' 2024-03-20T03:50:11,256 adding 'alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt' 2024-03-20T03:50:11,258 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2024-03-20T03:50:11,259 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2024-03-20T03:50:11,261 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2024-03-20T03:50:11,262 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2024-03-20T03:50:11,263 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2024-03-20T03:50:11,265 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2024-03-20T03:50:11,266 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2024-03-20T03:50:11,268 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml' 2024-03-20T03:50:11,269 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt' 2024-03-20T03:50:11,271 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml' 2024-03-20T03:50:11,273 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt' 2024-03-20T03:50:11,275 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml' 2024-03-20T03:50:11,276 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt' 2024-03-20T03:50:11,278 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml' 2024-03-20T03:50:11,279 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt' 2024-03-20T03:50:11,281 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml' 2024-03-20T03:50:11,282 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt' 2024-03-20T03:50:11,284 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml' 2024-03-20T03:50:11,285 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt' 2024-03-20T03:50:11,287 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2024-03-20T03:50:11,288 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2024-03-20T03:50:11,290 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2024-03-20T03:50:11,292 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2024-03-20T03:50:11,294 adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml' 2024-03-20T03:50:11,296 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2024-03-20T03:50:11,298 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2024-03-20T03:50:11,300 adding 'alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml' 2024-03-20T03:50:11,302 adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml' 2024-03-20T03:50:11,303 adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml' 2024-03-20T03:50:11,305 adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt' 2024-03-20T03:50:11,306 adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml' 2024-03-20T03:50:11,308 adding 'alpaca_eval/models_configs/phi-2/configs.yaml' 2024-03-20T03:50:11,310 adding 'alpaca_eval/models_configs/phi-2/prompt.txt' 2024-03-20T03:50:11,312 adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml' 2024-03-20T03:50:11,313 adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt' 2024-03-20T03:50:11,315 adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml' 2024-03-20T03:50:11,316 adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt' 2024-03-20T03:50:11,318 adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml' 2024-03-20T03:50:11,320 adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt' 2024-03-20T03:50:11,322 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2024-03-20T03:50:11,324 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml' 2024-03-20T03:50:11,325 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml' 2024-03-20T03:50:11,327 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2024-03-20T03:50:11,329 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2024-03-20T03:50:11,330 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2024-03-20T03:50:11,332 adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml' 2024-03-20T03:50:11,334 adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml' 2024-03-20T03:50:11,335 adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt' 2024-03-20T03:50:11,337 adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml' 2024-03-20T03:50:11,339 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2024-03-20T03:50:11,340 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2024-03-20T03:50:11,342 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml' 2024-03-20T03:50:11,343 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt' 2024-03-20T03:50:11,345 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml' 2024-03-20T03:50:11,346 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt' 2024-03-20T03:50:11,348 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml' 2024-03-20T03:50:11,349 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt' 2024-03-20T03:50:11,351 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2024-03-20T03:50:11,353 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2024-03-20T03:50:11,355 adding 'alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml' 2024-03-20T03:50:11,357 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2024-03-20T03:50:11,359 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2024-03-20T03:50:11,360 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2024-03-20T03:50:11,362 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2024-03-20T03:50:11,364 adding 'alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml' 2024-03-20T03:50:11,366 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2024-03-20T03:50:11,367 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2024-03-20T03:50:11,369 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2024-03-20T03:50:11,371 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml' 2024-03-20T03:50:11,373 adding 'alpaca_eval/models_configs/wizardlm-70b/configs.yaml' 2024-03-20T03:50:11,375 adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml' 2024-03-20T03:50:11,377 adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml' 2024-03-20T03:50:11,378 adding 'alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml' 2024-03-20T03:50:11,380 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml' 2024-03-20T03:50:11,381 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt' 2024-03-20T03:50:11,383 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml' 2024-03-20T03:50:11,384 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt' 2024-03-20T03:50:11,386 adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml' 2024-03-20T03:50:11,389 adding 'alpaca_eval-0.6.dist-info/LICENSE' 2024-03-20T03:50:11,401 adding 'alpaca_eval-0.6.dist-info/METADATA' 2024-03-20T03:50:11,402 adding 'alpaca_eval-0.6.dist-info/WHEEL' 2024-03-20T03:50:11,403 adding 'alpaca_eval-0.6.dist-info/entry_points.txt' 2024-03-20T03:50:11,404 adding 'alpaca_eval-0.6.dist-info/top_level.txt' 2024-03-20T03:50:11,410 adding 'alpaca_eval-0.6.dist-info/RECORD' 2024-03-20T03:50:11,424 removing build/bdist.linux-armv7l/wheel 2024-03-20T03:50:11,700 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2024-03-20T03:50:11,706 Created wheel for alpaca-eval: filename=alpaca_eval-0.6-py3-none-any.whl size=283266 sha256=3b56b319bc9de69a82303e07f4964c4263e234262bed1cddad76054978a3d45e 2024-03-20T03:50:11,708 Stored in directory: /tmp/pip-ephem-wheel-cache-_h_tbtpq/wheels/f7/16/14/ff04608dfbbf3bd2f773e610788809ae1ecbe6dd21aaa03174 2024-03-20T03:50:11,742 Successfully built alpaca-eval 2024-03-20T03:50:11,754 Removed build tracker: '/tmp/pip-build-tracker-0jia3bmj'