2024-12-17T13:03:36,480 Created temporary directory: /tmp/pip-build-tracker-g1xqvoi0 2024-12-17T13:03:36,482 Initialized build tracking at /tmp/pip-build-tracker-g1xqvoi0 2024-12-17T13:03:36,483 Created build tracker: /tmp/pip-build-tracker-g1xqvoi0 2024-12-17T13:03:36,483 Entered build tracker: /tmp/pip-build-tracker-g1xqvoi0 2024-12-17T13:03:36,484 Created temporary directory: /tmp/pip-wheel-l1ej2j_3 2024-12-17T13:03:36,488 Created temporary directory: /tmp/pip-ephem-wheel-cache-gak29_y5 2024-12-17T13:03:36,534 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-17T13:03:36,536 2 location(s) to search for versions of evalscope: 2024-12-17T13:03:36,536 * https://pypi.org/simple/evalscope/ 2024-12-17T13:03:36,536 * https://www.piwheels.org/simple/evalscope/ 2024-12-17T13:03:36,537 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2024-12-17T13:03:36,538 Getting page https://pypi.org/simple/evalscope/ 2024-12-17T13:03:36,540 Found index url https://pypi.org/simple/ 2024-12-17T13:03:36,764 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2024-12-17T13:03:36,772 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,773 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2024-12-17T13:03:36,774 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,775 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2024-12-17T13:03:36,775 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,776 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2024-12-17T13:03:36,777 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,778 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2024-12-17T13:03:36,778 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,779 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2024-12-17T13:03:36,780 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,781 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,782 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2024-12-17T13:03:36,782 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,783 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2024-12-17T13:03:36,784 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,785 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2024-12-17T13:03:36,785 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,786 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2024-12-17T13:03:36,787 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,788 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2024-12-17T13:03:36,788 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,789 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2024-12-17T13:03:36,790 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,791 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2024-12-17T13:03:36,791 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,792 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2024-12-17T13:03:36,793 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,794 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2024-12-17T13:03:36,795 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,795 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2024-12-17T13:03:36,796 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2024-12-17T13:03:36,797 Getting page https://www.piwheels.org/simple/evalscope/ 2024-12-17T13:03:36,798 Found index url https://www.piwheels.org/simple/ 2024-12-17T13:03:36,956 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2024-12-17T13:03:36,958 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,959 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,960 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,960 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-17T13:03:36,961 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2024-12-17T13:03:36,962 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2024-12-17T13:03:36,982 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2024-12-17T13:03:36,984 Collecting evalscope==0.8.1 2024-12-17T13:03:36,986 Created temporary directory: /tmp/pip-unpack-lcjv9vuw 2024-12-17T13:03:37,493 Downloading evalscope-0.8.1.tar.gz (1.3 MB) 2024-12-17T13:03:38,468 Added evalscope==0.8.1 from https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz to build tracker '/tmp/pip-build-tracker-g1xqvoi0' 2024-12-17T13:03:38,470 Running setup.py (path:/tmp/pip-wheel-l1ej2j_3/evalscope_bb0b7b6fd8a040f9b607be87f55a56b4/setup.py) egg_info for package evalscope 2024-12-17T13:03:38,471 Created temporary directory: /tmp/pip-pip-egg-info-4al7yxdi 2024-12-17T13:03:38,472 Preparing metadata (setup.py): started 2024-12-17T13:03:38,473 Running command python setup.py egg_info 2024-12-17T13:03:39,068 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-17T13:03:39,069 !! 2024-12-17T13:03:39,070 ******************************************************************************** 2024-12-17T13:03:39,071 Usage of dash-separated 'index-url' will not be supported in future 2024-12-17T13:03:39,071 versions. Please use the underscore name 'index_url' instead. 2024-12-17T13:03:39,072 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-17T13:03:39,073 or your builds will no longer be supported. 2024-12-17T13:03:39,074 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-17T13:03:39,074 ******************************************************************************** 2024-12-17T13:03:39,075 !! 2024-12-17T13:03:39,076 opt = self.warn_dash_deprecation(opt, section) 2024-12-17T13:03:39,639 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-17T13:03:39,639 !! 2024-12-17T13:03:39,640 ******************************************************************************** 2024-12-17T13:03:39,641 Usage of dash-separated 'index-url' will not be supported in future 2024-12-17T13:03:39,641 versions. Please use the underscore name 'index_url' instead. 2024-12-17T13:03:39,642 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-17T13:03:39,643 or your builds will no longer be supported. 2024-12-17T13:03:39,643 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-17T13:03:39,644 ******************************************************************************** 2024-12-17T13:03:39,645 !! 2024-12-17T13:03:39,646 opt = self.warn_dash_deprecation(opt, section) 2024-12-17T13:03:39,677 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-17T13:03:39,678 running egg_info 2024-12-17T13:03:39,705 creating /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info 2024-12-17T13:03:39,706 writing /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/PKG-INFO 2024-12-17T13:03:39,734 writing dependency_links to /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/dependency_links.txt 2024-12-17T13:03:39,735 writing entry points to /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/entry_points.txt 2024-12-17T13:03:39,748 writing requirements to /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/requires.txt 2024-12-17T13:03:39,750 writing top-level names to /tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/top_level.txt 2024-12-17T13:03:39,751 writing manifest file '/tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/SOURCES.txt' 2024-12-17T13:03:39,907 reading manifest file '/tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/SOURCES.txt' 2024-12-17T13:03:39,908 reading manifest template 'MANIFEST.in' 2024-12-17T13:03:40,031 adding license file 'LICENSE' 2024-12-17T13:03:40,045 writing manifest file '/tmp/pip-pip-egg-info-4al7yxdi/evalscope.egg-info/SOURCES.txt' 2024-12-17T13:03:40,159 Preparing metadata (setup.py): finished with status 'done' 2024-12-17T13:03:40,165 Source in /tmp/pip-wheel-l1ej2j_3/evalscope_bb0b7b6fd8a040f9b607be87f55a56b4 has version 0.8.1, which satisfies requirement evalscope==0.8.1 from https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz 2024-12-17T13:03:40,166 Removed evalscope==0.8.1 from https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz from build tracker '/tmp/pip-build-tracker-g1xqvoi0' 2024-12-17T13:03:40,221 Created temporary directory: /tmp/pip-unpack-o41g_vlp 2024-12-17T13:03:40,222 Created temporary directory: /tmp/pip-unpack-xuz8i0rz 2024-12-17T13:03:40,223 Building wheels for collected packages: evalscope 2024-12-17T13:03:40,228 Created temporary directory: /tmp/pip-wheel-flo99waa 2024-12-17T13:03:40,228 Building wheel for evalscope (setup.py): started 2024-12-17T13:03:40,230 Destination directory: /tmp/pip-wheel-flo99waa 2024-12-17T13:03:40,231 Running command python setup.py bdist_wheel 2024-12-17T13:03:40,692 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-17T13:03:40,794 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-17T13:03:40,794 !! 2024-12-17T13:03:40,795 ******************************************************************************** 2024-12-17T13:03:40,795 Usage of dash-separated 'index-url' will not be supported in future 2024-12-17T13:03:40,796 versions. Please use the underscore name 'index_url' instead. 2024-12-17T13:03:40,797 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-17T13:03:40,797 or your builds will no longer be supported. 2024-12-17T13:03:40,798 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-17T13:03:40,799 ******************************************************************************** 2024-12-17T13:03:40,800 !! 2024-12-17T13:03:40,800 opt = self.warn_dash_deprecation(opt, section) 2024-12-17T13:03:41,381 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-17T13:03:41,382 !! 2024-12-17T13:03:41,383 ******************************************************************************** 2024-12-17T13:03:41,383 Usage of dash-separated 'index-url' will not be supported in future 2024-12-17T13:03:41,384 versions. Please use the underscore name 'index_url' instead. 2024-12-17T13:03:41,385 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-17T13:03:41,386 or your builds will no longer be supported. 2024-12-17T13:03:41,387 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-17T13:03:41,388 ******************************************************************************** 2024-12-17T13:03:41,389 !! 2024-12-17T13:03:41,390 opt = self.warn_dash_deprecation(opt, section) 2024-12-17T13:03:41,391 running bdist_wheel 2024-12-17T13:03:41,529 running build 2024-12-17T13:03:41,530 running build_py 2024-12-17T13:03:41,561 creating build/lib/evalscope 2024-12-17T13:03:41,563 copying evalscope/version.py -> build/lib/evalscope 2024-12-17T13:03:41,565 copying evalscope/run.py -> build/lib/evalscope 2024-12-17T13:03:41,568 copying evalscope/config.py -> build/lib/evalscope 2024-12-17T13:03:41,570 copying evalscope/arguments.py -> build/lib/evalscope 2024-12-17T13:03:41,572 copying evalscope/run_arena.py -> build/lib/evalscope 2024-12-17T13:03:41,575 copying evalscope/__init__.py -> build/lib/evalscope 2024-12-17T13:03:41,576 copying evalscope/summarizer.py -> build/lib/evalscope 2024-12-17T13:03:41,579 copying evalscope/constants.py -> build/lib/evalscope 2024-12-17T13:03:41,582 creating build/lib/tests 2024-12-17T13:03:41,583 copying tests/__init__.py -> build/lib/tests 2024-12-17T13:03:41,584 copying tests/test_run_all.py -> build/lib/tests 2024-12-17T13:03:41,587 creating build/lib/evalscope/backend 2024-12-17T13:03:41,588 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2024-12-17T13:03:41,590 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2024-12-17T13:03:41,592 creating build/lib/evalscope/evaluator 2024-12-17T13:03:41,594 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2024-12-17T13:03:41,596 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2024-12-17T13:03:41,598 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2024-12-17T13:03:41,601 creating build/lib/evalscope/benchmarks 2024-12-17T13:03:41,602 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2024-12-17T13:03:41,605 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2024-12-17T13:03:41,607 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2024-12-17T13:03:41,609 creating build/lib/evalscope/models 2024-12-17T13:03:41,610 copying evalscope/models/openai_model.py -> build/lib/evalscope/models 2024-12-17T13:03:41,612 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2024-12-17T13:03:41,615 copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models 2024-12-17T13:03:41,617 copying evalscope/models/model_adapter.py -> build/lib/evalscope/models 2024-12-17T13:03:41,620 copying evalscope/models/model.py -> build/lib/evalscope/models 2024-12-17T13:03:41,623 creating build/lib/evalscope/cli 2024-12-17T13:03:41,624 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,626 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,628 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,630 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,632 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,633 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2024-12-17T13:03:41,636 creating build/lib/evalscope/metrics 2024-12-17T13:03:41,638 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2024-12-17T13:03:41,640 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2024-12-17T13:03:41,642 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2024-12-17T13:03:41,644 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2024-12-17T13:03:41,646 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2024-12-17T13:03:41,649 creating build/lib/evalscope/tools 2024-12-17T13:03:41,650 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2024-12-17T13:03:41,652 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2024-12-17T13:03:41,654 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2024-12-17T13:03:41,656 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2024-12-17T13:03:41,659 creating build/lib/evalscope/utils 2024-12-17T13:03:41,660 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,662 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,664 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,666 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,668 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,671 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,672 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,675 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2024-12-17T13:03:41,677 creating build/lib/evalscope/registry 2024-12-17T13:03:41,679 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2024-12-17T13:03:41,681 creating build/lib/evalscope/perf 2024-12-17T13:03:41,682 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2024-12-17T13:03:41,685 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2024-12-17T13:03:41,687 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2024-12-17T13:03:41,689 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2024-12-17T13:03:41,691 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2024-12-17T13:03:41,693 creating build/lib/evalscope/third_party 2024-12-17T13:03:41,695 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2024-12-17T13:03:41,697 creating build/lib/evalscope/backend/rag_eval 2024-12-17T13:03:41,698 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2024-12-17T13:03:41,701 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2024-12-17T13:03:41,704 creating build/lib/evalscope/backend/opencompass 2024-12-17T13:03:41,705 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2024-12-17T13:03:41,707 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2024-12-17T13:03:41,709 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2024-12-17T13:03:41,712 creating build/lib/evalscope/backend/vlm_eval_kit 2024-12-17T13:03:41,713 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-17T13:03:41,715 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-17T13:03:41,717 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-17T13:03:41,720 creating build/lib/evalscope/backend/rag_eval/ragas 2024-12-17T13:03:41,721 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-17T13:03:41,723 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-17T13:03:41,725 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-17T13:03:41,727 creating build/lib/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:41,728 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:41,730 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:41,732 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:41,734 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:41,736 creating build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,737 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,739 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,742 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,743 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,746 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-17T13:03:41,748 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:41,749 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:41,751 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:41,753 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:41,755 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:41,758 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,759 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,761 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,763 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,765 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,767 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:41,770 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,771 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,772 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,774 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,776 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,778 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,781 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,783 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,785 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:41,789 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:41,791 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:41,793 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:41,796 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:41,798 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:41,800 creating build/lib/evalscope/backend/opencompass/tasks 2024-12-17T13:03:41,802 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-17T13:03:41,804 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-17T13:03:41,805 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-17T13:03:41,808 creating build/lib/evalscope/evaluator/reviewer 2024-12-17T13:03:41,809 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2024-12-17T13:03:41,811 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2024-12-17T13:03:41,815 creating build/lib/evalscope/benchmarks/general_qa 2024-12-17T13:03:41,816 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-17T13:03:41,818 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-17T13:03:41,820 creating build/lib/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:41,821 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:41,824 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:41,825 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:41,828 creating build/lib/evalscope/benchmarks/ceval 2024-12-17T13:03:41,830 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2024-12-17T13:03:41,831 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2024-12-17T13:03:41,834 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2024-12-17T13:03:41,837 creating build/lib/evalscope/benchmarks/bbh 2024-12-17T13:03:41,838 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2024-12-17T13:03:41,840 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2024-12-17T13:03:41,842 creating build/lib/evalscope/benchmarks/truthful_qa 2024-12-17T13:03:41,843 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-17T13:03:41,845 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-17T13:03:41,848 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-17T13:03:41,851 creating build/lib/evalscope/benchmarks/cmmlu 2024-12-17T13:03:41,852 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-17T13:03:41,854 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-17T13:03:41,856 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-17T13:03:41,859 creating build/lib/evalscope/benchmarks/competition_math 2024-12-17T13:03:41,860 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-17T13:03:41,863 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-17T13:03:41,865 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-17T13:03:41,868 creating build/lib/evalscope/benchmarks/race 2024-12-17T13:03:41,869 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2024-12-17T13:03:41,871 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2024-12-17T13:03:41,874 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2024-12-17T13:03:41,877 creating build/lib/evalscope/benchmarks/arc 2024-12-17T13:03:41,879 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2024-12-17T13:03:41,881 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2024-12-17T13:03:41,884 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2024-12-17T13:03:41,888 creating build/lib/evalscope/benchmarks/hellaswag 2024-12-17T13:03:41,889 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-17T13:03:41,892 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-17T13:03:41,894 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-17T13:03:41,897 creating build/lib/evalscope/benchmarks/gsm8k 2024-12-17T13:03:41,898 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-17T13:03:41,901 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-17T13:03:41,903 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-17T13:03:41,906 creating build/lib/evalscope/benchmarks/humaneval 2024-12-17T13:03:41,907 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-17T13:03:41,909 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-17T13:03:41,911 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-17T13:03:41,914 creating build/lib/evalscope/benchmarks/mmlu 2024-12-17T13:03:41,915 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-17T13:03:41,917 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-17T13:03:41,919 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-17T13:03:41,922 creating build/lib/evalscope/models/api 2024-12-17T13:03:41,923 copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api 2024-12-17T13:03:41,925 copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api 2024-12-17T13:03:41,927 creating build/lib/evalscope/models/custom 2024-12-17T13:03:41,928 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2024-12-17T13:03:41,930 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2024-12-17T13:03:41,932 creating build/lib/evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:41,933 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:41,936 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:41,938 creating build/lib/evalscope/perf/utils 2024-12-17T13:03:41,939 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,941 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,943 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,945 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,947 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,949 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2024-12-17T13:03:41,951 creating build/lib/evalscope/perf/plugin 2024-12-17T13:03:41,952 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2024-12-17T13:03:41,954 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2024-12-17T13:03:41,956 creating build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,958 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,960 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,961 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,964 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,965 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-17T13:03:41,968 creating build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,969 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,971 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,973 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,975 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,976 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,978 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,980 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,982 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-17T13:03:41,985 creating build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,986 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,988 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,990 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,992 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,995 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:41,997 creating build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:41,998 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,000 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,002 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,004 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,006 creating build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,007 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,010 creating build/lib/evalscope/third_party/longbench_write/tools 2024-12-17T13:03:42,011 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-17T13:03:42,012 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-17T13:03:42,015 creating build/lib/evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:42,016 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:42,018 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:42,021 creating build/lib/tests/rag 2024-12-17T13:03:42,022 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2024-12-17T13:03:42,024 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2024-12-17T13:03:42,026 copying tests/rag/__init__.py -> build/lib/tests/rag 2024-12-17T13:03:42,028 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2024-12-17T13:03:42,031 creating build/lib/tests/vlm 2024-12-17T13:03:42,032 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2024-12-17T13:03:42,034 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2024-12-17T13:03:42,036 creating build/lib/tests/cli 2024-12-17T13:03:42,037 copying tests/cli/__init__.py -> build/lib/tests/cli 2024-12-17T13:03:42,039 copying tests/cli/test_run.py -> build/lib/tests/cli 2024-12-17T13:03:42,042 creating build/lib/tests/perf 2024-12-17T13:03:42,043 copying tests/perf/__init__.py -> build/lib/tests/perf 2024-12-17T13:03:42,045 copying tests/perf/test_perf.py -> build/lib/tests/perf 2024-12-17T13:03:42,047 creating build/lib/tests/swift 2024-12-17T13:03:42,048 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2024-12-17T13:03:42,051 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2024-12-17T13:03:42,053 copying tests/swift/__init__.py -> build/lib/tests/swift 2024-12-17T13:03:42,055 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2024-12-17T13:03:42,057 running egg_info 2024-12-17T13:03:42,087 writing evalscope.egg-info/PKG-INFO 2024-12-17T13:03:42,114 writing dependency_links to evalscope.egg-info/dependency_links.txt 2024-12-17T13:03:42,116 writing entry points to evalscope.egg-info/entry_points.txt 2024-12-17T13:03:42,129 writing requirements to evalscope.egg-info/requires.txt 2024-12-17T13:03:42,131 writing top-level names to evalscope.egg-info/top_level.txt 2024-12-17T13:03:42,239 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-17T13:03:42,258 reading manifest template 'MANIFEST.in' 2024-12-17T13:03:42,384 adding license file 'LICENSE' 2024-12-17T13:03:42,403 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-17T13:03:42,406 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2024-12-17T13:03:42,406 !! 2024-12-17T13:03:42,407 ******************************************************************************** 2024-12-17T13:03:42,408 ############################ 2024-12-17T13:03:42,408 # Package would be ignored # 2024-12-17T13:03:42,409 ############################ 2024-12-17T13:03:42,409 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2024-12-17T13:03:42,410 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,411 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,411 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2024-12-17T13:03:42,411 to the `packages` configuration field. 2024-12-17T13:03:42,412 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,413 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,414 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,415 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,415 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,416 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2024-12-17T13:03:42,417 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2024-12-17T13:03:42,417 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,418 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,418 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,419 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,420 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,422 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,422 even if it does not contain any `.py` files. 2024-12-17T13:03:42,423 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,423 directory, all directories are treated like packages. 2024-12-17T13:03:42,424 ******************************************************************************** 2024-12-17T13:03:42,425 !! 2024-12-17T13:03:42,426 check.warn(importable) 2024-12-17T13:03:42,426 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2024-12-17T13:03:42,427 !! 2024-12-17T13:03:42,428 ******************************************************************************** 2024-12-17T13:03:42,428 ############################ 2024-12-17T13:03:42,429 # Package would be ignored # 2024-12-17T13:03:42,430 ############################ 2024-12-17T13:03:42,430 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2024-12-17T13:03:42,431 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,432 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,432 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2024-12-17T13:03:42,433 to the `packages` configuration field. 2024-12-17T13:03:42,434 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,434 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,435 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,435 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,436 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,437 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2024-12-17T13:03:42,437 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2024-12-17T13:03:42,438 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,438 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,438 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,439 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,440 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,441 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,441 even if it does not contain any `.py` files. 2024-12-17T13:03:42,442 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,442 directory, all directories are treated like packages. 2024-12-17T13:03:42,442 ******************************************************************************** 2024-12-17T13:03:42,443 !! 2024-12-17T13:03:42,444 check.warn(importable) 2024-12-17T13:03:42,444 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is absent from the `packages` configuration. 2024-12-17T13:03:42,445 !! 2024-12-17T13:03:42,446 ******************************************************************************** 2024-12-17T13:03:42,447 ############################ 2024-12-17T13:03:42,447 # Package would be ignored # 2024-12-17T13:03:42,447 ############################ 2024-12-17T13:03:42,448 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' as an importable package[^1], 2024-12-17T13:03:42,448 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,450 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,450 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is explicitly added 2024-12-17T13:03:42,451 to the `packages` configuration field. 2024-12-17T13:03:42,451 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,452 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,452 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,453 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,454 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,455 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' to be distributed and are 2024-12-17T13:03:42,456 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' via 2024-12-17T13:03:42,456 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,457 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,457 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,458 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,459 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,460 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,460 even if it does not contain any `.py` files. 2024-12-17T13:03:42,461 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,461 directory, all directories are treated like packages. 2024-12-17T13:03:42,461 ******************************************************************************** 2024-12-17T13:03:42,462 !! 2024-12-17T13:03:42,463 check.warn(importable) 2024-12-17T13:03:42,463 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is absent from the `packages` configuration. 2024-12-17T13:03:42,463 !! 2024-12-17T13:03:42,464 ******************************************************************************** 2024-12-17T13:03:42,464 ############################ 2024-12-17T13:03:42,465 # Package would be ignored # 2024-12-17T13:03:42,465 ############################ 2024-12-17T13:03:42,465 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' as an importable package[^1], 2024-12-17T13:03:42,466 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,467 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,467 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is explicitly added 2024-12-17T13:03:42,468 to the `packages` configuration field. 2024-12-17T13:03:42,469 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,469 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,470 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,471 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,472 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,473 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' to be distributed and are 2024-12-17T13:03:42,473 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' via 2024-12-17T13:03:42,474 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,474 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,475 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,476 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,477 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,479 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,479 even if it does not contain any `.py` files. 2024-12-17T13:03:42,480 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,480 directory, all directories are treated like packages. 2024-12-17T13:03:42,481 ******************************************************************************** 2024-12-17T13:03:42,482 !! 2024-12-17T13:03:42,482 check.warn(importable) 2024-12-17T13:03:42,483 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is absent from the `packages` configuration. 2024-12-17T13:03:42,483 !! 2024-12-17T13:03:42,485 ******************************************************************************** 2024-12-17T13:03:42,485 ############################ 2024-12-17T13:03:42,485 # Package would be ignored # 2024-12-17T13:03:42,486 ############################ 2024-12-17T13:03:42,486 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' as an importable package[^1], 2024-12-17T13:03:42,487 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,487 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,488 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is explicitly added 2024-12-17T13:03:42,488 to the `packages` configuration field. 2024-12-17T13:03:42,489 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,489 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,490 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,490 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,491 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,492 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' to be distributed and are 2024-12-17T13:03:42,492 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' via 2024-12-17T13:03:42,493 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,493 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,494 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,495 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,496 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,498 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,498 even if it does not contain any `.py` files. 2024-12-17T13:03:42,499 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,499 directory, all directories are treated like packages. 2024-12-17T13:03:42,500 ******************************************************************************** 2024-12-17T13:03:42,501 !! 2024-12-17T13:03:42,502 check.warn(importable) 2024-12-17T13:03:42,502 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' is absent from the `packages` configuration. 2024-12-17T13:03:42,503 !! 2024-12-17T13:03:42,504 ******************************************************************************** 2024-12-17T13:03:42,504 ############################ 2024-12-17T13:03:42,505 # Package would be ignored # 2024-12-17T13:03:42,506 ############################ 2024-12-17T13:03:42,506 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' as an importable package[^1], 2024-12-17T13:03:42,507 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,508 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,508 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' is explicitly added 2024-12-17T13:03:42,509 to the `packages` configuration field. 2024-12-17T13:03:42,510 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,510 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,511 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,512 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,513 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,514 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' to be distributed and are 2024-12-17T13:03:42,514 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' via 2024-12-17T13:03:42,514 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,515 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,515 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,516 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,517 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,518 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,519 even if it does not contain any `.py` files. 2024-12-17T13:03:42,519 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,520 directory, all directories are treated like packages. 2024-12-17T13:03:42,520 ******************************************************************************** 2024-12-17T13:03:42,522 !! 2024-12-17T13:03:42,522 check.warn(importable) 2024-12-17T13:03:42,523 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is absent from the `packages` configuration. 2024-12-17T13:03:42,523 !! 2024-12-17T13:03:42,524 ******************************************************************************** 2024-12-17T13:03:42,525 ############################ 2024-12-17T13:03:42,525 # Package would be ignored # 2024-12-17T13:03:42,526 ############################ 2024-12-17T13:03:42,526 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' as an importable package[^1], 2024-12-17T13:03:42,527 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,528 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,528 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is explicitly added 2024-12-17T13:03:42,529 to the `packages` configuration field. 2024-12-17T13:03:42,530 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,531 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,531 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,532 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,533 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,534 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' to be distributed and are 2024-12-17T13:03:42,535 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' via 2024-12-17T13:03:42,536 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,536 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,537 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,538 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,539 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,540 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,541 even if it does not contain any `.py` files. 2024-12-17T13:03:42,541 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,541 directory, all directories are treated like packages. 2024-12-17T13:03:42,542 ******************************************************************************** 2024-12-17T13:03:42,542 !! 2024-12-17T13:03:42,543 check.warn(importable) 2024-12-17T13:03:42,543 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is absent from the `packages` configuration. 2024-12-17T13:03:42,544 !! 2024-12-17T13:03:42,544 ******************************************************************************** 2024-12-17T13:03:42,545 ############################ 2024-12-17T13:03:42,545 # Package would be ignored # 2024-12-17T13:03:42,546 ############################ 2024-12-17T13:03:42,546 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' as an importable package[^1], 2024-12-17T13:03:42,547 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,548 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,548 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is explicitly added 2024-12-17T13:03:42,549 to the `packages` configuration field. 2024-12-17T13:03:42,550 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,550 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,551 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,552 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,553 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,554 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' to be distributed and are 2024-12-17T13:03:42,554 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' via 2024-12-17T13:03:42,555 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,555 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,556 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,557 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,558 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,559 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,560 even if it does not contain any `.py` files. 2024-12-17T13:03:42,560 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,561 directory, all directories are treated like packages. 2024-12-17T13:03:42,561 ******************************************************************************** 2024-12-17T13:03:42,562 !! 2024-12-17T13:03:42,563 check.warn(importable) 2024-12-17T13:03:42,564 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is absent from the `packages` configuration. 2024-12-17T13:03:42,564 !! 2024-12-17T13:03:42,566 ******************************************************************************** 2024-12-17T13:03:42,566 ############################ 2024-12-17T13:03:42,567 # Package would be ignored # 2024-12-17T13:03:42,567 ############################ 2024-12-17T13:03:42,568 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' as an importable package[^1], 2024-12-17T13:03:42,569 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,570 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,570 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is explicitly added 2024-12-17T13:03:42,571 to the `packages` configuration field. 2024-12-17T13:03:42,572 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,572 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,573 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,574 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,575 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,575 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' to be distributed and are 2024-12-17T13:03:42,576 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' via 2024-12-17T13:03:42,576 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,577 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,577 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,578 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,579 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,581 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,581 even if it does not contain any `.py` files. 2024-12-17T13:03:42,582 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,583 directory, all directories are treated like packages. 2024-12-17T13:03:42,583 ******************************************************************************** 2024-12-17T13:03:42,584 !! 2024-12-17T13:03:42,585 check.warn(importable) 2024-12-17T13:03:42,585 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-17T13:03:42,586 !! 2024-12-17T13:03:42,587 ******************************************************************************** 2024-12-17T13:03:42,587 ############################ 2024-12-17T13:03:42,588 # Package would be ignored # 2024-12-17T13:03:42,588 ############################ 2024-12-17T13:03:42,589 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-17T13:03:42,590 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,591 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,591 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is explicitly added 2024-12-17T13:03:42,592 to the `packages` configuration field. 2024-12-17T13:03:42,593 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,594 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,594 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,595 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,596 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,597 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' to be distributed and are 2024-12-17T13:03:42,597 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' via 2024-12-17T13:03:42,598 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,598 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,599 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,600 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,600 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,602 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,603 even if it does not contain any `.py` files. 2024-12-17T13:03:42,603 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,604 directory, all directories are treated like packages. 2024-12-17T13:03:42,604 ******************************************************************************** 2024-12-17T13:03:42,605 !! 2024-12-17T13:03:42,606 check.warn(importable) 2024-12-17T13:03:42,606 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is absent from the `packages` configuration. 2024-12-17T13:03:42,607 !! 2024-12-17T13:03:42,608 ******************************************************************************** 2024-12-17T13:03:42,608 ############################ 2024-12-17T13:03:42,609 # Package would be ignored # 2024-12-17T13:03:42,609 ############################ 2024-12-17T13:03:42,610 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' as an importable package[^1], 2024-12-17T13:03:42,610 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,611 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,612 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is explicitly added 2024-12-17T13:03:42,612 to the `packages` configuration field. 2024-12-17T13:03:42,613 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,614 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,614 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,615 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,616 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,618 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' to be distributed and are 2024-12-17T13:03:42,618 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' via 2024-12-17T13:03:42,619 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,619 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,620 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,622 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,622 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,624 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,625 even if it does not contain any `.py` files. 2024-12-17T13:03:42,625 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,626 directory, all directories are treated like packages. 2024-12-17T13:03:42,626 ******************************************************************************** 2024-12-17T13:03:42,627 !! 2024-12-17T13:03:42,628 check.warn(importable) 2024-12-17T13:03:42,629 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is absent from the `packages` configuration. 2024-12-17T13:03:42,629 !! 2024-12-17T13:03:42,630 ******************************************************************************** 2024-12-17T13:03:42,631 ############################ 2024-12-17T13:03:42,632 # Package would be ignored # 2024-12-17T13:03:42,632 ############################ 2024-12-17T13:03:42,632 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' as an importable package[^1], 2024-12-17T13:03:42,633 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,634 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,634 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is explicitly added 2024-12-17T13:03:42,635 to the `packages` configuration field. 2024-12-17T13:03:42,635 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,636 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,636 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,637 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,638 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,640 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' to be distributed and are 2024-12-17T13:03:42,640 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' via 2024-12-17T13:03:42,641 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,641 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,642 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,643 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,644 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,645 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,646 even if it does not contain any `.py` files. 2024-12-17T13:03:42,646 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,647 directory, all directories are treated like packages. 2024-12-17T13:03:42,648 ******************************************************************************** 2024-12-17T13:03:42,650 !! 2024-12-17T13:03:42,650 check.warn(importable) 2024-12-17T13:03:42,651 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is absent from the `packages` configuration. 2024-12-17T13:03:42,651 !! 2024-12-17T13:03:42,653 ******************************************************************************** 2024-12-17T13:03:42,654 ############################ 2024-12-17T13:03:42,654 # Package would be ignored # 2024-12-17T13:03:42,655 ############################ 2024-12-17T13:03:42,655 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' as an importable package[^1], 2024-12-17T13:03:42,656 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,659 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,661 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is explicitly added 2024-12-17T13:03:42,662 to the `packages` configuration field. 2024-12-17T13:03:42,663 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,664 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,665 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,666 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,667 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' to be distributed and are 2024-12-17T13:03:42,667 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' via 2024-12-17T13:03:42,668 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,668 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,669 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,670 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,677 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,688 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,689 even if it does not contain any `.py` files. 2024-12-17T13:03:42,689 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,690 directory, all directories are treated like packages. 2024-12-17T13:03:42,690 ******************************************************************************** 2024-12-17T13:03:42,692 !! 2024-12-17T13:03:42,692 check.warn(importable) 2024-12-17T13:03:42,692 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-17T13:03:42,693 !! 2024-12-17T13:03:42,694 ******************************************************************************** 2024-12-17T13:03:42,695 ############################ 2024-12-17T13:03:42,695 # Package would be ignored # 2024-12-17T13:03:42,696 ############################ 2024-12-17T13:03:42,697 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-17T13:03:42,698 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,699 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,699 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is explicitly added 2024-12-17T13:03:42,700 to the `packages` configuration field. 2024-12-17T13:03:42,701 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,702 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,702 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,703 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,704 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,705 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' to be distributed and are 2024-12-17T13:03:42,705 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' via 2024-12-17T13:03:42,706 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,707 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,708 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,709 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,711 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,711 even if it does not contain any `.py` files. 2024-12-17T13:03:42,712 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,712 directory, all directories are treated like packages. 2024-12-17T13:03:42,713 ******************************************************************************** 2024-12-17T13:03:42,714 !! 2024-12-17T13:03:42,714 check.warn(importable) 2024-12-17T13:03:42,715 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is absent from the `packages` configuration. 2024-12-17T13:03:42,715 !! 2024-12-17T13:03:42,716 ******************************************************************************** 2024-12-17T13:03:42,717 ############################ 2024-12-17T13:03:42,718 # Package would be ignored # 2024-12-17T13:03:42,718 ############################ 2024-12-17T13:03:42,719 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' as an importable package[^1], 2024-12-17T13:03:42,719 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,721 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,721 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is explicitly added 2024-12-17T13:03:42,722 to the `packages` configuration field. 2024-12-17T13:03:42,723 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,723 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,724 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,725 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,726 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,727 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' to be distributed and are 2024-12-17T13:03:42,728 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' via 2024-12-17T13:03:42,728 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,729 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,730 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,742 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,744 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,746 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,746 even if it does not contain any `.py` files. 2024-12-17T13:03:42,747 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,748 directory, all directories are treated like packages. 2024-12-17T13:03:42,749 ******************************************************************************** 2024-12-17T13:03:42,751 !! 2024-12-17T13:03:42,751 check.warn(importable) 2024-12-17T13:03:42,752 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is absent from the `packages` configuration. 2024-12-17T13:03:42,752 !! 2024-12-17T13:03:42,753 ******************************************************************************** 2024-12-17T13:03:42,754 ############################ 2024-12-17T13:03:42,755 # Package would be ignored # 2024-12-17T13:03:42,755 ############################ 2024-12-17T13:03:42,756 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' as an importable package[^1], 2024-12-17T13:03:42,756 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,758 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,758 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is explicitly added 2024-12-17T13:03:42,759 to the `packages` configuration field. 2024-12-17T13:03:42,760 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,761 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,761 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,762 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,763 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,764 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' to be distributed and are 2024-12-17T13:03:42,765 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' via 2024-12-17T13:03:42,765 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,766 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,766 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,767 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,768 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,770 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,771 even if it does not contain any `.py` files. 2024-12-17T13:03:42,771 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,772 directory, all directories are treated like packages. 2024-12-17T13:03:42,772 ******************************************************************************** 2024-12-17T13:03:42,774 !! 2024-12-17T13:03:42,774 check.warn(importable) 2024-12-17T13:03:42,775 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2024-12-17T13:03:42,776 !! 2024-12-17T13:03:42,776 ******************************************************************************** 2024-12-17T13:03:42,777 ############################ 2024-12-17T13:03:42,777 # Package would be ignored # 2024-12-17T13:03:42,778 ############################ 2024-12-17T13:03:42,778 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2024-12-17T13:03:42,779 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,779 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,780 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2024-12-17T13:03:42,780 to the `packages` configuration field. 2024-12-17T13:03:42,781 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,782 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,782 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,783 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,784 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,785 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2024-12-17T13:03:42,786 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2024-12-17T13:03:42,786 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,787 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,787 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,788 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,790 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,791 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,792 even if it does not contain any `.py` files. 2024-12-17T13:03:42,792 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,793 directory, all directories are treated like packages. 2024-12-17T13:03:42,793 ******************************************************************************** 2024-12-17T13:03:42,794 !! 2024-12-17T13:03:42,795 check.warn(importable) 2024-12-17T13:03:42,795 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2024-12-17T13:03:42,796 !! 2024-12-17T13:03:42,797 ******************************************************************************** 2024-12-17T13:03:42,798 ############################ 2024-12-17T13:03:42,798 # Package would be ignored # 2024-12-17T13:03:42,799 ############################ 2024-12-17T13:03:42,799 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2024-12-17T13:03:42,800 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,801 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,801 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2024-12-17T13:03:42,802 to the `packages` configuration field. 2024-12-17T13:03:42,803 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,804 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,804 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,805 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,806 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,807 If you don't want 'evalscope.metrics.resources' to be distributed and are 2024-12-17T13:03:42,808 already explicitly excluding 'evalscope.metrics.resources' via 2024-12-17T13:03:42,808 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,808 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,809 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,810 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,811 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,812 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,812 even if it does not contain any `.py` files. 2024-12-17T13:03:42,813 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,813 directory, all directories are treated like packages. 2024-12-17T13:03:42,814 ******************************************************************************** 2024-12-17T13:03:42,815 !! 2024-12-17T13:03:42,815 check.warn(importable) 2024-12-17T13:03:42,816 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2024-12-17T13:03:42,816 !! 2024-12-17T13:03:42,817 ******************************************************************************** 2024-12-17T13:03:42,818 ############################ 2024-12-17T13:03:42,818 # Package would be ignored # 2024-12-17T13:03:42,819 ############################ 2024-12-17T13:03:42,819 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2024-12-17T13:03:42,820 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,821 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,822 package, please make sure that 'evalscope.registry.config' is explicitly added 2024-12-17T13:03:42,822 to the `packages` configuration field. 2024-12-17T13:03:42,823 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,824 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,824 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,825 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,827 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,828 If you don't want 'evalscope.registry.config' to be distributed and are 2024-12-17T13:03:42,828 already explicitly excluding 'evalscope.registry.config' via 2024-12-17T13:03:42,829 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,829 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,830 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,831 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,832 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,834 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,835 even if it does not contain any `.py` files. 2024-12-17T13:03:42,835 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,836 directory, all directories are treated like packages. 2024-12-17T13:03:42,837 ******************************************************************************** 2024-12-17T13:03:42,838 !! 2024-12-17T13:03:42,838 check.warn(importable) 2024-12-17T13:03:42,839 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2024-12-17T13:03:42,839 !! 2024-12-17T13:03:42,840 ******************************************************************************** 2024-12-17T13:03:42,841 ############################ 2024-12-17T13:03:42,842 # Package would be ignored # 2024-12-17T13:03:42,842 ############################ 2024-12-17T13:03:42,842 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2024-12-17T13:03:42,843 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,844 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,844 package, please make sure that 'evalscope.registry.data' is explicitly added 2024-12-17T13:03:42,845 to the `packages` configuration field. 2024-12-17T13:03:42,846 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,846 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,847 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,848 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,849 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,850 If you don't want 'evalscope.registry.data' to be distributed and are 2024-12-17T13:03:42,850 already explicitly excluding 'evalscope.registry.data' via 2024-12-17T13:03:42,851 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,851 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,852 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,853 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,854 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,856 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,856 even if it does not contain any `.py` files. 2024-12-17T13:03:42,857 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,858 directory, all directories are treated like packages. 2024-12-17T13:03:42,858 ******************************************************************************** 2024-12-17T13:03:42,859 !! 2024-12-17T13:03:42,860 check.warn(importable) 2024-12-17T13:03:42,860 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2024-12-17T13:03:42,861 !! 2024-12-17T13:03:42,862 ******************************************************************************** 2024-12-17T13:03:42,863 ############################ 2024-12-17T13:03:42,863 # Package would be ignored # 2024-12-17T13:03:42,864 ############################ 2024-12-17T13:03:42,864 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2024-12-17T13:03:42,865 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,866 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,867 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2024-12-17T13:03:42,867 to the `packages` configuration field. 2024-12-17T13:03:42,868 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,869 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,869 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,870 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,871 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,872 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2024-12-17T13:03:42,872 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2024-12-17T13:03:42,873 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,873 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,874 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,875 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,876 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,877 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,877 even if it does not contain any `.py` files. 2024-12-17T13:03:42,878 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,878 directory, all directories are treated like packages. 2024-12-17T13:03:42,879 ******************************************************************************** 2024-12-17T13:03:42,880 !! 2024-12-17T13:03:42,880 check.warn(importable) 2024-12-17T13:03:42,881 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2024-12-17T13:03:42,882 !! 2024-12-17T13:03:42,883 ******************************************************************************** 2024-12-17T13:03:42,883 ############################ 2024-12-17T13:03:42,884 # Package would be ignored # 2024-12-17T13:03:42,884 ############################ 2024-12-17T13:03:42,885 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2024-12-17T13:03:42,886 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,887 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,887 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2024-12-17T13:03:42,888 to the `packages` configuration field. 2024-12-17T13:03:42,889 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,889 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,890 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,891 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,892 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,893 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2024-12-17T13:03:42,894 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2024-12-17T13:03:42,894 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,895 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,896 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,897 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,898 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,899 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,899 even if it does not contain any `.py` files. 2024-12-17T13:03:42,900 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,900 directory, all directories are treated like packages. 2024-12-17T13:03:42,901 ******************************************************************************** 2024-12-17T13:03:42,902 !! 2024-12-17T13:03:42,902 check.warn(importable) 2024-12-17T13:03:42,903 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2024-12-17T13:03:42,903 !! 2024-12-17T13:03:42,904 ******************************************************************************** 2024-12-17T13:03:42,905 ############################ 2024-12-17T13:03:42,905 # Package would be ignored # 2024-12-17T13:03:42,906 ############################ 2024-12-17T13:03:42,906 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2024-12-17T13:03:42,907 but it is absent from setuptools' `packages` configuration. 2024-12-17T13:03:42,908 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-17T13:03:42,908 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2024-12-17T13:03:42,909 to the `packages` configuration field. 2024-12-17T13:03:42,910 Alternatively, you can also rely on setuptools' discovery methods 2024-12-17T13:03:42,910 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-17T13:03:42,911 instead of `find_packages(...)`/`find:`). 2024-12-17T13:03:42,912 You can read more about "package discovery" on setuptools documentation page: 2024-12-17T13:03:42,913 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-17T13:03:42,914 If you don't want 'evalscope.registry.tasks' to be distributed and are 2024-12-17T13:03:42,914 already explicitly excluding 'evalscope.registry.tasks' via 2024-12-17T13:03:42,915 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-17T13:03:42,915 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-17T13:03:42,916 combination with a more fine grained `package-data` configuration. 2024-12-17T13:03:42,917 You can read more about "package data files" on setuptools documentation page: 2024-12-17T13:03:42,919 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-17T13:03:42,921 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-17T13:03:42,921 even if it does not contain any `.py` files. 2024-12-17T13:03:42,922 On the other hand, currently there is no concept of package data 2024-12-17T13:03:42,923 directory, all directories are treated like packages. 2024-12-17T13:03:42,923 ******************************************************************************** 2024-12-17T13:03:42,925 !! 2024-12-17T13:03:42,925 check.warn(importable) 2024-12-17T13:03:42,926 creating build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,927 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,927 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,928 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,928 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,929 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,929 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,930 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,930 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,930 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,931 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,931 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-17T13:03:42,932 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,932 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,933 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,933 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,934 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,934 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,937 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,938 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,939 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,940 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,940 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,941 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,941 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,942 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,942 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,943 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,943 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,944 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,945 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,945 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,946 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,946 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,947 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,948 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,948 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,949 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,949 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,950 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:42,950 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,951 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,951 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,951 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:42,952 creating build/lib/evalscope/metrics/resources 2024-12-17T13:03:42,952 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2024-12-17T13:03:42,953 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2024-12-17T13:03:42,953 creating build/lib/evalscope/registry/config 2024-12-17T13:03:42,954 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2024-12-17T13:03:42,954 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2024-12-17T13:03:42,955 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2024-12-17T13:03:42,956 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2024-12-17T13:03:42,956 creating build/lib/evalscope/registry/data 2024-12-17T13:03:42,957 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2024-12-17T13:03:42,957 creating build/lib/evalscope/registry/data/prompt_template 2024-12-17T13:03:42,958 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-17T13:03:42,958 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-17T13:03:42,959 creating build/lib/evalscope/registry/data/qa_browser 2024-12-17T13:03:42,959 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2024-12-17T13:03:42,960 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2024-12-17T13:03:42,960 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-17T13:03:42,961 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-17T13:03:42,962 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:42,962 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:42,963 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:42,963 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-17T13:03:42,964 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-17T13:03:42,965 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-17T13:03:42,965 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-17T13:03:42,966 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-17T13:03:42,966 copying evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-17T13:03:42,967 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:42,967 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:42,967 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:42,968 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-17T13:03:42,968 copying evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-17T13:03:42,969 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:42,969 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:42,970 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:42,971 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:42,971 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:42,972 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:42,972 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:42,973 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-17T13:03:42,974 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-17T13:03:42,974 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-17T13:03:42,975 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-17T13:03:42,976 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-17T13:03:42,976 copying evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-17T13:03:42,977 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:42,978 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:42,978 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:42,978 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-17T13:03:42,979 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-17T13:03:42,979 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-17T13:03:42,980 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-17T13:03:42,980 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:42,981 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:42,981 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:42,982 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:42,982 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2024-12-17T13:03:42,983 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2024-12-17T13:03:42,983 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2024-12-17T13:03:42,984 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2024-12-17T13:03:42,984 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:42,985 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:42,985 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2024-12-17T13:03:42,986 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,987 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,987 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,988 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2024-12-17T13:03:42,988 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-17T13:03:42,989 !! 2024-12-17T13:03:42,990 ******************************************************************************** 2024-12-17T13:03:42,990 Please avoid running ``setup.py`` directly. 2024-12-17T13:03:42,991 Instead, use pypa/build, pypa/installer or other 2024-12-17T13:03:42,991 standards-based tools. 2024-12-17T13:03:42,993 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-17T13:03:42,993 ******************************************************************************** 2024-12-17T13:03:42,995 !! 2024-12-17T13:03:42,995 self.initialize_options() 2024-12-17T13:03:43,006 installing to build/bdist.linux-armv7l/wheel 2024-12-17T13:03:43,006 running install 2024-12-17T13:03:43,031 running install_lib 2024-12-17T13:03:43,060 creating build/bdist.linux-armv7l/wheel 2024-12-17T13:03:43,062 creating build/bdist.linux-armv7l/wheel/evalscope 2024-12-17T13:03:43,064 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,066 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2024-12-17T13:03:43,067 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-17T13:03:43,069 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2024-12-17T13:03:43,071 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2024-12-17T13:03:43,073 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,074 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,077 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,079 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,080 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,082 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-17T13:03:43,084 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-17T13:03:43,086 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-17T13:03:43,089 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2024-12-17T13:03:43,090 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese 2024-12-17T13:03:43,092 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-17T13:03:43,094 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-17T13:03:43,096 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:43,097 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:43,099 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-17T13:03:43,102 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-17T13:03:43,103 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-17T13:03:43,106 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:43,107 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:43,110 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-17T13:03:43,112 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-17T13:03:43,113 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-17T13:03:43,116 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-17T13:03:43,117 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-17T13:03:43,119 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:43,121 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:43,123 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-17T13:03:43,125 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-17T13:03:43,126 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-17T13:03:43,129 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:43,130 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:43,132 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-17T13:03:43,135 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-17T13:03:43,136 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-17T13:03:43,139 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-17T13:03:43,140 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-17T13:03:43,142 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:43,144 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:43,146 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:43,148 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-17T13:03:43,150 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-17T13:03:43,151 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-17T13:03:43,154 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-17T13:03:43,155 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-17T13:03:43,157 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2024-12-17T13:03:43,159 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-17T13:03:43,161 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-17T13:03:43,163 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-17T13:03:43,165 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:43,167 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,168 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,170 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,172 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,174 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,176 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,178 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,181 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,183 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-17T13:03:43,186 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:43,187 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:43,189 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:43,191 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-17T13:03:43,194 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,195 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,197 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,199 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,200 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,203 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-17T13:03:43,205 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:43,207 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:43,208 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:43,210 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:43,212 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:43,214 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-17T13:03:43,216 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:43,218 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:43,220 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:43,223 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:43,224 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:43,226 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-17T13:03:43,228 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-17T13:03:43,231 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2024-12-17T13:03:43,232 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2024-12-17T13:03:43,234 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-17T13:03:43,236 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-17T13:03:43,238 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-17T13:03:43,241 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-17T13:03:43,244 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-17T13:03:43,246 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-17T13:03:43,248 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-17T13:03:43,250 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2024-12-17T13:03:43,251 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-17T13:03:43,253 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-17T13:03:43,255 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-17T13:03:43,258 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2024-12-17T13:03:43,259 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-17T13:03:43,262 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2024-12-17T13:03:43,263 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-17T13:03:43,265 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-17T13:03:43,267 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-17T13:03:43,269 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-17T13:03:43,271 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,274 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2024-12-17T13:03:43,275 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-17T13:03:43,278 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2024-12-17T13:03:43,280 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-17T13:03:43,282 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-17T13:03:43,285 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2024-12-17T13:03:43,286 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-17T13:03:43,288 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-17T13:03:43,290 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-17T13:03:43,292 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-17T13:03:43,294 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2024-12-17T13:03:43,296 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-17T13:03:43,298 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-17T13:03:43,300 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-17T13:03:43,302 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-17T13:03:43,305 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2024-12-17T13:03:43,306 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-17T13:03:43,309 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,311 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,312 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,314 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,316 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,318 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,320 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,322 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,324 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,326 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,328 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,330 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,332 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,334 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,335 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,338 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,340 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,342 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,344 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,346 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,348 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,350 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,351 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,354 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,355 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,357 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,359 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,361 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-17T13:03:43,363 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-17T13:03:43,365 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2024-12-17T13:03:43,367 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-17T13:03:43,368 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-17T13:03:43,371 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-17T13:03:43,374 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2024-12-17T13:03:43,375 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-17T13:03:43,377 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-17T13:03:43,380 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-17T13:03:43,382 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-17T13:03:43,385 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2024-12-17T13:03:43,386 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-17T13:03:43,388 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-17T13:03:43,390 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-17T13:03:43,392 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-17T13:03:43,394 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2024-12-17T13:03:43,396 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-17T13:03:43,398 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-17T13:03:43,400 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-17T13:03:43,402 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-17T13:03:43,404 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2024-12-17T13:03:43,406 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-17T13:03:43,407 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-17T13:03:43,410 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-17T13:03:43,412 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2024-12-17T13:03:43,413 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-17T13:03:43,415 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-17T13:03:43,417 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-17T13:03:43,420 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2024-12-17T13:03:43,421 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-17T13:03:43,424 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-17T13:03:43,426 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-17T13:03:43,428 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2024-12-17T13:03:43,430 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-17T13:03:43,432 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-17T13:03:43,434 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-17T13:03:43,436 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-17T13:03:43,438 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2024-12-17T13:03:43,440 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-17T13:03:43,442 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-17T13:03:43,444 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-17T13:03:43,447 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-17T13:03:43,449 creating build/bdist.linux-armv7l/wheel/evalscope/models 2024-12-17T13:03:43,451 creating build/bdist.linux-armv7l/wheel/evalscope/models/api 2024-12-17T13:03:43,452 copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-17T13:03:43,454 copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-17T13:03:43,457 copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-17T13:03:43,459 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-17T13:03:43,461 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2024-12-17T13:03:43,462 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-17T13:03:43,464 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-17T13:03:43,466 copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-17T13:03:43,468 copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-17T13:03:43,470 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-17T13:03:43,472 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,475 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,477 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2024-12-17T13:03:43,479 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,481 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,483 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,486 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,488 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,490 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-17T13:03:43,493 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,496 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,498 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,501 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2024-12-17T13:03:43,503 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-17T13:03:43,505 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-17T13:03:43,507 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2024-12-17T13:03:43,509 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-17T13:03:43,520 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-17T13:03:43,543 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:43,544 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:43,547 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-17T13:03:43,548 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-17T13:03:43,550 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-17T13:03:43,552 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-17T13:03:43,556 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2024-12-17T13:03:43,557 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-17T13:03:43,559 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-17T13:03:43,562 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-17T13:03:43,563 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-17T13:03:43,566 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2024-12-17T13:03:43,567 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,570 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,572 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,574 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,576 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,578 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,580 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,582 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-17T13:03:43,585 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2024-12-17T13:03:43,587 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2024-12-17T13:03:43,588 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,590 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,592 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,594 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,596 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,599 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,601 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,603 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,605 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,607 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,610 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-17T13:03:43,612 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2024-12-17T13:03:43,614 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2024-12-17T13:03:43,616 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-17T13:03:43,618 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-17T13:03:43,620 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-17T13:03:43,623 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-17T13:03:43,626 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2024-12-17T13:03:43,627 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2024-12-17T13:03:43,629 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-17T13:03:43,631 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-17T13:03:43,634 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2024-12-17T13:03:43,639 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2024-12-17T13:03:43,640 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-17T13:03:43,643 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-17T13:03:43,669 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2024-12-17T13:03:43,670 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-17T13:03:43,673 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-17T13:03:43,676 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-17T13:03:43,679 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2024-12-17T13:03:43,681 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,684 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,686 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,689 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,691 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,694 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-17T13:03:43,696 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-17T13:03:43,699 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2024-12-17T13:03:43,703 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2024-12-17T13:03:43,705 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-17T13:03:43,709 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-17T13:03:43,714 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-17T13:03:43,719 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-17T13:03:43,725 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-17T13:03:43,732 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-17T13:03:43,738 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-17T13:03:43,741 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2024-12-17T13:03:43,742 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,746 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,748 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,752 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,755 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,760 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,763 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,766 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-17T13:03:43,769 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-17T13:03:43,771 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-17T13:03:43,780 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2024-12-17T13:03:43,781 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2024-12-17T13:03:43,784 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2024-12-17T13:03:43,785 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,788 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,791 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,794 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,795 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,798 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,801 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,803 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,806 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-17T13:03:43,810 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,812 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,816 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2024-12-17T13:03:43,818 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-17T13:03:43,820 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-17T13:03:43,823 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,826 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,829 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-17T13:03:43,832 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2024-12-17T13:03:43,833 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,835 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,838 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,840 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,842 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,845 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:43,846 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:43,848 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-17T13:03:43,850 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,853 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,856 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-17T13:03:43,859 creating build/bdist.linux-armv7l/wheel/tests 2024-12-17T13:03:43,862 creating build/bdist.linux-armv7l/wheel/tests/rag 2024-12-17T13:03:43,863 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-17T13:03:43,865 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-17T13:03:43,867 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-17T13:03:43,869 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-17T13:03:43,872 creating build/bdist.linux-armv7l/wheel/tests/vlm 2024-12-17T13:03:43,874 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-17T13:03:43,876 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-17T13:03:43,878 creating build/bdist.linux-armv7l/wheel/tests/cli 2024-12-17T13:03:43,879 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-17T13:03:43,882 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-17T13:03:43,884 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-17T13:03:43,886 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-17T13:03:43,888 creating build/bdist.linux-armv7l/wheel/tests/perf 2024-12-17T13:03:43,889 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-17T13:03:43,891 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-17T13:03:43,894 creating build/bdist.linux-armv7l/wheel/tests/swift 2024-12-17T13:03:43,895 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-17T13:03:43,898 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-17T13:03:43,900 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-17T13:03:43,902 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-17T13:03:43,904 running install_egg_info 2024-12-17T13:03:43,938 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.8.1-py3.11.egg-info 2024-12-17T13:03:43,955 running install_scripts 2024-12-17T13:03:44,004 creating build/bdist.linux-armv7l/wheel/evalscope-0.8.1.dist-info/WHEEL 2024-12-17T13:03:44,006 creating '/tmp/pip-wheel-flo99waa/evalscope-0.8.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-17T13:03:44,009 adding 'evalscope/__init__.py' 2024-12-17T13:03:44,010 adding 'evalscope/arguments.py' 2024-12-17T13:03:44,012 adding 'evalscope/config.py' 2024-12-17T13:03:44,014 adding 'evalscope/constants.py' 2024-12-17T13:03:44,016 adding 'evalscope/run.py' 2024-12-17T13:03:44,017 adding 'evalscope/run_arena.py' 2024-12-17T13:03:44,019 adding 'evalscope/summarizer.py' 2024-12-17T13:03:44,020 adding 'evalscope/version.py' 2024-12-17T13:03:44,023 adding 'evalscope/backend/__init__.py' 2024-12-17T13:03:44,024 adding 'evalscope/backend/base.py' 2024-12-17T13:03:44,026 adding 'evalscope/backend/opencompass/__init__.py' 2024-12-17T13:03:44,027 adding 'evalscope/backend/opencompass/api_meta_template.py' 2024-12-17T13:03:44,029 adding 'evalscope/backend/opencompass/backend_manager.py' 2024-12-17T13:03:44,031 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2024-12-17T13:03:44,032 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2024-12-17T13:03:44,034 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2024-12-17T13:03:44,036 adding 'evalscope/backend/rag_eval/__init__.py' 2024-12-17T13:03:44,037 adding 'evalscope/backend/rag_eval/backend_manager.py' 2024-12-17T13:03:44,039 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2024-12-17T13:03:44,040 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2024-12-17T13:03:44,042 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2024-12-17T13:03:44,043 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2024-12-17T13:03:44,045 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2024-12-17T13:03:44,046 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2024-12-17T13:03:44,048 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2024-12-17T13:03:44,049 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2024-12-17T13:03:44,052 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2024-12-17T13:03:44,053 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2024-12-17T13:03:44,055 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2024-12-17T13:03:44,056 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2024-12-17T13:03:44,057 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2024-12-17T13:03:44,059 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2024-12-17T13:03:44,061 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2024-12-17T13:03:44,063 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2024-12-17T13:03:44,064 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2024-12-17T13:03:44,065 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2024-12-17T13:03:44,067 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2024-12-17T13:03:44,068 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2024-12-17T13:03:44,070 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2024-12-17T13:03:44,071 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2024-12-17T13:03:44,073 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2024-12-17T13:03:44,074 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2024-12-17T13:03:44,075 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2024-12-17T13:03:44,077 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2024-12-17T13:03:44,080 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json' 2024-12-17T13:03:44,081 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json' 2024-12-17T13:03:44,083 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json' 2024-12-17T13:03:44,085 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json' 2024-12-17T13:03:44,087 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json' 2024-12-17T13:03:44,088 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json' 2024-12-17T13:03:44,090 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json' 2024-12-17T13:03:44,092 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json' 2024-12-17T13:03:44,093 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json' 2024-12-17T13:03:44,094 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-17T13:03:44,096 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-17T13:03:44,098 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-17T13:03:44,099 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-17T13:03:44,101 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json' 2024-12-17T13:03:44,103 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json' 2024-12-17T13:03:44,104 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json' 2024-12-17T13:03:44,106 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-17T13:03:44,108 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-17T13:03:44,109 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json' 2024-12-17T13:03:44,111 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json' 2024-12-17T13:03:44,113 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2024-12-17T13:03:44,114 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2024-12-17T13:03:44,116 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2024-12-17T13:03:44,117 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2024-12-17T13:03:44,118 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2024-12-17T13:03:44,120 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2024-12-17T13:03:44,121 adding 'evalscope/backend/rag_eval/utils/clip.py' 2024-12-17T13:03:44,123 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2024-12-17T13:03:44,124 adding 'evalscope/backend/rag_eval/utils/llm.py' 2024-12-17T13:03:44,125 adding 'evalscope/backend/rag_eval/utils/tools.py' 2024-12-17T13:03:44,127 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2024-12-17T13:03:44,129 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2024-12-17T13:03:44,130 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2024-12-17T13:03:44,132 adding 'evalscope/benchmarks/__init__.py' 2024-12-17T13:03:44,133 adding 'evalscope/benchmarks/benchmark.py' 2024-12-17T13:03:44,135 adding 'evalscope/benchmarks/data_adapter.py' 2024-12-17T13:03:44,137 adding 'evalscope/benchmarks/arc/__init__.py' 2024-12-17T13:03:44,138 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2024-12-17T13:03:44,140 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2024-12-17T13:03:44,142 adding 'evalscope/benchmarks/bbh/__init__.py' 2024-12-17T13:03:44,144 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2024-12-17T13:03:44,146 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2024-12-17T13:03:44,147 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2024-12-17T13:03:44,148 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2024-12-17T13:03:44,150 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2024-12-17T13:03:44,151 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2024-12-17T13:03:44,152 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2024-12-17T13:03:44,154 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2024-12-17T13:03:44,155 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2024-12-17T13:03:44,156 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2024-12-17T13:03:44,158 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2024-12-17T13:03:44,159 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2024-12-17T13:03:44,160 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2024-12-17T13:03:44,162 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2024-12-17T13:03:44,163 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2024-12-17T13:03:44,164 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2024-12-17T13:03:44,165 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2024-12-17T13:03:44,166 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2024-12-17T13:03:44,168 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2024-12-17T13:03:44,169 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2024-12-17T13:03:44,170 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2024-12-17T13:03:44,172 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2024-12-17T13:03:44,173 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2024-12-17T13:03:44,174 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2024-12-17T13:03:44,175 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2024-12-17T13:03:44,177 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2024-12-17T13:03:44,178 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2024-12-17T13:03:44,179 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2024-12-17T13:03:44,181 adding 'evalscope/benchmarks/ceval/__init__.py' 2024-12-17T13:03:44,183 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2024-12-17T13:03:44,185 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2024-12-17T13:03:44,186 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2024-12-17T13:03:44,188 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2024-12-17T13:03:44,189 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2024-12-17T13:03:44,192 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2024-12-17T13:03:44,193 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2024-12-17T13:03:44,195 adding 'evalscope/benchmarks/competition_math/__init__.py' 2024-12-17T13:03:44,196 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2024-12-17T13:03:44,199 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2024-12-17T13:03:44,201 adding 'evalscope/benchmarks/general_qa/__init__.py' 2024-12-17T13:03:44,202 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2024-12-17T13:03:44,204 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2024-12-17T13:03:44,206 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2024-12-17T13:03:44,208 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2024-12-17T13:03:44,209 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2024-12-17T13:03:44,211 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2024-12-17T13:03:44,213 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2024-12-17T13:03:44,215 adding 'evalscope/benchmarks/humaneval/__init__.py' 2024-12-17T13:03:44,216 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2024-12-17T13:03:44,218 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2024-12-17T13:03:44,219 adding 'evalscope/benchmarks/mmlu/__init__.py' 2024-12-17T13:03:44,221 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2024-12-17T13:03:44,223 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2024-12-17T13:03:44,224 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2024-12-17T13:03:44,226 adding 'evalscope/benchmarks/race/__init__.py' 2024-12-17T13:03:44,227 adding 'evalscope/benchmarks/race/race.py' 2024-12-17T13:03:44,229 adding 'evalscope/benchmarks/race/race_adapter.py' 2024-12-17T13:03:44,230 adding 'evalscope/benchmarks/race/samples.jsonl' 2024-12-17T13:03:44,232 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2024-12-17T13:03:44,233 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2024-12-17T13:03:44,234 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2024-12-17T13:03:44,236 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2024-12-17T13:03:44,238 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2024-12-17T13:03:44,239 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2024-12-17T13:03:44,242 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2024-12-17T13:03:44,243 adding 'evalscope/cli/__init__.py' 2024-12-17T13:03:44,244 adding 'evalscope/cli/base.py' 2024-12-17T13:03:44,246 adding 'evalscope/cli/cli.py' 2024-12-17T13:03:44,247 adding 'evalscope/cli/start_eval.py' 2024-12-17T13:03:44,248 adding 'evalscope/cli/start_perf.py' 2024-12-17T13:03:44,249 adding 'evalscope/cli/start_server.py' 2024-12-17T13:03:44,251 adding 'evalscope/evaluator/__init__.py' 2024-12-17T13:03:44,254 adding 'evalscope/evaluator/evaluator.py' 2024-12-17T13:03:44,255 adding 'evalscope/evaluator/rating_eval.py' 2024-12-17T13:03:44,257 adding 'evalscope/evaluator/reviewer/__init__.py' 2024-12-17T13:03:44,259 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2024-12-17T13:03:44,261 adding 'evalscope/metrics/__init__.py' 2024-12-17T13:03:44,262 adding 'evalscope/metrics/code_metric.py' 2024-12-17T13:03:44,263 adding 'evalscope/metrics/math_accuracy.py' 2024-12-17T13:03:44,265 adding 'evalscope/metrics/metrics.py' 2024-12-17T13:03:44,267 adding 'evalscope/metrics/rouge_metric.py' 2024-12-17T13:03:44,269 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2024-12-17T13:03:44,271 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2024-12-17T13:03:44,428 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2024-12-17T13:03:44,679 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2024-12-17T13:03:44,688 adding 'evalscope/models/__init__.py' 2024-12-17T13:03:44,689 adding 'evalscope/models/dummy_chat_model.py' 2024-12-17T13:03:44,691 adding 'evalscope/models/model.py' 2024-12-17T13:03:44,693 adding 'evalscope/models/model_adapter.py' 2024-12-17T13:03:44,694 adding 'evalscope/models/openai_model.py' 2024-12-17T13:03:44,696 adding 'evalscope/models/api/__init__.py' 2024-12-17T13:03:44,698 adding 'evalscope/models/api/openai_api.py' 2024-12-17T13:03:44,699 adding 'evalscope/models/custom/__init__.py' 2024-12-17T13:03:44,701 adding 'evalscope/models/custom/custom_model.py' 2024-12-17T13:03:44,703 adding 'evalscope/perf/__init__.py' 2024-12-17T13:03:44,704 adding 'evalscope/perf/arguments.py' 2024-12-17T13:03:44,706 adding 'evalscope/perf/benchmark.py' 2024-12-17T13:03:44,708 adding 'evalscope/perf/http_client.py' 2024-12-17T13:03:44,709 adding 'evalscope/perf/main.py' 2024-12-17T13:03:44,711 adding 'evalscope/perf/plugin/__init__.py' 2024-12-17T13:03:44,712 adding 'evalscope/perf/plugin/registry.py' 2024-12-17T13:03:44,714 adding 'evalscope/perf/plugin/api/__init__.py' 2024-12-17T13:03:44,715 adding 'evalscope/perf/plugin/api/base.py' 2024-12-17T13:03:44,717 adding 'evalscope/perf/plugin/api/custom_api.py' 2024-12-17T13:03:44,718 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2024-12-17T13:03:44,719 adding 'evalscope/perf/plugin/api/openai_api.py' 2024-12-17T13:03:44,721 adding 'evalscope/perf/plugin/datasets/__init__.py' 2024-12-17T13:03:44,722 adding 'evalscope/perf/plugin/datasets/base.py' 2024-12-17T13:03:44,723 adding 'evalscope/perf/plugin/datasets/custom.py' 2024-12-17T13:03:44,724 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2024-12-17T13:03:44,726 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2024-12-17T13:03:44,727 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2024-12-17T13:03:44,728 adding 'evalscope/perf/plugin/datasets/openqa.py' 2024-12-17T13:03:44,729 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2024-12-17T13:03:44,731 adding 'evalscope/perf/utils/__init__.py' 2024-12-17T13:03:44,732 adding 'evalscope/perf/utils/analysis_result.py' 2024-12-17T13:03:44,734 adding 'evalscope/perf/utils/benchmark_util.py' 2024-12-17T13:03:44,735 adding 'evalscope/perf/utils/db_util.py' 2024-12-17T13:03:44,736 adding 'evalscope/perf/utils/handler.py' 2024-12-17T13:03:44,738 adding 'evalscope/perf/utils/local_server.py' 2024-12-17T13:03:44,739 adding 'evalscope/registry/__init__.py' 2024-12-17T13:03:44,741 adding 'evalscope/registry/config/cfg_arena.yaml' 2024-12-17T13:03:44,743 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2024-12-17T13:03:44,744 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2024-12-17T13:03:44,745 adding 'evalscope/registry/config/cfg_single.yaml' 2024-12-17T13:03:44,748 adding 'evalscope/registry/data/question.jsonl' 2024-12-17T13:03:44,750 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2024-12-17T13:03:44,751 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2024-12-17T13:03:44,919 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2024-12-17T13:03:44,927 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2024-12-17T13:03:44,929 adding 'evalscope/registry/tasks/arc.yaml' 2024-12-17T13:03:44,930 adding 'evalscope/registry/tasks/bbh.yaml' 2024-12-17T13:03:44,931 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2024-12-17T13:03:44,932 adding 'evalscope/registry/tasks/ceval.yaml' 2024-12-17T13:03:44,934 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2024-12-17T13:03:44,935 adding 'evalscope/registry/tasks/cmmlu.yaml' 2024-12-17T13:03:44,936 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2024-12-17T13:03:44,937 adding 'evalscope/registry/tasks/general_qa.yaml' 2024-12-17T13:03:44,939 adding 'evalscope/registry/tasks/gsm8k.yaml' 2024-12-17T13:03:44,940 adding 'evalscope/registry/tasks/mmlu.yaml' 2024-12-17T13:03:44,941 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2024-12-17T13:03:44,943 adding 'evalscope/third_party/__init__.py' 2024-12-17T13:03:44,945 adding 'evalscope/third_party/longbench_write/README.md' 2024-12-17T13:03:44,946 adding 'evalscope/third_party/longbench_write/__init__.py' 2024-12-17T13:03:44,947 adding 'evalscope/third_party/longbench_write/default_task.json' 2024-12-17T13:03:44,949 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2024-12-17T13:03:44,951 adding 'evalscope/third_party/longbench_write/eval.py' 2024-12-17T13:03:44,952 adding 'evalscope/third_party/longbench_write/infer.py' 2024-12-17T13:03:44,954 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2024-12-17T13:03:44,955 adding 'evalscope/third_party/longbench_write/utils.py' 2024-12-17T13:03:44,957 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2024-12-17T13:03:44,958 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2024-12-17T13:03:44,966 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2024-12-17T13:03:44,970 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2024-12-17T13:03:44,972 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2024-12-17T13:03:44,973 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2024-12-17T13:03:44,975 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2024-12-17T13:03:44,977 adding 'evalscope/third_party/toolbench_static/README.md' 2024-12-17T13:03:44,978 adding 'evalscope/third_party/toolbench_static/__init__.py' 2024-12-17T13:03:44,979 adding 'evalscope/third_party/toolbench_static/config_default.json' 2024-12-17T13:03:44,981 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2024-12-17T13:03:44,983 adding 'evalscope/third_party/toolbench_static/eval.py' 2024-12-17T13:03:44,984 adding 'evalscope/third_party/toolbench_static/infer.py' 2024-12-17T13:03:44,986 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2024-12-17T13:03:44,987 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2024-12-17T13:03:44,988 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2024-12-17T13:03:44,990 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2024-12-17T13:03:44,992 adding 'evalscope/tools/__init__.py' 2024-12-17T13:03:44,993 adding 'evalscope/tools/combine_reports.py' 2024-12-17T13:03:44,994 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2024-12-17T13:03:44,996 adding 'evalscope/tools/rewrite_eval_results.py' 2024-12-17T13:03:44,997 adding 'evalscope/utils/__init__.py' 2024-12-17T13:03:44,999 adding 'evalscope/utils/arena_utils.py' 2024-12-17T13:03:45,000 adding 'evalscope/utils/chat_service.py' 2024-12-17T13:03:45,001 adding 'evalscope/utils/completion_parsers.py' 2024-12-17T13:03:45,003 adding 'evalscope/utils/io_utils.py' 2024-12-17T13:03:45,004 adding 'evalscope/utils/logger.py' 2024-12-17T13:03:45,005 adding 'evalscope/utils/model_utils.py' 2024-12-17T13:03:45,007 adding 'evalscope/utils/utils.py' 2024-12-17T13:03:45,010 adding 'tests/__init__.py' 2024-12-17T13:03:45,011 adding 'tests/test_run_all.py' 2024-12-17T13:03:45,013 adding 'tests/cli/__init__.py' 2024-12-17T13:03:45,014 adding 'tests/cli/test_run.py' 2024-12-17T13:03:45,016 adding 'tests/perf/__init__.py' 2024-12-17T13:03:45,017 adding 'tests/perf/test_perf.py' 2024-12-17T13:03:45,019 adding 'tests/rag/__init__.py' 2024-12-17T13:03:45,020 adding 'tests/rag/test_clip_benchmark.py' 2024-12-17T13:03:45,022 adding 'tests/rag/test_mteb.py' 2024-12-17T13:03:45,023 adding 'tests/rag/test_ragas.py' 2024-12-17T13:03:45,025 adding 'tests/swift/__init__.py' 2024-12-17T13:03:45,027 adding 'tests/swift/test_run_swift_eval.py' 2024-12-17T13:03:45,028 adding 'tests/swift/test_run_swift_vlm_eval.py' 2024-12-17T13:03:45,030 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2024-12-17T13:03:45,032 adding 'tests/vlm/__init__.py' 2024-12-17T13:03:45,033 adding 'tests/vlm/test_vlmeval.py' 2024-12-17T13:03:45,035 adding 'evalscope-0.8.1.dist-info/LICENSE' 2024-12-17T13:03:45,038 adding 'evalscope-0.8.1.dist-info/METADATA' 2024-12-17T13:03:45,039 adding 'evalscope-0.8.1.dist-info/WHEEL' 2024-12-17T13:03:45,040 adding 'evalscope-0.8.1.dist-info/entry_points.txt' 2024-12-17T13:03:45,042 adding 'evalscope-0.8.1.dist-info/top_level.txt' 2024-12-17T13:03:45,046 adding 'evalscope-0.8.1.dist-info/RECORD' 2024-12-17T13:03:45,080 removing build/bdist.linux-armv7l/wheel 2024-12-17T13:03:45,294 Building wheel for evalscope (setup.py): finished with status 'done' 2024-12-17T13:03:45,311 Created wheel for evalscope: filename=evalscope-0.8.1-py3-none-any.whl size=1409769 sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 2024-12-17T13:03:45,312 Stored in directory: /tmp/pip-ephem-wheel-cache-gak29_y5/wheels/71/8f/78/6d7c1940ed4a889b06fa189950d4153994d235e61b00cd2a74 2024-12-17T13:03:45,339 Successfully built evalscope 2024-12-17T13:03:45,382 Removed build tracker: '/tmp/pip-build-tracker-g1xqvoi0'