2024-12-14T18:01:11,124 Created temporary directory: /tmp/pip-build-tracker-v4k66fkc 2024-12-14T18:01:11,125 Initialized build tracking at /tmp/pip-build-tracker-v4k66fkc 2024-12-14T18:01:11,126 Created build tracker: /tmp/pip-build-tracker-v4k66fkc 2024-12-14T18:01:11,126 Entered build tracker: /tmp/pip-build-tracker-v4k66fkc 2024-12-14T18:01:11,127 Created temporary directory: /tmp/pip-wheel-f2tl1qq6 2024-12-14T18:01:11,131 Created temporary directory: /tmp/pip-ephem-wheel-cache-3xdw22pv 2024-12-14T18:01:11,174 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-14T18:01:11,177 2 location(s) to search for versions of evalscope: 2024-12-14T18:01:11,177 * https://pypi.org/simple/evalscope/ 2024-12-14T18:01:11,177 * https://www.piwheels.org/simple/evalscope/ 2024-12-14T18:01:11,178 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2024-12-14T18:01:11,178 Getting page https://pypi.org/simple/evalscope/ 2024-12-14T18:01:11,180 Found index url https://pypi.org/simple/ 2024-12-14T18:01:11,471 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2024-12-14T18:01:11,477 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,478 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2024-12-14T18:01:11,479 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,480 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2024-12-14T18:01:11,480 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,481 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2024-12-14T18:01:11,482 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,483 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2024-12-14T18:01:11,483 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,484 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2024-12-14T18:01:11,485 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,485 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,487 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2024-12-14T18:01:11,487 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,488 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2024-12-14T18:01:11,489 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,490 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2024-12-14T18:01:11,490 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,491 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2024-12-14T18:01:11,491 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,492 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2024-12-14T18:01:11,493 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,494 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2024-12-14T18:01:11,494 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,495 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2024-12-14T18:01:11,496 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,496 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2024-12-14T18:01:11,497 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,498 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2024-12-14T18:01:11,499 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2024-12-14T18:01:11,500 Getting page https://www.piwheels.org/simple/evalscope/ 2024-12-14T18:01:11,501 Found index url https://www.piwheels.org/simple/ 2024-12-14T18:01:11,664 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2024-12-14T18:01:11,666 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,667 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,668 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-14T18:01:11,669 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2024-12-14T18:01:11,669 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2024-12-14T18:01:11,692 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2024-12-14T18:01:11,694 Collecting evalscope==0.8.0 2024-12-14T18:01:11,696 Created temporary directory: /tmp/pip-unpack-5wirq_my 2024-12-14T18:01:11,922 Downloading evalscope-0.8.0.tar.gz (1.3 MB) 2024-12-14T18:01:12,860 Added evalscope==0.8.0 from https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz to build tracker '/tmp/pip-build-tracker-v4k66fkc' 2024-12-14T18:01:12,862 Running setup.py (path:/tmp/pip-wheel-f2tl1qq6/evalscope_bd6ed231448442ef8add249801191bb6/setup.py) egg_info for package evalscope 2024-12-14T18:01:12,862 Created temporary directory: /tmp/pip-pip-egg-info-8ib0i2r0 2024-12-14T18:01:12,863 Preparing metadata (setup.py): started 2024-12-14T18:01:12,864 Running command python setup.py egg_info 2024-12-14T18:01:13,475 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-14T18:01:13,475 !! 2024-12-14T18:01:13,477 ******************************************************************************** 2024-12-14T18:01:13,477 Usage of dash-separated 'index-url' will not be supported in future 2024-12-14T18:01:13,478 versions. Please use the underscore name 'index_url' instead. 2024-12-14T18:01:13,479 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-14T18:01:13,479 or your builds will no longer be supported. 2024-12-14T18:01:13,481 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-14T18:01:13,481 ******************************************************************************** 2024-12-14T18:01:13,482 !! 2024-12-14T18:01:13,483 opt = self.warn_dash_deprecation(opt, section) 2024-12-14T18:01:14,065 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-14T18:01:14,067 !! 2024-12-14T18:01:14,067 ******************************************************************************** 2024-12-14T18:01:14,068 Usage of dash-separated 'index-url' will not be supported in future 2024-12-14T18:01:14,068 versions. Please use the underscore name 'index_url' instead. 2024-12-14T18:01:14,069 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-14T18:01:14,070 or your builds will no longer be supported. 2024-12-14T18:01:14,071 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-14T18:01:14,071 ******************************************************************************** 2024-12-14T18:01:14,072 !! 2024-12-14T18:01:14,072 opt = self.warn_dash_deprecation(opt, section) 2024-12-14T18:01:14,107 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-14T18:01:14,107 running egg_info 2024-12-14T18:01:14,136 creating /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info 2024-12-14T18:01:14,137 writing /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/PKG-INFO 2024-12-14T18:01:14,166 writing dependency_links to /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/dependency_links.txt 2024-12-14T18:01:14,167 writing entry points to /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/entry_points.txt 2024-12-14T18:01:14,181 writing requirements to /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/requires.txt 2024-12-14T18:01:14,182 writing top-level names to /tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/top_level.txt 2024-12-14T18:01:14,184 writing manifest file '/tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/SOURCES.txt' 2024-12-14T18:01:14,343 reading manifest file '/tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/SOURCES.txt' 2024-12-14T18:01:14,345 reading manifest template 'MANIFEST.in' 2024-12-14T18:01:14,480 adding license file 'LICENSE' 2024-12-14T18:01:14,494 writing manifest file '/tmp/pip-pip-egg-info-8ib0i2r0/evalscope.egg-info/SOURCES.txt' 2024-12-14T18:01:14,603 Preparing metadata (setup.py): finished with status 'done' 2024-12-14T18:01:14,609 Source in /tmp/pip-wheel-f2tl1qq6/evalscope_bd6ed231448442ef8add249801191bb6 has version 0.8.0, which satisfies requirement evalscope==0.8.0 from https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz 2024-12-14T18:01:14,610 Removed evalscope==0.8.0 from https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz from build tracker '/tmp/pip-build-tracker-v4k66fkc' 2024-12-14T18:01:14,662 Created temporary directory: /tmp/pip-unpack-t_t439yk 2024-12-14T18:01:14,663 Created temporary directory: /tmp/pip-unpack-y7eo6a7u 2024-12-14T18:01:14,664 Building wheels for collected packages: evalscope 2024-12-14T18:01:14,668 Created temporary directory: /tmp/pip-wheel-orub5gpd 2024-12-14T18:01:14,669 Building wheel for evalscope (setup.py): started 2024-12-14T18:01:14,670 Destination directory: /tmp/pip-wheel-orub5gpd 2024-12-14T18:01:14,670 Running command python setup.py bdist_wheel 2024-12-14T18:01:15,131 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-14T18:01:15,234 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-14T18:01:15,235 !! 2024-12-14T18:01:15,236 ******************************************************************************** 2024-12-14T18:01:15,237 Usage of dash-separated 'index-url' will not be supported in future 2024-12-14T18:01:15,237 versions. Please use the underscore name 'index_url' instead. 2024-12-14T18:01:15,239 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-14T18:01:15,239 or your builds will no longer be supported. 2024-12-14T18:01:15,240 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-14T18:01:15,241 ******************************************************************************** 2024-12-14T18:01:15,242 !! 2024-12-14T18:01:15,243 opt = self.warn_dash_deprecation(opt, section) 2024-12-14T18:01:15,847 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-14T18:01:15,848 !! 2024-12-14T18:01:15,849 ******************************************************************************** 2024-12-14T18:01:15,850 Usage of dash-separated 'index-url' will not be supported in future 2024-12-14T18:01:15,850 versions. Please use the underscore name 'index_url' instead. 2024-12-14T18:01:15,851 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-14T18:01:15,852 or your builds will no longer be supported. 2024-12-14T18:01:15,853 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-14T18:01:15,853 ******************************************************************************** 2024-12-14T18:01:15,854 !! 2024-12-14T18:01:15,855 opt = self.warn_dash_deprecation(opt, section) 2024-12-14T18:01:15,858 running bdist_wheel 2024-12-14T18:01:15,994 running build 2024-12-14T18:01:15,995 running build_py 2024-12-14T18:01:16,026 creating build/lib/tests 2024-12-14T18:01:16,028 copying tests/test_run_all.py -> build/lib/tests 2024-12-14T18:01:16,030 copying tests/__init__.py -> build/lib/tests 2024-12-14T18:01:16,033 creating build/lib/evalscope 2024-12-14T18:01:16,034 copying evalscope/config.py -> build/lib/evalscope 2024-12-14T18:01:16,036 copying evalscope/run_arena.py -> build/lib/evalscope 2024-12-14T18:01:16,039 copying evalscope/summarizer.py -> build/lib/evalscope 2024-12-14T18:01:16,041 copying evalscope/version.py -> build/lib/evalscope 2024-12-14T18:01:16,043 copying evalscope/run.py -> build/lib/evalscope 2024-12-14T18:01:16,045 copying evalscope/arguments.py -> build/lib/evalscope 2024-12-14T18:01:16,047 copying evalscope/__init__.py -> build/lib/evalscope 2024-12-14T18:01:16,049 copying evalscope/constants.py -> build/lib/evalscope 2024-12-14T18:01:16,052 creating build/lib/tests/swift 2024-12-14T18:01:16,053 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2024-12-14T18:01:16,055 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2024-12-14T18:01:16,058 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2024-12-14T18:01:16,060 copying tests/swift/__init__.py -> build/lib/tests/swift 2024-12-14T18:01:16,062 creating build/lib/tests/cli 2024-12-14T18:01:16,063 copying tests/cli/test_run.py -> build/lib/tests/cli 2024-12-14T18:01:16,066 copying tests/cli/__init__.py -> build/lib/tests/cli 2024-12-14T18:01:16,068 creating build/lib/tests/vlm 2024-12-14T18:01:16,069 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2024-12-14T18:01:16,071 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2024-12-14T18:01:16,074 creating build/lib/tests/perf 2024-12-14T18:01:16,075 copying tests/perf/test_perf.py -> build/lib/tests/perf 2024-12-14T18:01:16,077 copying tests/perf/__init__.py -> build/lib/tests/perf 2024-12-14T18:01:16,079 creating build/lib/tests/rag 2024-12-14T18:01:16,080 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2024-12-14T18:01:16,082 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2024-12-14T18:01:16,084 copying tests/rag/__init__.py -> build/lib/tests/rag 2024-12-14T18:01:16,086 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2024-12-14T18:01:16,089 creating build/lib/evalscope/benchmarks 2024-12-14T18:01:16,090 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2024-12-14T18:01:16,092 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2024-12-14T18:01:16,094 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2024-12-14T18:01:16,097 creating build/lib/evalscope/evaluator 2024-12-14T18:01:16,098 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2024-12-14T18:01:16,100 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2024-12-14T18:01:16,102 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2024-12-14T18:01:16,104 copying evalscope/evaluator/humaneval_evaluator.py -> build/lib/evalscope/evaluator 2024-12-14T18:01:16,107 creating build/lib/evalscope/cli 2024-12-14T18:01:16,108 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,110 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,111 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,113 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,115 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,117 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2024-12-14T18:01:16,119 creating build/lib/evalscope/utils 2024-12-14T18:01:16,120 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,123 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,125 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,127 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,129 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,131 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,133 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2024-12-14T18:01:16,135 creating build/lib/evalscope/tools 2024-12-14T18:01:16,136 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2024-12-14T18:01:16,138 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2024-12-14T18:01:16,140 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2024-12-14T18:01:16,142 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2024-12-14T18:01:16,145 creating build/lib/evalscope/backend 2024-12-14T18:01:16,146 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2024-12-14T18:01:16,147 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2024-12-14T18:01:16,150 creating build/lib/evalscope/perf 2024-12-14T18:01:16,151 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2024-12-14T18:01:16,153 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2024-12-14T18:01:16,155 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2024-12-14T18:01:16,158 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2024-12-14T18:01:16,159 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2024-12-14T18:01:16,161 creating build/lib/evalscope/third_party 2024-12-14T18:01:16,162 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2024-12-14T18:01:16,165 creating build/lib/evalscope/models 2024-12-14T18:01:16,166 copying evalscope/models/openai_model.py -> build/lib/evalscope/models 2024-12-14T18:01:16,168 copying evalscope/models/model_adapter.py -> build/lib/evalscope/models 2024-12-14T18:01:16,170 copying evalscope/models/model.py -> build/lib/evalscope/models 2024-12-14T18:01:16,173 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2024-12-14T18:01:16,174 copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models 2024-12-14T18:01:16,177 creating build/lib/evalscope/registry 2024-12-14T18:01:16,178 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2024-12-14T18:01:16,180 creating build/lib/evalscope/metrics 2024-12-14T18:01:16,181 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2024-12-14T18:01:16,183 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2024-12-14T18:01:16,186 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2024-12-14T18:01:16,188 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2024-12-14T18:01:16,190 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2024-12-14T18:01:16,192 creating build/lib/evalscope/benchmarks/gsm8k 2024-12-14T18:01:16,194 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-14T18:01:16,196 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-14T18:01:16,198 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-14T18:01:16,201 creating build/lib/evalscope/benchmarks/arc 2024-12-14T18:01:16,202 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2024-12-14T18:01:16,204 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2024-12-14T18:01:16,206 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2024-12-14T18:01:16,209 creating build/lib/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:16,210 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:16,212 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:16,214 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:16,216 creating build/lib/evalscope/benchmarks/general_qa 2024-12-14T18:01:16,217 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-14T18:01:16,220 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-14T18:01:16,222 creating build/lib/evalscope/benchmarks/hellaswag 2024-12-14T18:01:16,223 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-14T18:01:16,226 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-14T18:01:16,228 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-14T18:01:16,230 creating build/lib/evalscope/benchmarks/race 2024-12-14T18:01:16,231 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2024-12-14T18:01:16,234 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2024-12-14T18:01:16,236 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2024-12-14T18:01:16,238 creating build/lib/evalscope/benchmarks/bbh 2024-12-14T18:01:16,239 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2024-12-14T18:01:16,242 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2024-12-14T18:01:16,244 creating build/lib/evalscope/benchmarks/competition_math 2024-12-14T18:01:16,245 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-14T18:01:16,247 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-14T18:01:16,250 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-14T18:01:16,252 creating build/lib/evalscope/benchmarks/truthful_qa 2024-12-14T18:01:16,253 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-14T18:01:16,255 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-14T18:01:16,258 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-14T18:01:16,260 creating build/lib/evalscope/benchmarks/cmmlu 2024-12-14T18:01:16,261 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-14T18:01:16,264 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-14T18:01:16,266 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-14T18:01:16,269 creating build/lib/evalscope/benchmarks/mmlu 2024-12-14T18:01:16,270 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-14T18:01:16,272 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-14T18:01:16,274 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-14T18:01:16,277 creating build/lib/evalscope/benchmarks/ceval 2024-12-14T18:01:16,279 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2024-12-14T18:01:16,281 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2024-12-14T18:01:16,283 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2024-12-14T18:01:16,286 creating build/lib/evalscope/benchmarks/humaneval 2024-12-14T18:01:16,287 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-14T18:01:16,289 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-14T18:01:16,291 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-14T18:01:16,294 creating build/lib/evalscope/evaluator/reviewer 2024-12-14T18:01:16,295 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2024-12-14T18:01:16,298 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2024-12-14T18:01:16,300 creating build/lib/evalscope/backend/opencompass 2024-12-14T18:01:16,301 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2024-12-14T18:01:16,303 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2024-12-14T18:01:16,305 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2024-12-14T18:01:16,308 creating build/lib/evalscope/backend/rag_eval 2024-12-14T18:01:16,309 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2024-12-14T18:01:16,311 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2024-12-14T18:01:16,313 creating build/lib/evalscope/backend/vlm_eval_kit 2024-12-14T18:01:16,314 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-14T18:01:16,316 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-14T18:01:16,318 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-14T18:01:16,321 creating build/lib/evalscope/backend/opencompass/tasks 2024-12-14T18:01:16,322 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-14T18:01:16,324 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-14T18:01:16,326 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-14T18:01:16,329 creating build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,330 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,332 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,334 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,336 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,338 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-14T18:01:16,341 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:16,342 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:16,344 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:16,346 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:16,348 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:16,350 creating build/lib/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:16,352 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:16,354 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:16,355 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:16,357 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:16,360 creating build/lib/evalscope/backend/rag_eval/ragas 2024-12-14T18:01:16,361 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-14T18:01:16,363 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-14T18:01:16,365 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-14T18:01:16,367 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:16,368 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:16,370 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:16,372 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:16,375 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:16,377 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,378 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,380 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,383 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,385 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,387 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,389 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,391 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,394 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:16,396 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,397 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,399 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,401 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,404 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,406 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:16,408 creating build/lib/evalscope/perf/utils 2024-12-14T18:01:16,409 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,411 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,413 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,415 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,417 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,419 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2024-12-14T18:01:16,421 creating build/lib/evalscope/perf/plugin 2024-12-14T18:01:16,422 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2024-12-14T18:01:16,424 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2024-12-14T18:01:16,426 creating build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,428 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,430 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,432 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,434 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,436 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2024-12-14T18:01:16,439 creating build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,440 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,442 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,444 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,446 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,448 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,450 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,452 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,454 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-14T18:01:16,456 creating build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,457 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,459 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,462 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,464 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,466 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:16,469 creating build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:16,470 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:16,472 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:16,474 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:16,476 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:16,479 creating build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:16,480 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:16,483 creating build/lib/evalscope/third_party/longbench_write/tools 2024-12-14T18:01:16,484 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-14T18:01:16,487 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-14T18:01:16,489 creating build/lib/evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:16,490 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:16,492 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:16,494 creating build/lib/evalscope/models/api 2024-12-14T18:01:16,495 copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api 2024-12-14T18:01:16,498 copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api 2024-12-14T18:01:16,500 creating build/lib/evalscope/models/custom 2024-12-14T18:01:16,501 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2024-12-14T18:01:16,503 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2024-12-14T18:01:16,506 creating build/lib/evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:16,507 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:16,509 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:16,511 running egg_info 2024-12-14T18:01:16,544 writing evalscope.egg-info/PKG-INFO 2024-12-14T18:01:16,572 writing dependency_links to evalscope.egg-info/dependency_links.txt 2024-12-14T18:01:16,574 writing entry points to evalscope.egg-info/entry_points.txt 2024-12-14T18:01:16,587 writing requirements to evalscope.egg-info/requires.txt 2024-12-14T18:01:16,588 writing top-level names to evalscope.egg-info/top_level.txt 2024-12-14T18:01:16,687 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-14T18:01:16,716 reading manifest template 'MANIFEST.in' 2024-12-14T18:01:16,911 adding license file 'LICENSE' 2024-12-14T18:01:16,930 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-14T18:01:16,933 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2024-12-14T18:01:16,933 !! 2024-12-14T18:01:16,935 ******************************************************************************** 2024-12-14T18:01:16,935 ############################ 2024-12-14T18:01:16,936 # Package would be ignored # 2024-12-14T18:01:16,936 ############################ 2024-12-14T18:01:16,937 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2024-12-14T18:01:16,937 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:16,939 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:16,939 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2024-12-14T18:01:16,940 to the `packages` configuration field. 2024-12-14T18:01:16,941 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:16,941 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:16,941 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:16,942 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:16,943 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:16,944 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2024-12-14T18:01:16,944 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2024-12-14T18:01:16,945 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:16,945 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:16,945 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:16,946 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:16,947 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:16,948 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:16,949 even if it does not contain any `.py` files. 2024-12-14T18:01:16,949 On the other hand, currently there is no concept of package data 2024-12-14T18:01:16,949 directory, all directories are treated like packages. 2024-12-14T18:01:16,950 ******************************************************************************** 2024-12-14T18:01:16,951 !! 2024-12-14T18:01:16,951 check.warn(importable) 2024-12-14T18:01:16,952 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2024-12-14T18:01:16,952 !! 2024-12-14T18:01:16,953 ******************************************************************************** 2024-12-14T18:01:16,954 ############################ 2024-12-14T18:01:16,954 # Package would be ignored # 2024-12-14T18:01:16,955 ############################ 2024-12-14T18:01:16,955 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2024-12-14T18:01:16,956 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:16,957 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:16,957 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2024-12-14T18:01:16,957 to the `packages` configuration field. 2024-12-14T18:01:16,958 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:16,959 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:16,959 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:16,960 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:16,961 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:16,962 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2024-12-14T18:01:16,963 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2024-12-14T18:01:16,963 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:16,964 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:16,964 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:16,965 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:16,966 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:16,967 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:16,967 even if it does not contain any `.py` files. 2024-12-14T18:01:16,968 On the other hand, currently there is no concept of package data 2024-12-14T18:01:16,968 directory, all directories are treated like packages. 2024-12-14T18:01:16,968 ******************************************************************************** 2024-12-14T18:01:16,969 !! 2024-12-14T18:01:16,969 check.warn(importable) 2024-12-14T18:01:16,970 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is absent from the `packages` configuration. 2024-12-14T18:01:16,970 !! 2024-12-14T18:01:16,971 ******************************************************************************** 2024-12-14T18:01:16,971 ############################ 2024-12-14T18:01:16,971 # Package would be ignored # 2024-12-14T18:01:16,972 ############################ 2024-12-14T18:01:16,972 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' as an importable package[^1], 2024-12-14T18:01:16,973 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:16,973 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:16,974 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is explicitly added 2024-12-14T18:01:16,974 to the `packages` configuration field. 2024-12-14T18:01:16,975 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:16,975 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:16,976 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:16,977 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:16,978 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:16,979 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' to be distributed and are 2024-12-14T18:01:16,979 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' via 2024-12-14T18:01:16,980 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:16,980 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:16,981 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:16,982 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:16,983 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:16,984 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:16,985 even if it does not contain any `.py` files. 2024-12-14T18:01:16,985 On the other hand, currently there is no concept of package data 2024-12-14T18:01:16,985 directory, all directories are treated like packages. 2024-12-14T18:01:16,986 ******************************************************************************** 2024-12-14T18:01:16,987 !! 2024-12-14T18:01:16,987 check.warn(importable) 2024-12-14T18:01:16,988 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is absent from the `packages` configuration. 2024-12-14T18:01:16,988 !! 2024-12-14T18:01:16,989 ******************************************************************************** 2024-12-14T18:01:16,989 ############################ 2024-12-14T18:01:16,990 # Package would be ignored # 2024-12-14T18:01:16,990 ############################ 2024-12-14T18:01:16,990 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' as an importable package[^1], 2024-12-14T18:01:16,991 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:16,992 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:16,992 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is explicitly added 2024-12-14T18:01:16,993 to the `packages` configuration field. 2024-12-14T18:01:16,993 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:16,994 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:16,994 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:16,995 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:16,995 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:16,996 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' to be distributed and are 2024-12-14T18:01:16,997 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' via 2024-12-14T18:01:16,997 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:16,997 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:16,998 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:16,999 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,000 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,001 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,002 even if it does not contain any `.py` files. 2024-12-14T18:01:17,002 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,003 directory, all directories are treated like packages. 2024-12-14T18:01:17,003 ******************************************************************************** 2024-12-14T18:01:17,004 !! 2024-12-14T18:01:17,005 check.warn(importable) 2024-12-14T18:01:17,005 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is absent from the `packages` configuration. 2024-12-14T18:01:17,006 !! 2024-12-14T18:01:17,007 ******************************************************************************** 2024-12-14T18:01:17,007 ############################ 2024-12-14T18:01:17,007 # Package would be ignored # 2024-12-14T18:01:17,008 ############################ 2024-12-14T18:01:17,009 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' as an importable package[^1], 2024-12-14T18:01:17,009 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,010 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,011 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is explicitly added 2024-12-14T18:01:17,011 to the `packages` configuration field. 2024-12-14T18:01:17,013 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,013 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,013 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,014 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,015 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,015 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' to be distributed and are 2024-12-14T18:01:17,016 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' via 2024-12-14T18:01:17,016 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,017 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,017 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,018 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,019 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,020 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,021 even if it does not contain any `.py` files. 2024-12-14T18:01:17,021 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,022 directory, all directories are treated like packages. 2024-12-14T18:01:17,022 ******************************************************************************** 2024-12-14T18:01:17,023 !! 2024-12-14T18:01:17,024 check.warn(importable) 2024-12-14T18:01:17,024 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' is absent from the `packages` configuration. 2024-12-14T18:01:17,025 !! 2024-12-14T18:01:17,025 ******************************************************************************** 2024-12-14T18:01:17,026 ############################ 2024-12-14T18:01:17,027 # Package would be ignored # 2024-12-14T18:01:17,027 ############################ 2024-12-14T18:01:17,027 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' as an importable package[^1], 2024-12-14T18:01:17,028 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,029 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,030 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' is explicitly added 2024-12-14T18:01:17,030 to the `packages` configuration field. 2024-12-14T18:01:17,031 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,032 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,032 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,033 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,034 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,035 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' to be distributed and are 2024-12-14T18:01:17,036 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.CustomNodeFilter' via 2024-12-14T18:01:17,037 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,037 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,038 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,039 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,040 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,041 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,041 even if it does not contain any `.py` files. 2024-12-14T18:01:17,042 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,042 directory, all directories are treated like packages. 2024-12-14T18:01:17,043 ******************************************************************************** 2024-12-14T18:01:17,044 !! 2024-12-14T18:01:17,044 check.warn(importable) 2024-12-14T18:01:17,045 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is absent from the `packages` configuration. 2024-12-14T18:01:17,045 !! 2024-12-14T18:01:17,046 ******************************************************************************** 2024-12-14T18:01:17,046 ############################ 2024-12-14T18:01:17,047 # Package would be ignored # 2024-12-14T18:01:17,047 ############################ 2024-12-14T18:01:17,048 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' as an importable package[^1], 2024-12-14T18:01:17,048 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,049 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,050 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is explicitly added 2024-12-14T18:01:17,050 to the `packages` configuration field. 2024-12-14T18:01:17,051 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,052 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,052 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,053 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,054 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,055 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' to be distributed and are 2024-12-14T18:01:17,056 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' via 2024-12-14T18:01:17,056 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,057 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,057 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,058 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,059 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,061 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,061 even if it does not contain any `.py` files. 2024-12-14T18:01:17,062 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,062 directory, all directories are treated like packages. 2024-12-14T18:01:17,063 ******************************************************************************** 2024-12-14T18:01:17,064 !! 2024-12-14T18:01:17,065 check.warn(importable) 2024-12-14T18:01:17,065 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is absent from the `packages` configuration. 2024-12-14T18:01:17,066 !! 2024-12-14T18:01:17,067 ******************************************************************************** 2024-12-14T18:01:17,067 ############################ 2024-12-14T18:01:17,067 # Package would be ignored # 2024-12-14T18:01:17,068 ############################ 2024-12-14T18:01:17,068 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' as an importable package[^1], 2024-12-14T18:01:17,069 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,069 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,070 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is explicitly added 2024-12-14T18:01:17,070 to the `packages` configuration field. 2024-12-14T18:01:17,071 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,072 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,072 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,073 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,074 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,075 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' to be distributed and are 2024-12-14T18:01:17,075 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' via 2024-12-14T18:01:17,076 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,076 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,077 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,078 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,079 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,080 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,081 even if it does not contain any `.py` files. 2024-12-14T18:01:17,081 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,082 directory, all directories are treated like packages. 2024-12-14T18:01:17,082 ******************************************************************************** 2024-12-14T18:01:17,083 !! 2024-12-14T18:01:17,084 check.warn(importable) 2024-12-14T18:01:17,084 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is absent from the `packages` configuration. 2024-12-14T18:01:17,085 !! 2024-12-14T18:01:17,086 ******************************************************************************** 2024-12-14T18:01:17,086 ############################ 2024-12-14T18:01:17,087 # Package would be ignored # 2024-12-14T18:01:17,087 ############################ 2024-12-14T18:01:17,088 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' as an importable package[^1], 2024-12-14T18:01:17,088 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,089 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,090 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is explicitly added 2024-12-14T18:01:17,090 to the `packages` configuration field. 2024-12-14T18:01:17,092 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,092 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,093 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,094 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,095 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,096 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' to be distributed and are 2024-12-14T18:01:17,096 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' via 2024-12-14T18:01:17,097 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,097 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,098 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,099 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,100 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,101 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,102 even if it does not contain any `.py` files. 2024-12-14T18:01:17,102 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,103 directory, all directories are treated like packages. 2024-12-14T18:01:17,103 ******************************************************************************** 2024-12-14T18:01:17,104 !! 2024-12-14T18:01:17,105 check.warn(importable) 2024-12-14T18:01:17,105 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-14T18:01:17,106 !! 2024-12-14T18:01:17,107 ******************************************************************************** 2024-12-14T18:01:17,107 ############################ 2024-12-14T18:01:17,107 # Package would be ignored # 2024-12-14T18:01:17,108 ############################ 2024-12-14T18:01:17,109 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-14T18:01:17,109 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,110 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,111 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is explicitly added 2024-12-14T18:01:17,111 to the `packages` configuration field. 2024-12-14T18:01:17,112 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,113 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,113 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,114 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,115 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,117 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' to be distributed and are 2024-12-14T18:01:17,118 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' via 2024-12-14T18:01:17,118 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,119 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,119 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,120 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,121 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,123 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,123 even if it does not contain any `.py` files. 2024-12-14T18:01:17,124 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,124 directory, all directories are treated like packages. 2024-12-14T18:01:17,125 ******************************************************************************** 2024-12-14T18:01:17,126 !! 2024-12-14T18:01:17,126 check.warn(importable) 2024-12-14T18:01:17,127 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is absent from the `packages` configuration. 2024-12-14T18:01:17,127 !! 2024-12-14T18:01:17,128 ******************************************************************************** 2024-12-14T18:01:17,129 ############################ 2024-12-14T18:01:17,129 # Package would be ignored # 2024-12-14T18:01:17,130 ############################ 2024-12-14T18:01:17,130 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' as an importable package[^1], 2024-12-14T18:01:17,130 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,131 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,132 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is explicitly added 2024-12-14T18:01:17,133 to the `packages` configuration field. 2024-12-14T18:01:17,134 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,134 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,135 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,135 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,137 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,138 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' to be distributed and are 2024-12-14T18:01:17,138 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' via 2024-12-14T18:01:17,139 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,139 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,140 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,141 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,142 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,144 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,144 even if it does not contain any `.py` files. 2024-12-14T18:01:17,145 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,145 directory, all directories are treated like packages. 2024-12-14T18:01:17,146 ******************************************************************************** 2024-12-14T18:01:17,147 !! 2024-12-14T18:01:17,147 check.warn(importable) 2024-12-14T18:01:17,148 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is absent from the `packages` configuration. 2024-12-14T18:01:17,148 !! 2024-12-14T18:01:17,149 ******************************************************************************** 2024-12-14T18:01:17,151 ############################ 2024-12-14T18:01:17,151 # Package would be ignored # 2024-12-14T18:01:17,152 ############################ 2024-12-14T18:01:17,152 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' as an importable package[^1], 2024-12-14T18:01:17,153 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,154 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,154 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is explicitly added 2024-12-14T18:01:17,155 to the `packages` configuration field. 2024-12-14T18:01:17,156 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,156 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,157 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,158 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,159 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,159 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' to be distributed and are 2024-12-14T18:01:17,160 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' via 2024-12-14T18:01:17,161 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,161 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,162 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,163 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,163 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,165 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,166 even if it does not contain any `.py` files. 2024-12-14T18:01:17,166 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,167 directory, all directories are treated like packages. 2024-12-14T18:01:17,167 ******************************************************************************** 2024-12-14T18:01:17,168 !! 2024-12-14T18:01:17,169 check.warn(importable) 2024-12-14T18:01:17,169 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is absent from the `packages` configuration. 2024-12-14T18:01:17,170 !! 2024-12-14T18:01:17,171 ******************************************************************************** 2024-12-14T18:01:17,171 ############################ 2024-12-14T18:01:17,172 # Package would be ignored # 2024-12-14T18:01:17,172 ############################ 2024-12-14T18:01:17,173 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' as an importable package[^1], 2024-12-14T18:01:17,173 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,174 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,175 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is explicitly added 2024-12-14T18:01:17,176 to the `packages` configuration field. 2024-12-14T18:01:17,177 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,177 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,178 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,179 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,179 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,180 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' to be distributed and are 2024-12-14T18:01:17,181 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' via 2024-12-14T18:01:17,181 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,182 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,182 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,183 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,184 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,186 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,187 even if it does not contain any `.py` files. 2024-12-14T18:01:17,187 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,188 directory, all directories are treated like packages. 2024-12-14T18:01:17,188 ******************************************************************************** 2024-12-14T18:01:17,189 !! 2024-12-14T18:01:17,190 check.warn(importable) 2024-12-14T18:01:17,190 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-14T18:01:17,191 !! 2024-12-14T18:01:17,192 ******************************************************************************** 2024-12-14T18:01:17,193 ############################ 2024-12-14T18:01:17,193 # Package would be ignored # 2024-12-14T18:01:17,194 ############################ 2024-12-14T18:01:17,194 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-14T18:01:17,195 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,196 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,196 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is explicitly added 2024-12-14T18:01:17,197 to the `packages` configuration field. 2024-12-14T18:01:17,198 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,198 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,199 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,200 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,201 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,202 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' to be distributed and are 2024-12-14T18:01:17,202 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' via 2024-12-14T18:01:17,203 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,204 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,204 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,205 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,206 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,208 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,208 even if it does not contain any `.py` files. 2024-12-14T18:01:17,209 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,209 directory, all directories are treated like packages. 2024-12-14T18:01:17,210 ******************************************************************************** 2024-12-14T18:01:17,210 !! 2024-12-14T18:01:17,211 check.warn(importable) 2024-12-14T18:01:17,212 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is absent from the `packages` configuration. 2024-12-14T18:01:17,212 !! 2024-12-14T18:01:17,213 ******************************************************************************** 2024-12-14T18:01:17,213 ############################ 2024-12-14T18:01:17,214 # Package would be ignored # 2024-12-14T18:01:17,215 ############################ 2024-12-14T18:01:17,215 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' as an importable package[^1], 2024-12-14T18:01:17,216 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,217 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,217 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is explicitly added 2024-12-14T18:01:17,218 to the `packages` configuration field. 2024-12-14T18:01:17,219 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,219 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,220 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,221 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,222 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,223 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' to be distributed and are 2024-12-14T18:01:17,224 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' via 2024-12-14T18:01:17,225 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,225 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,227 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,231 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,240 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,243 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,243 even if it does not contain any `.py` files. 2024-12-14T18:01:17,244 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,245 directory, all directories are treated like packages. 2024-12-14T18:01:17,246 ******************************************************************************** 2024-12-14T18:01:17,248 !! 2024-12-14T18:01:17,248 check.warn(importable) 2024-12-14T18:01:17,249 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is absent from the `packages` configuration. 2024-12-14T18:01:17,250 !! 2024-12-14T18:01:17,252 ******************************************************************************** 2024-12-14T18:01:17,252 ############################ 2024-12-14T18:01:17,253 # Package would be ignored # 2024-12-14T18:01:17,253 ############################ 2024-12-14T18:01:17,254 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' as an importable package[^1], 2024-12-14T18:01:17,254 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,255 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,256 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is explicitly added 2024-12-14T18:01:17,257 to the `packages` configuration field. 2024-12-14T18:01:17,258 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,259 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,259 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,260 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,261 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,265 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' to be distributed and are 2024-12-14T18:01:17,268 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' via 2024-12-14T18:01:17,268 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,269 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,269 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,271 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,273 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,274 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,275 even if it does not contain any `.py` files. 2024-12-14T18:01:17,275 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,276 directory, all directories are treated like packages. 2024-12-14T18:01:17,278 ******************************************************************************** 2024-12-14T18:01:17,282 !! 2024-12-14T18:01:17,288 check.warn(importable) 2024-12-14T18:01:17,291 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2024-12-14T18:01:17,291 !! 2024-12-14T18:01:17,293 ******************************************************************************** 2024-12-14T18:01:17,293 ############################ 2024-12-14T18:01:17,294 # Package would be ignored # 2024-12-14T18:01:17,295 ############################ 2024-12-14T18:01:17,295 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2024-12-14T18:01:17,296 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,297 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,299 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2024-12-14T18:01:17,300 to the `packages` configuration field. 2024-12-14T18:01:17,301 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,302 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,302 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,304 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,305 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,306 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2024-12-14T18:01:17,306 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2024-12-14T18:01:17,307 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,308 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,308 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,310 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,311 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,312 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,313 even if it does not contain any `.py` files. 2024-12-14T18:01:17,313 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,314 directory, all directories are treated like packages. 2024-12-14T18:01:17,314 ******************************************************************************** 2024-12-14T18:01:17,316 !! 2024-12-14T18:01:17,316 check.warn(importable) 2024-12-14T18:01:17,317 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2024-12-14T18:01:17,317 !! 2024-12-14T18:01:17,318 ******************************************************************************** 2024-12-14T18:01:17,319 ############################ 2024-12-14T18:01:17,319 # Package would be ignored # 2024-12-14T18:01:17,320 ############################ 2024-12-14T18:01:17,320 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2024-12-14T18:01:17,321 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,322 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,322 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2024-12-14T18:01:17,323 to the `packages` configuration field. 2024-12-14T18:01:17,324 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,325 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,325 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,327 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,328 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,329 If you don't want 'evalscope.metrics.resources' to be distributed and are 2024-12-14T18:01:17,329 already explicitly excluding 'evalscope.metrics.resources' via 2024-12-14T18:01:17,330 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,331 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,331 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,333 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,334 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,336 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,337 even if it does not contain any `.py` files. 2024-12-14T18:01:17,337 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,338 directory, all directories are treated like packages. 2024-12-14T18:01:17,338 ******************************************************************************** 2024-12-14T18:01:17,339 !! 2024-12-14T18:01:17,340 check.warn(importable) 2024-12-14T18:01:17,340 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2024-12-14T18:01:17,341 !! 2024-12-14T18:01:17,342 ******************************************************************************** 2024-12-14T18:01:17,342 ############################ 2024-12-14T18:01:17,342 # Package would be ignored # 2024-12-14T18:01:17,343 ############################ 2024-12-14T18:01:17,343 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2024-12-14T18:01:17,344 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,345 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,345 package, please make sure that 'evalscope.registry.config' is explicitly added 2024-12-14T18:01:17,346 to the `packages` configuration field. 2024-12-14T18:01:17,346 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,347 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,347 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,348 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,349 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,350 If you don't want 'evalscope.registry.config' to be distributed and are 2024-12-14T18:01:17,351 already explicitly excluding 'evalscope.registry.config' via 2024-12-14T18:01:17,351 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,352 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,353 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,354 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,355 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,356 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,357 even if it does not contain any `.py` files. 2024-12-14T18:01:17,357 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,357 directory, all directories are treated like packages. 2024-12-14T18:01:17,358 ******************************************************************************** 2024-12-14T18:01:17,359 !! 2024-12-14T18:01:17,359 check.warn(importable) 2024-12-14T18:01:17,360 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2024-12-14T18:01:17,360 !! 2024-12-14T18:01:17,361 ******************************************************************************** 2024-12-14T18:01:17,362 ############################ 2024-12-14T18:01:17,362 # Package would be ignored # 2024-12-14T18:01:17,363 ############################ 2024-12-14T18:01:17,363 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2024-12-14T18:01:17,364 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,365 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,365 package, please make sure that 'evalscope.registry.data' is explicitly added 2024-12-14T18:01:17,365 to the `packages` configuration field. 2024-12-14T18:01:17,366 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,367 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,367 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,368 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,369 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,370 If you don't want 'evalscope.registry.data' to be distributed and are 2024-12-14T18:01:17,370 already explicitly excluding 'evalscope.registry.data' via 2024-12-14T18:01:17,371 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,371 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,372 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,374 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,375 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,376 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,377 even if it does not contain any `.py` files. 2024-12-14T18:01:17,377 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,378 directory, all directories are treated like packages. 2024-12-14T18:01:17,378 ******************************************************************************** 2024-12-14T18:01:17,379 !! 2024-12-14T18:01:17,380 check.warn(importable) 2024-12-14T18:01:17,380 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2024-12-14T18:01:17,381 !! 2024-12-14T18:01:17,382 ******************************************************************************** 2024-12-14T18:01:17,382 ############################ 2024-12-14T18:01:17,383 # Package would be ignored # 2024-12-14T18:01:17,383 ############################ 2024-12-14T18:01:17,384 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2024-12-14T18:01:17,384 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,385 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,386 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2024-12-14T18:01:17,386 to the `packages` configuration field. 2024-12-14T18:01:17,387 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,387 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,388 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,389 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,390 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,391 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2024-12-14T18:01:17,392 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2024-12-14T18:01:17,393 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,393 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,393 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,394 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,395 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,396 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,397 even if it does not contain any `.py` files. 2024-12-14T18:01:17,397 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,397 directory, all directories are treated like packages. 2024-12-14T18:01:17,398 ******************************************************************************** 2024-12-14T18:01:17,399 !! 2024-12-14T18:01:17,399 check.warn(importable) 2024-12-14T18:01:17,400 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2024-12-14T18:01:17,400 !! 2024-12-14T18:01:17,401 ******************************************************************************** 2024-12-14T18:01:17,402 ############################ 2024-12-14T18:01:17,402 # Package would be ignored # 2024-12-14T18:01:17,403 ############################ 2024-12-14T18:01:17,403 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2024-12-14T18:01:17,404 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,405 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,405 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2024-12-14T18:01:17,405 to the `packages` configuration field. 2024-12-14T18:01:17,406 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,407 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,407 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,408 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,409 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,410 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2024-12-14T18:01:17,411 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2024-12-14T18:01:17,411 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,412 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,412 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,413 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,414 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,416 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,416 even if it does not contain any `.py` files. 2024-12-14T18:01:17,417 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,417 directory, all directories are treated like packages. 2024-12-14T18:01:17,417 ******************************************************************************** 2024-12-14T18:01:17,419 !! 2024-12-14T18:01:17,419 check.warn(importable) 2024-12-14T18:01:17,420 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2024-12-14T18:01:17,420 !! 2024-12-14T18:01:17,421 ******************************************************************************** 2024-12-14T18:01:17,421 ############################ 2024-12-14T18:01:17,422 # Package would be ignored # 2024-12-14T18:01:17,422 ############################ 2024-12-14T18:01:17,423 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2024-12-14T18:01:17,423 but it is absent from setuptools' `packages` configuration. 2024-12-14T18:01:17,424 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-14T18:01:17,425 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2024-12-14T18:01:17,425 to the `packages` configuration field. 2024-12-14T18:01:17,426 Alternatively, you can also rely on setuptools' discovery methods 2024-12-14T18:01:17,427 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-14T18:01:17,427 instead of `find_packages(...)`/`find:`). 2024-12-14T18:01:17,428 You can read more about "package discovery" on setuptools documentation page: 2024-12-14T18:01:17,429 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-14T18:01:17,430 If you don't want 'evalscope.registry.tasks' to be distributed and are 2024-12-14T18:01:17,430 already explicitly excluding 'evalscope.registry.tasks' via 2024-12-14T18:01:17,431 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-14T18:01:17,431 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-14T18:01:17,432 combination with a more fine grained `package-data` configuration. 2024-12-14T18:01:17,433 You can read more about "package data files" on setuptools documentation page: 2024-12-14T18:01:17,434 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-14T18:01:17,435 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-14T18:01:17,435 even if it does not contain any `.py` files. 2024-12-14T18:01:17,436 On the other hand, currently there is no concept of package data 2024-12-14T18:01:17,437 directory, all directories are treated like packages. 2024-12-14T18:01:17,437 ******************************************************************************** 2024-12-14T18:01:17,438 !! 2024-12-14T18:01:17,439 check.warn(importable) 2024-12-14T18:01:17,439 creating build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,440 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,440 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,441 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,441 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,442 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,442 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,442 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,443 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,443 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,444 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,444 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-14T18:01:17,445 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,445 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,446 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,446 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,446 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,447 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,447 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,448 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,448 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,449 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,449 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,450 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,450 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,451 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,451 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,452 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,452 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,453 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,453 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,454 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,454 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,455 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,455 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,456 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,456 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,457 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,457 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,458 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,458 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:17,459 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:17,460 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:17,460 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:17,460 creating build/lib/evalscope/registry/config 2024-12-14T18:01:17,461 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2024-12-14T18:01:17,461 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2024-12-14T18:01:17,462 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2024-12-14T18:01:17,462 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2024-12-14T18:01:17,463 creating build/lib/evalscope/registry/data 2024-12-14T18:01:17,463 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2024-12-14T18:01:17,463 creating build/lib/evalscope/registry/data/prompt_template 2024-12-14T18:01:17,464 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-14T18:01:17,465 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-14T18:01:17,465 creating build/lib/evalscope/registry/data/qa_browser 2024-12-14T18:01:17,465 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2024-12-14T18:01:17,466 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2024-12-14T18:01:17,466 creating build/lib/evalscope/metrics/resources 2024-12-14T18:01:17,467 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2024-12-14T18:01:17,467 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2024-12-14T18:01:17,468 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,469 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2024-12-14T18:01:17,469 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,470 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2024-12-14T18:01:17,470 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2024-12-14T18:01:17,471 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,472 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,472 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,473 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-14T18:01:17,473 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-14T18:01:17,474 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:17,475 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:17,475 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:17,476 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-14T18:01:17,477 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-14T18:01:17,477 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-14T18:01:17,478 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-14T18:01:17,478 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-14T18:01:17,479 copying evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-14T18:01:17,479 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:17,480 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:17,481 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:17,481 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-14T18:01:17,482 copying evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-14T18:01:17,482 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:17,483 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:17,484 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:17,484 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:17,485 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:17,485 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:17,486 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:17,487 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-14T18:01:17,487 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-14T18:01:17,488 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-14T18:01:17,488 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-14T18:01:17,489 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-14T18:01:17,490 copying evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-14T18:01:17,490 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:17,491 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:17,491 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:17,492 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-14T18:01:17,492 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-14T18:01:17,493 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-14T18:01:17,494 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-14T18:01:17,494 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:17,495 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:17,495 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2024-12-14T18:01:17,496 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:17,497 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:17,498 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:17,498 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2024-12-14T18:01:17,533 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-14T18:01:17,534 !! 2024-12-14T18:01:17,535 ******************************************************************************** 2024-12-14T18:01:17,536 Please avoid running ``setup.py`` directly. 2024-12-14T18:01:17,537 Instead, use pypa/build, pypa/installer or other 2024-12-14T18:01:17,537 standards-based tools. 2024-12-14T18:01:17,539 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-14T18:01:17,539 ******************************************************************************** 2024-12-14T18:01:17,541 !! 2024-12-14T18:01:17,541 self.initialize_options() 2024-12-14T18:01:17,572 installing to build/bdist.linux-armv7l/wheel 2024-12-14T18:01:17,573 running install 2024-12-14T18:01:17,598 running install_lib 2024-12-14T18:01:17,625 creating build/bdist.linux-armv7l/wheel 2024-12-14T18:01:17,628 creating build/bdist.linux-armv7l/wheel/tests 2024-12-14T18:01:17,629 creating build/bdist.linux-armv7l/wheel/tests/swift 2024-12-14T18:01:17,631 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-14T18:01:17,633 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-14T18:01:17,635 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-14T18:01:17,637 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-14T18:01:17,640 creating build/bdist.linux-armv7l/wheel/tests/cli 2024-12-14T18:01:17,641 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-14T18:01:17,643 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-14T18:01:17,645 creating build/bdist.linux-armv7l/wheel/tests/vlm 2024-12-14T18:01:17,646 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-14T18:01:17,648 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-14T18:01:17,650 creating build/bdist.linux-armv7l/wheel/tests/perf 2024-12-14T18:01:17,652 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-14T18:01:17,654 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-14T18:01:17,655 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-14T18:01:17,658 creating build/bdist.linux-armv7l/wheel/tests/rag 2024-12-14T18:01:17,659 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-14T18:01:17,661 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-14T18:01:17,663 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-14T18:01:17,665 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-14T18:01:17,667 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-14T18:01:17,669 creating build/bdist.linux-armv7l/wheel/evalscope 2024-12-14T18:01:17,670 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:17,674 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2024-12-14T18:01:17,676 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2024-12-14T18:01:17,677 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-14T18:01:17,680 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-14T18:01:17,682 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-14T18:01:17,685 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2024-12-14T18:01:17,686 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-14T18:01:17,689 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-14T18:01:17,691 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-14T18:01:17,694 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,695 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,697 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,699 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,702 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-14T18:01:17,704 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2024-12-14T18:01:17,706 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-14T18:01:17,708 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-14T18:01:17,710 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2024-12-14T18:01:17,711 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-14T18:01:17,714 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-14T18:01:17,716 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-14T18:01:17,719 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2024-12-14T18:01:17,720 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-14T18:01:17,722 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-14T18:01:17,724 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-14T18:01:17,726 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-14T18:01:17,729 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2024-12-14T18:01:17,731 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,733 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,735 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,737 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,739 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,741 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,743 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,745 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,747 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,749 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,751 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,753 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,755 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,757 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,758 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,761 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,763 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,764 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,766 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,768 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,770 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,772 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,774 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,776 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,778 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,780 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,782 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,784 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-14T18:01:17,786 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-14T18:01:17,788 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-14T18:01:17,791 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2024-12-14T18:01:17,792 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-14T18:01:17,794 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-14T18:01:17,797 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-14T18:01:17,799 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-14T18:01:17,801 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-14T18:01:17,804 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2024-12-14T18:01:17,805 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-14T18:01:17,808 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-14T18:01:17,811 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-14T18:01:17,813 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,814 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,817 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,820 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,822 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-14T18:01:17,824 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2024-12-14T18:01:17,825 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-14T18:01:17,827 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-14T18:01:17,829 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-14T18:01:17,832 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-14T18:01:17,835 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2024-12-14T18:01:17,836 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-14T18:01:17,839 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-14T18:01:17,842 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-14T18:01:17,843 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-14T18:01:17,846 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2024-12-14T18:01:17,847 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-14T18:01:17,850 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-14T18:01:17,852 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-14T18:01:17,854 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-14T18:01:17,856 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2024-12-14T18:01:17,858 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2024-12-14T18:01:17,859 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-14T18:01:17,862 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-14T18:01:17,864 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-14T18:01:17,866 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-14T18:01:17,869 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-14T18:01:17,870 copying build/lib/evalscope/evaluator/humaneval_evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-14T18:01:17,873 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:17,875 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:17,878 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2024-12-14T18:01:17,879 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,881 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,883 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,886 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,888 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,889 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-14T18:01:17,892 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:17,894 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:17,897 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2024-12-14T18:01:17,898 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,900 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,903 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,904 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,906 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,908 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,910 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-14T18:01:17,912 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2024-12-14T18:01:17,913 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-14T18:01:17,915 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-14T18:01:17,917 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-14T18:01:17,920 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-14T18:01:17,922 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2024-12-14T18:01:17,924 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2024-12-14T18:01:17,925 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-14T18:01:17,928 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2024-12-14T18:01:17,929 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-14T18:01:17,932 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-14T18:01:17,934 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-14T18:01:17,935 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-14T18:01:17,938 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-14T18:01:17,940 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2024-12-14T18:01:17,942 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,943 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,945 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,947 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,949 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,951 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-14T18:01:17,954 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:17,955 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:17,958 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,959 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,961 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-14T18:01:17,964 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:17,966 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:17,967 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:17,970 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:17,972 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:17,974 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-14T18:01:17,976 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:17,978 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-14T18:01:17,980 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:17,982 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:17,984 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,985 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,988 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,990 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,992 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,994 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:17,997 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:18,000 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:18,002 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-14T18:01:18,004 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:18,006 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:18,007 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-14T18:01:18,009 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-14T18:01:18,012 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2024-12-14T18:01:18,014 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2024-12-14T18:01:18,016 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese 2024-12-14T18:01:18,017 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-14T18:01:18,019 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-14T18:01:18,021 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-14T18:01:18,022 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter 2024-12-14T18:01:18,025 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-14T18:01:18,026 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-14T18:01:18,029 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:18,030 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:18,032 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-14T18:01:18,035 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-14T18:01:18,036 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-14T18:01:18,038 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:18,040 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:18,042 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-14T18:01:18,044 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:18,045 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:18,047 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-14T18:01:18,050 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:18,051 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:18,053 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:18,055 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-14T18:01:18,057 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-14T18:01:18,059 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-14T18:01:18,061 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-14T18:01:18,062 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-14T18:01:18,065 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-14T18:01:18,066 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-14T18:01:18,068 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-14T18:01:18,070 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-14T18:01:18,072 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-14T18:01:18,073 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-14T18:01:18,076 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:18,077 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:18,079 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-14T18:01:18,081 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2024-12-14T18:01:18,083 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-14T18:01:18,086 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,087 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,089 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,091 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,094 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,095 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-14T18:01:18,097 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-14T18:01:18,099 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-14T18:01:18,101 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-14T18:01:18,103 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2024-12-14T18:01:18,104 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-14T18:01:18,106 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-14T18:01:18,108 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-14T18:01:18,110 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-14T18:01:18,111 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-14T18:01:18,114 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2024-12-14T18:01:18,115 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-14T18:01:18,118 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-14T18:01:18,121 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2024-12-14T18:01:18,122 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,124 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,126 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,128 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,130 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,132 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-14T18:01:18,135 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2024-12-14T18:01:18,137 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2024-12-14T18:01:18,139 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-14T18:01:18,141 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-14T18:01:18,144 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-14T18:01:18,146 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-14T18:01:18,149 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-14T18:01:18,152 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2024-12-14T18:01:18,153 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,155 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,157 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,158 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,160 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,162 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,164 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,165 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-14T18:01:18,167 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-14T18:01:18,169 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-14T18:01:18,171 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-14T18:01:18,173 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-14T18:01:18,175 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-14T18:01:18,177 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2024-12-14T18:01:18,179 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2024-12-14T18:01:18,180 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,183 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,184 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,187 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,189 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,191 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,194 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-14T18:01:18,195 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,197 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,199 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,201 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,203 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,205 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,208 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2024-12-14T18:01:18,210 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-14T18:01:18,212 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-14T18:01:18,214 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-14T18:01:18,215 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2024-12-14T18:01:18,218 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2024-12-14T18:01:18,219 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,221 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,223 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,225 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,227 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,229 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,231 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,233 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-14T18:01:18,235 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:18,236 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:18,238 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-14T18:01:18,241 creating build/bdist.linux-armv7l/wheel/evalscope/models 2024-12-14T18:01:18,242 creating build/bdist.linux-armv7l/wheel/evalscope/models/api 2024-12-14T18:01:18,244 copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-14T18:01:18,246 copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-14T18:01:18,247 copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-14T18:01:18,249 copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-14T18:01:18,252 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-14T18:01:18,254 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2024-12-14T18:01:18,255 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-14T18:01:18,257 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-14T18:01:18,259 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-14T18:01:18,260 copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-14T18:01:18,262 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:18,265 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2024-12-14T18:01:18,266 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2024-12-14T18:01:18,268 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2024-12-14T18:01:18,269 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-14T18:01:18,272 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-14T18:01:18,274 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2024-12-14T18:01:18,277 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2024-12-14T18:01:18,278 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-14T18:01:18,280 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-14T18:01:18,300 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2024-12-14T18:01:18,301 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-14T18:01:18,304 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-14T18:01:18,305 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-14T18:01:18,307 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-14T18:01:18,310 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2024-12-14T18:01:18,311 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,313 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,315 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,317 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,319 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,321 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,322 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,324 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,326 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,327 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,330 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-14T18:01:18,332 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2024-12-14T18:01:18,334 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:18,336 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2024-12-14T18:01:18,338 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2024-12-14T18:01:18,339 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-14T18:01:18,354 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-14T18:01:18,382 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-14T18:01:18,384 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-14T18:01:18,386 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-14T18:01:18,390 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-14T18:01:18,393 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:18,394 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:18,399 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-14T18:01:18,401 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-14T18:01:18,403 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-14T18:01:18,406 running install_egg_info 2024-12-14T18:01:18,441 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.8.0-py3.11.egg-info 2024-12-14T18:01:18,461 running install_scripts 2024-12-14T18:01:18,510 creating build/bdist.linux-armv7l/wheel/evalscope-0.8.0.dist-info/WHEEL 2024-12-14T18:01:18,513 creating '/tmp/pip-wheel-orub5gpd/evalscope-0.8.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-14T18:01:18,515 adding 'evalscope/__init__.py' 2024-12-14T18:01:18,517 adding 'evalscope/arguments.py' 2024-12-14T18:01:18,519 adding 'evalscope/config.py' 2024-12-14T18:01:18,520 adding 'evalscope/constants.py' 2024-12-14T18:01:18,522 adding 'evalscope/run.py' 2024-12-14T18:01:18,524 adding 'evalscope/run_arena.py' 2024-12-14T18:01:18,526 adding 'evalscope/summarizer.py' 2024-12-14T18:01:18,527 adding 'evalscope/version.py' 2024-12-14T18:01:18,529 adding 'evalscope/backend/__init__.py' 2024-12-14T18:01:18,530 adding 'evalscope/backend/base.py' 2024-12-14T18:01:18,532 adding 'evalscope/backend/opencompass/__init__.py' 2024-12-14T18:01:18,533 adding 'evalscope/backend/opencompass/api_meta_template.py' 2024-12-14T18:01:18,535 adding 'evalscope/backend/opencompass/backend_manager.py' 2024-12-14T18:01:18,537 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2024-12-14T18:01:18,538 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2024-12-14T18:01:18,540 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2024-12-14T18:01:18,542 adding 'evalscope/backend/rag_eval/__init__.py' 2024-12-14T18:01:18,543 adding 'evalscope/backend/rag_eval/backend_manager.py' 2024-12-14T18:01:18,544 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2024-12-14T18:01:18,546 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2024-12-14T18:01:18,547 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2024-12-14T18:01:18,549 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2024-12-14T18:01:18,550 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2024-12-14T18:01:18,552 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2024-12-14T18:01:18,554 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2024-12-14T18:01:18,555 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2024-12-14T18:01:18,557 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2024-12-14T18:01:18,558 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2024-12-14T18:01:18,560 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2024-12-14T18:01:18,561 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2024-12-14T18:01:18,563 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2024-12-14T18:01:18,564 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2024-12-14T18:01:18,566 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2024-12-14T18:01:18,568 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2024-12-14T18:01:18,569 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2024-12-14T18:01:18,571 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2024-12-14T18:01:18,572 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2024-12-14T18:01:18,574 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2024-12-14T18:01:18,576 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2024-12-14T18:01:18,577 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2024-12-14T18:01:18,579 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2024-12-14T18:01:18,580 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2024-12-14T18:01:18,582 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2024-12-14T18:01:18,584 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2024-12-14T18:01:18,586 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json' 2024-12-14T18:01:18,587 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json' 2024-12-14T18:01:18,589 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json' 2024-12-14T18:01:18,591 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json' 2024-12-14T18:01:18,593 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/CustomNodeFilter/scoring_prompt_chinese.json' 2024-12-14T18:01:18,595 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json' 2024-12-14T18:01:18,596 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json' 2024-12-14T18:01:18,598 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json' 2024-12-14T18:01:18,600 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json' 2024-12-14T18:01:18,601 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-14T18:01:18,603 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-14T18:01:18,605 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-14T18:01:18,606 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-14T18:01:18,607 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json' 2024-12-14T18:01:18,609 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json' 2024-12-14T18:01:18,611 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json' 2024-12-14T18:01:18,613 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-14T18:01:18,614 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-14T18:01:18,616 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json' 2024-12-14T18:01:18,617 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json' 2024-12-14T18:01:18,619 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2024-12-14T18:01:18,620 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2024-12-14T18:01:18,622 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2024-12-14T18:01:18,623 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2024-12-14T18:01:18,625 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2024-12-14T18:01:18,626 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2024-12-14T18:01:18,628 adding 'evalscope/backend/rag_eval/utils/clip.py' 2024-12-14T18:01:18,630 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2024-12-14T18:01:18,631 adding 'evalscope/backend/rag_eval/utils/llm.py' 2024-12-14T18:01:18,632 adding 'evalscope/backend/rag_eval/utils/tools.py' 2024-12-14T18:01:18,634 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2024-12-14T18:01:18,636 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2024-12-14T18:01:18,637 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2024-12-14T18:01:18,639 adding 'evalscope/benchmarks/__init__.py' 2024-12-14T18:01:18,640 adding 'evalscope/benchmarks/benchmark.py' 2024-12-14T18:01:18,642 adding 'evalscope/benchmarks/data_adapter.py' 2024-12-14T18:01:18,644 adding 'evalscope/benchmarks/arc/__init__.py' 2024-12-14T18:01:18,646 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2024-12-14T18:01:18,647 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2024-12-14T18:01:18,649 adding 'evalscope/benchmarks/bbh/__init__.py' 2024-12-14T18:01:18,651 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2024-12-14T18:01:18,654 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2024-12-14T18:01:18,655 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2024-12-14T18:01:18,656 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2024-12-14T18:01:18,658 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2024-12-14T18:01:18,659 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2024-12-14T18:01:18,660 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2024-12-14T18:01:18,662 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2024-12-14T18:01:18,663 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2024-12-14T18:01:18,665 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2024-12-14T18:01:18,666 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2024-12-14T18:01:18,667 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2024-12-14T18:01:18,668 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2024-12-14T18:01:18,670 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2024-12-14T18:01:18,671 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2024-12-14T18:01:18,672 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2024-12-14T18:01:18,674 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2024-12-14T18:01:18,675 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2024-12-14T18:01:18,676 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2024-12-14T18:01:18,678 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2024-12-14T18:01:18,679 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2024-12-14T18:01:18,680 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2024-12-14T18:01:18,682 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2024-12-14T18:01:18,683 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2024-12-14T18:01:18,684 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2024-12-14T18:01:18,686 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2024-12-14T18:01:18,687 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2024-12-14T18:01:18,688 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2024-12-14T18:01:18,690 adding 'evalscope/benchmarks/ceval/__init__.py' 2024-12-14T18:01:18,692 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2024-12-14T18:01:18,694 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2024-12-14T18:01:18,695 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2024-12-14T18:01:18,696 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2024-12-14T18:01:18,698 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2024-12-14T18:01:18,700 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2024-12-14T18:01:18,701 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2024-12-14T18:01:18,703 adding 'evalscope/benchmarks/competition_math/__init__.py' 2024-12-14T18:01:18,704 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2024-12-14T18:01:18,707 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2024-12-14T18:01:18,709 adding 'evalscope/benchmarks/general_qa/__init__.py' 2024-12-14T18:01:18,710 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2024-12-14T18:01:18,712 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2024-12-14T18:01:18,713 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2024-12-14T18:01:18,716 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2024-12-14T18:01:18,718 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2024-12-14T18:01:18,719 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2024-12-14T18:01:18,721 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2024-12-14T18:01:18,722 adding 'evalscope/benchmarks/humaneval/__init__.py' 2024-12-14T18:01:18,724 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2024-12-14T18:01:18,726 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2024-12-14T18:01:18,728 adding 'evalscope/benchmarks/mmlu/__init__.py' 2024-12-14T18:01:18,729 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2024-12-14T18:01:18,731 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2024-12-14T18:01:18,733 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2024-12-14T18:01:18,734 adding 'evalscope/benchmarks/race/__init__.py' 2024-12-14T18:01:18,736 adding 'evalscope/benchmarks/race/race.py' 2024-12-14T18:01:18,738 adding 'evalscope/benchmarks/race/race_adapter.py' 2024-12-14T18:01:18,739 adding 'evalscope/benchmarks/race/samples.jsonl' 2024-12-14T18:01:18,741 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2024-12-14T18:01:18,742 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2024-12-14T18:01:18,743 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2024-12-14T18:01:18,745 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2024-12-14T18:01:18,747 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2024-12-14T18:01:18,748 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2024-12-14T18:01:18,750 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2024-12-14T18:01:18,752 adding 'evalscope/cli/__init__.py' 2024-12-14T18:01:18,753 adding 'evalscope/cli/base.py' 2024-12-14T18:01:18,755 adding 'evalscope/cli/cli.py' 2024-12-14T18:01:18,756 adding 'evalscope/cli/start_eval.py' 2024-12-14T18:01:18,757 adding 'evalscope/cli/start_perf.py' 2024-12-14T18:01:18,758 adding 'evalscope/cli/start_server.py' 2024-12-14T18:01:18,760 adding 'evalscope/evaluator/__init__.py' 2024-12-14T18:01:18,762 adding 'evalscope/evaluator/evaluator.py' 2024-12-14T18:01:18,764 adding 'evalscope/evaluator/humaneval_evaluator.py' 2024-12-14T18:01:18,766 adding 'evalscope/evaluator/rating_eval.py' 2024-12-14T18:01:18,767 adding 'evalscope/evaluator/reviewer/__init__.py' 2024-12-14T18:01:18,769 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2024-12-14T18:01:18,771 adding 'evalscope/metrics/__init__.py' 2024-12-14T18:01:18,772 adding 'evalscope/metrics/code_metric.py' 2024-12-14T18:01:18,774 adding 'evalscope/metrics/math_accuracy.py' 2024-12-14T18:01:18,776 adding 'evalscope/metrics/metrics.py' 2024-12-14T18:01:18,777 adding 'evalscope/metrics/rouge_metric.py' 2024-12-14T18:01:18,779 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2024-12-14T18:01:18,781 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2024-12-14T18:01:18,939 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2024-12-14T18:01:19,183 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2024-12-14T18:01:19,192 adding 'evalscope/models/__init__.py' 2024-12-14T18:01:19,194 adding 'evalscope/models/dummy_chat_model.py' 2024-12-14T18:01:19,195 adding 'evalscope/models/model.py' 2024-12-14T18:01:19,197 adding 'evalscope/models/model_adapter.py' 2024-12-14T18:01:19,199 adding 'evalscope/models/openai_model.py' 2024-12-14T18:01:19,200 adding 'evalscope/models/api/__init__.py' 2024-12-14T18:01:19,202 adding 'evalscope/models/api/openai_api.py' 2024-12-14T18:01:19,204 adding 'evalscope/models/custom/__init__.py' 2024-12-14T18:01:19,205 adding 'evalscope/models/custom/custom_model.py' 2024-12-14T18:01:19,207 adding 'evalscope/perf/__init__.py' 2024-12-14T18:01:19,208 adding 'evalscope/perf/arguments.py' 2024-12-14T18:01:19,210 adding 'evalscope/perf/benchmark.py' 2024-12-14T18:01:19,212 adding 'evalscope/perf/http_client.py' 2024-12-14T18:01:19,214 adding 'evalscope/perf/main.py' 2024-12-14T18:01:19,215 adding 'evalscope/perf/plugin/__init__.py' 2024-12-14T18:01:19,216 adding 'evalscope/perf/plugin/registry.py' 2024-12-14T18:01:19,218 adding 'evalscope/perf/plugin/api/__init__.py' 2024-12-14T18:01:19,219 adding 'evalscope/perf/plugin/api/base.py' 2024-12-14T18:01:19,221 adding 'evalscope/perf/plugin/api/custom_api.py' 2024-12-14T18:01:19,222 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2024-12-14T18:01:19,224 adding 'evalscope/perf/plugin/api/openai_api.py' 2024-12-14T18:01:19,226 adding 'evalscope/perf/plugin/datasets/__init__.py' 2024-12-14T18:01:19,227 adding 'evalscope/perf/plugin/datasets/base.py' 2024-12-14T18:01:19,228 adding 'evalscope/perf/plugin/datasets/custom.py' 2024-12-14T18:01:19,230 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2024-12-14T18:01:19,231 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2024-12-14T18:01:19,232 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2024-12-14T18:01:19,234 adding 'evalscope/perf/plugin/datasets/openqa.py' 2024-12-14T18:01:19,235 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2024-12-14T18:01:19,236 adding 'evalscope/perf/utils/__init__.py' 2024-12-14T18:01:19,237 adding 'evalscope/perf/utils/analysis_result.py' 2024-12-14T18:01:19,239 adding 'evalscope/perf/utils/benchmark_util.py' 2024-12-14T18:01:19,240 adding 'evalscope/perf/utils/db_util.py' 2024-12-14T18:01:19,241 adding 'evalscope/perf/utils/handler.py' 2024-12-14T18:01:19,243 adding 'evalscope/perf/utils/local_server.py' 2024-12-14T18:01:19,244 adding 'evalscope/registry/__init__.py' 2024-12-14T18:01:19,246 adding 'evalscope/registry/config/cfg_arena.yaml' 2024-12-14T18:01:19,247 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2024-12-14T18:01:19,249 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2024-12-14T18:01:19,250 adding 'evalscope/registry/config/cfg_single.yaml' 2024-12-14T18:01:19,252 adding 'evalscope/registry/data/question.jsonl' 2024-12-14T18:01:19,254 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2024-12-14T18:01:19,256 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2024-12-14T18:01:19,420 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2024-12-14T18:01:19,429 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2024-12-14T18:01:19,431 adding 'evalscope/registry/tasks/arc.yaml' 2024-12-14T18:01:19,432 adding 'evalscope/registry/tasks/bbh.yaml' 2024-12-14T18:01:19,433 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2024-12-14T18:01:19,434 adding 'evalscope/registry/tasks/ceval.yaml' 2024-12-14T18:01:19,436 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2024-12-14T18:01:19,437 adding 'evalscope/registry/tasks/cmmlu.yaml' 2024-12-14T18:01:19,438 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2024-12-14T18:01:19,439 adding 'evalscope/registry/tasks/general_qa.yaml' 2024-12-14T18:01:19,440 adding 'evalscope/registry/tasks/gsm8k.yaml' 2024-12-14T18:01:19,442 adding 'evalscope/registry/tasks/mmlu.yaml' 2024-12-14T18:01:19,443 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2024-12-14T18:01:19,444 adding 'evalscope/third_party/__init__.py' 2024-12-14T18:01:19,446 adding 'evalscope/third_party/longbench_write/README.md' 2024-12-14T18:01:19,448 adding 'evalscope/third_party/longbench_write/__init__.py' 2024-12-14T18:01:19,449 adding 'evalscope/third_party/longbench_write/default_task.json' 2024-12-14T18:01:19,450 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2024-12-14T18:01:19,452 adding 'evalscope/third_party/longbench_write/eval.py' 2024-12-14T18:01:19,454 adding 'evalscope/third_party/longbench_write/infer.py' 2024-12-14T18:01:19,455 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2024-12-14T18:01:19,457 adding 'evalscope/third_party/longbench_write/utils.py' 2024-12-14T18:01:19,458 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2024-12-14T18:01:19,460 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2024-12-14T18:01:19,467 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2024-12-14T18:01:19,472 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2024-12-14T18:01:19,473 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2024-12-14T18:01:19,475 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2024-12-14T18:01:19,477 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2024-12-14T18:01:19,479 adding 'evalscope/third_party/toolbench_static/README.md' 2024-12-14T18:01:19,480 adding 'evalscope/third_party/toolbench_static/__init__.py' 2024-12-14T18:01:19,481 adding 'evalscope/third_party/toolbench_static/config_default.json' 2024-12-14T18:01:19,483 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2024-12-14T18:01:19,484 adding 'evalscope/third_party/toolbench_static/eval.py' 2024-12-14T18:01:19,486 adding 'evalscope/third_party/toolbench_static/infer.py' 2024-12-14T18:01:19,487 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2024-12-14T18:01:19,488 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2024-12-14T18:01:19,490 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2024-12-14T18:01:19,491 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2024-12-14T18:01:19,493 adding 'evalscope/tools/__init__.py' 2024-12-14T18:01:19,495 adding 'evalscope/tools/combine_reports.py' 2024-12-14T18:01:19,496 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2024-12-14T18:01:19,497 adding 'evalscope/tools/rewrite_eval_results.py' 2024-12-14T18:01:19,499 adding 'evalscope/utils/__init__.py' 2024-12-14T18:01:19,501 adding 'evalscope/utils/arena_utils.py' 2024-12-14T18:01:19,502 adding 'evalscope/utils/chat_service.py' 2024-12-14T18:01:19,504 adding 'evalscope/utils/completion_parsers.py' 2024-12-14T18:01:19,505 adding 'evalscope/utils/logger.py' 2024-12-14T18:01:19,506 adding 'evalscope/utils/model_utils.py' 2024-12-14T18:01:19,509 adding 'evalscope/utils/utils.py' 2024-12-14T18:01:19,511 adding 'tests/__init__.py' 2024-12-14T18:01:19,512 adding 'tests/test_run_all.py' 2024-12-14T18:01:19,514 adding 'tests/cli/__init__.py' 2024-12-14T18:01:19,515 adding 'tests/cli/test_run.py' 2024-12-14T18:01:19,517 adding 'tests/perf/__init__.py' 2024-12-14T18:01:19,518 adding 'tests/perf/test_perf.py' 2024-12-14T18:01:19,520 adding 'tests/rag/__init__.py' 2024-12-14T18:01:19,521 adding 'tests/rag/test_clip_benchmark.py' 2024-12-14T18:01:19,523 adding 'tests/rag/test_mteb.py' 2024-12-14T18:01:19,524 adding 'tests/rag/test_ragas.py' 2024-12-14T18:01:19,526 adding 'tests/swift/__init__.py' 2024-12-14T18:01:19,528 adding 'tests/swift/test_run_swift_eval.py' 2024-12-14T18:01:19,529 adding 'tests/swift/test_run_swift_vlm_eval.py' 2024-12-14T18:01:19,531 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2024-12-14T18:01:19,532 adding 'tests/vlm/__init__.py' 2024-12-14T18:01:19,534 adding 'tests/vlm/test_vlmeval.py' 2024-12-14T18:01:19,536 adding 'evalscope-0.8.0.dist-info/LICENSE' 2024-12-14T18:01:19,539 adding 'evalscope-0.8.0.dist-info/METADATA' 2024-12-14T18:01:19,540 adding 'evalscope-0.8.0.dist-info/WHEEL' 2024-12-14T18:01:19,541 adding 'evalscope-0.8.0.dist-info/entry_points.txt' 2024-12-14T18:01:19,542 adding 'evalscope-0.8.0.dist-info/top_level.txt' 2024-12-14T18:01:19,547 adding 'evalscope-0.8.0.dist-info/RECORD' 2024-12-14T18:01:19,574 removing build/bdist.linux-armv7l/wheel 2024-12-14T18:01:19,774 Building wheel for evalscope (setup.py): finished with status 'done' 2024-12-14T18:01:19,791 Created wheel for evalscope: filename=evalscope-0.8.0-py3-none-any.whl size=1409185 sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 2024-12-14T18:01:19,792 Stored in directory: /tmp/pip-ephem-wheel-cache-3xdw22pv/wheels/12/f7/b9/ff4ac829347f2eeabb18143620f642ef748f862e8cf796c32b 2024-12-14T18:01:19,818 Successfully built evalscope 2024-12-14T18:01:19,855 Removed build tracker: '/tmp/pip-build-tracker-v4k66fkc'