2024-12-04T05:05:36,649 Created temporary directory: /tmp/pip-build-tracker-z1kln_1c 2024-12-04T05:05:36,650 Initialized build tracking at /tmp/pip-build-tracker-z1kln_1c 2024-12-04T05:05:36,651 Created build tracker: /tmp/pip-build-tracker-z1kln_1c 2024-12-04T05:05:36,651 Entered build tracker: /tmp/pip-build-tracker-z1kln_1c 2024-12-04T05:05:36,652 Created temporary directory: /tmp/pip-wheel-jvzeguo9 2024-12-04T05:05:36,656 Created temporary directory: /tmp/pip-ephem-wheel-cache-aleia0ju 2024-12-04T05:05:36,703 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-04T05:05:36,706 2 location(s) to search for versions of evalscope: 2024-12-04T05:05:36,706 * https://pypi.org/simple/evalscope/ 2024-12-04T05:05:36,706 * https://www.piwheels.org/simple/evalscope/ 2024-12-04T05:05:36,707 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2024-12-04T05:05:36,707 Getting page https://pypi.org/simple/evalscope/ 2024-12-04T05:05:36,709 Found index url https://pypi.org/simple/ 2024-12-04T05:05:36,930 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2024-12-04T05:05:36,936 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,937 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2024-12-04T05:05:36,938 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,938 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2024-12-04T05:05:36,939 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,940 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2024-12-04T05:05:36,941 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,942 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2024-12-04T05:05:36,942 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,943 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2024-12-04T05:05:36,944 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,944 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,946 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2024-12-04T05:05:36,946 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,947 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2024-12-04T05:05:36,948 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,948 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2024-12-04T05:05:36,949 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,950 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2024-12-04T05:05:36,950 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,951 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2024-12-04T05:05:36,952 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,953 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2024-12-04T05:05:36,953 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,954 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2024-12-04T05:05:36,955 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:36,956 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2024-12-04T05:05:36,956 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2024-12-04T05:05:36,957 Getting page https://www.piwheels.org/simple/evalscope/ 2024-12-04T05:05:36,959 Found index url https://www.piwheels.org/simple/ 2024-12-04T05:05:37,128 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2024-12-04T05:05:37,130 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:37,130 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-04T05:05:37,131 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2024-12-04T05:05:37,131 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2024-12-04T05:05:37,151 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2024-12-04T05:05:37,153 Collecting evalscope==0.7.2 2024-12-04T05:05:37,156 Created temporary directory: /tmp/pip-unpack-i48__vmv 2024-12-04T05:05:37,376 Downloading evalscope-0.7.2.tar.gz (1.3 MB) 2024-12-04T05:05:38,398 Added evalscope==0.7.2 from https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz to build tracker '/tmp/pip-build-tracker-z1kln_1c' 2024-12-04T05:05:38,401 Running setup.py (path:/tmp/pip-wheel-jvzeguo9/evalscope_4c227a4c55144b9f8dc5faea36341c2e/setup.py) egg_info for package evalscope 2024-12-04T05:05:38,402 Created temporary directory: /tmp/pip-pip-egg-info-psxj4fd9 2024-12-04T05:05:38,403 Preparing metadata (setup.py): started 2024-12-04T05:05:38,405 Running command python setup.py egg_info 2024-12-04T05:05:39,058 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-04T05:05:39,058 !! 2024-12-04T05:05:39,060 ******************************************************************************** 2024-12-04T05:05:39,060 Usage of dash-separated 'index-url' will not be supported in future 2024-12-04T05:05:39,061 versions. Please use the underscore name 'index_url' instead. 2024-12-04T05:05:39,062 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-04T05:05:39,062 or your builds will no longer be supported. 2024-12-04T05:05:39,063 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-04T05:05:39,064 ******************************************************************************** 2024-12-04T05:05:39,065 !! 2024-12-04T05:05:39,066 opt = self.warn_dash_deprecation(opt, section) 2024-12-04T05:05:39,669 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-04T05:05:39,670 !! 2024-12-04T05:05:39,671 ******************************************************************************** 2024-12-04T05:05:39,671 Usage of dash-separated 'index-url' will not be supported in future 2024-12-04T05:05:39,672 versions. Please use the underscore name 'index_url' instead. 2024-12-04T05:05:39,673 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-04T05:05:39,674 or your builds will no longer be supported. 2024-12-04T05:05:39,675 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-04T05:05:39,675 ******************************************************************************** 2024-12-04T05:05:39,677 !! 2024-12-04T05:05:39,677 opt = self.warn_dash_deprecation(opt, section) 2024-12-04T05:05:39,709 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-04T05:05:39,710 running egg_info 2024-12-04T05:05:39,737 creating /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info 2024-12-04T05:05:39,738 writing /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/PKG-INFO 2024-12-04T05:05:39,767 writing dependency_links to /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/dependency_links.txt 2024-12-04T05:05:39,768 writing entry points to /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/entry_points.txt 2024-12-04T05:05:39,782 writing requirements to /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/requires.txt 2024-12-04T05:05:39,783 writing top-level names to /tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/top_level.txt 2024-12-04T05:05:39,785 writing manifest file '/tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/SOURCES.txt' 2024-12-04T05:05:39,995 reading manifest file '/tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/SOURCES.txt' 2024-12-04T05:05:39,998 reading manifest template 'MANIFEST.in' 2024-12-04T05:05:41,452 adding license file 'LICENSE' 2024-12-04T05:05:41,474 writing manifest file '/tmp/pip-pip-egg-info-psxj4fd9/evalscope.egg-info/SOURCES.txt' 2024-12-04T05:05:41,584 Preparing metadata (setup.py): finished with status 'done' 2024-12-04T05:05:41,726 Source in /tmp/pip-wheel-jvzeguo9/evalscope_4c227a4c55144b9f8dc5faea36341c2e has version 0.7.2, which satisfies requirement evalscope==0.7.2 from https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz 2024-12-04T05:05:41,728 Removed evalscope==0.7.2 from https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz from build tracker '/tmp/pip-build-tracker-z1kln_1c' 2024-12-04T05:05:41,918 Created temporary directory: /tmp/pip-unpack-sixjj19i 2024-12-04T05:05:42,190 Created temporary directory: /tmp/pip-unpack-y9uvl8vl 2024-12-04T05:05:42,327 Building wheels for collected packages: evalscope 2024-12-04T05:05:42,760 Created temporary directory: /tmp/pip-wheel-_t7ekcgw 2024-12-04T05:05:42,765 Building wheel for evalscope (setup.py): started 2024-12-04T05:05:42,835 Destination directory: /tmp/pip-wheel-_t7ekcgw 2024-12-04T05:05:42,838 Running command python setup.py bdist_wheel 2024-12-04T05:05:43,378 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-04T05:05:43,490 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-04T05:05:43,491 !! 2024-12-04T05:05:43,492 ******************************************************************************** 2024-12-04T05:05:43,492 Usage of dash-separated 'index-url' will not be supported in future 2024-12-04T05:05:43,493 versions. Please use the underscore name 'index_url' instead. 2024-12-04T05:05:43,494 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-04T05:05:43,495 or your builds will no longer be supported. 2024-12-04T05:05:43,496 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-04T05:05:43,496 ******************************************************************************** 2024-12-04T05:05:43,498 !! 2024-12-04T05:05:43,498 opt = self.warn_dash_deprecation(opt, section) 2024-12-04T05:05:44,083 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-04T05:05:44,083 !! 2024-12-04T05:05:44,085 ******************************************************************************** 2024-12-04T05:05:44,085 Usage of dash-separated 'index-url' will not be supported in future 2024-12-04T05:05:44,086 versions. Please use the underscore name 'index_url' instead. 2024-12-04T05:05:44,087 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-04T05:05:44,087 or your builds will no longer be supported. 2024-12-04T05:05:44,088 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-04T05:05:44,088 ******************************************************************************** 2024-12-04T05:05:44,089 !! 2024-12-04T05:05:44,090 opt = self.warn_dash_deprecation(opt, section) 2024-12-04T05:05:44,093 running bdist_wheel 2024-12-04T05:05:44,236 running build 2024-12-04T05:05:44,237 running build_py 2024-12-04T05:05:44,268 creating build/lib/tests 2024-12-04T05:05:44,270 copying tests/__init__.py -> build/lib/tests 2024-12-04T05:05:44,273 copying tests/test_run_all.py -> build/lib/tests 2024-12-04T05:05:44,275 creating build/lib/evalscope 2024-12-04T05:05:44,277 copying evalscope/run_arena.py -> build/lib/evalscope 2024-12-04T05:05:44,279 copying evalscope/run_ms.py -> build/lib/evalscope 2024-12-04T05:05:44,282 copying evalscope/__init__.py -> build/lib/evalscope 2024-12-04T05:05:44,284 copying evalscope/cache.py -> build/lib/evalscope 2024-12-04T05:05:44,286 copying evalscope/config.py -> build/lib/evalscope 2024-12-04T05:05:44,288 copying evalscope/version.py -> build/lib/evalscope 2024-12-04T05:05:44,290 copying evalscope/summarizer.py -> build/lib/evalscope 2024-12-04T05:05:44,292 copying evalscope/run.py -> build/lib/evalscope 2024-12-04T05:05:44,295 copying evalscope/constants.py -> build/lib/evalscope 2024-12-04T05:05:44,298 creating build/lib/tests/rag 2024-12-04T05:05:44,299 copying tests/rag/__init__.py -> build/lib/tests/rag 2024-12-04T05:05:44,301 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2024-12-04T05:05:44,303 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2024-12-04T05:05:44,306 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2024-12-04T05:05:44,308 creating build/lib/tests/cli 2024-12-04T05:05:44,310 copying tests/cli/__init__.py -> build/lib/tests/cli 2024-12-04T05:05:44,312 copying tests/cli/test_run.py -> build/lib/tests/cli 2024-12-04T05:05:44,314 creating build/lib/tests/vlm 2024-12-04T05:05:44,315 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2024-12-04T05:05:44,317 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2024-12-04T05:05:44,320 creating build/lib/tests/perf 2024-12-04T05:05:44,321 copying tests/perf/test_perf.py -> build/lib/tests/perf 2024-12-04T05:05:44,323 copying tests/perf/__init__.py -> build/lib/tests/perf 2024-12-04T05:05:44,326 creating build/lib/tests/swift 2024-12-04T05:05:44,327 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2024-12-04T05:05:44,329 copying tests/swift/__init__.py -> build/lib/tests/swift 2024-12-04T05:05:44,331 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2024-12-04T05:05:44,335 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2024-12-04T05:05:44,338 creating build/lib/evalscope/metrics 2024-12-04T05:05:44,339 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2024-12-04T05:05:44,341 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2024-12-04T05:05:44,343 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2024-12-04T05:05:44,346 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2024-12-04T05:05:44,348 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2024-12-04T05:05:44,351 creating build/lib/evalscope/utils 2024-12-04T05:05:44,352 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,355 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,358 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,360 copying evalscope/utils/task_cfg_parser.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,362 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,365 copying evalscope/utils/task_utils.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,367 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2024-12-04T05:05:44,370 creating build/lib/evalscope/evaluator 2024-12-04T05:05:44,371 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2024-12-04T05:05:44,373 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2024-12-04T05:05:44,376 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2024-12-04T05:05:44,380 creating build/lib/evalscope/models 2024-12-04T05:05:44,381 copying evalscope/models/template.py -> build/lib/evalscope/models 2024-12-04T05:05:44,385 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2024-12-04T05:05:44,387 copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models 2024-12-04T05:05:44,389 copying evalscope/models/model.py -> build/lib/evalscope/models 2024-12-04T05:05:44,391 copying evalscope/models/openai_model.py -> build/lib/evalscope/models 2024-12-04T05:05:44,394 copying evalscope/models/model_adapter.py -> build/lib/evalscope/models 2024-12-04T05:05:44,397 creating build/lib/evalscope/registry 2024-12-04T05:05:44,398 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2024-12-04T05:05:44,401 creating build/lib/evalscope/benchmarks 2024-12-04T05:05:44,402 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2024-12-04T05:05:44,404 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2024-12-04T05:05:44,407 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2024-12-04T05:05:44,410 creating build/lib/evalscope/backend 2024-12-04T05:05:44,412 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2024-12-04T05:05:44,414 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2024-12-04T05:05:44,416 creating build/lib/evalscope/cli 2024-12-04T05:05:44,418 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2024-12-04T05:05:44,420 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2024-12-04T05:05:44,423 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2024-12-04T05:05:44,425 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2024-12-04T05:05:44,427 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2024-12-04T05:05:44,429 creating build/lib/evalscope/third_party 2024-12-04T05:05:44,430 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2024-12-04T05:05:44,434 creating build/lib/evalscope/perf 2024-12-04T05:05:44,435 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2024-12-04T05:05:44,438 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2024-12-04T05:05:44,440 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2024-12-04T05:05:44,442 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2024-12-04T05:05:44,445 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2024-12-04T05:05:44,448 creating build/lib/evalscope/tools 2024-12-04T05:05:44,450 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2024-12-04T05:05:44,452 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2024-12-04T05:05:44,454 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2024-12-04T05:05:44,456 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2024-12-04T05:05:44,459 creating build/lib/evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:44,460 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:44,462 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:44,465 creating build/lib/evalscope/evaluator/reviewer 2024-12-04T05:05:44,467 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2024-12-04T05:05:44,469 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2024-12-04T05:05:44,472 creating build/lib/evalscope/models/custom 2024-12-04T05:05:44,474 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2024-12-04T05:05:44,476 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2024-12-04T05:05:44,478 creating build/lib/evalscope/models/api 2024-12-04T05:05:44,479 copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api 2024-12-04T05:05:44,482 copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api 2024-12-04T05:05:44,485 creating build/lib/evalscope/benchmarks/general_qa 2024-12-04T05:05:44,486 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-04T05:05:44,488 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-04T05:05:44,491 creating build/lib/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:44,492 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:44,495 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:44,497 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:44,499 creating build/lib/evalscope/benchmarks/bbh 2024-12-04T05:05:44,501 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2024-12-04T05:05:44,503 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2024-12-04T05:05:44,506 creating build/lib/evalscope/benchmarks/competition_math 2024-12-04T05:05:44,507 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-04T05:05:44,510 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-04T05:05:44,513 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-04T05:05:44,515 creating build/lib/evalscope/benchmarks/mmlu 2024-12-04T05:05:44,517 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-04T05:05:44,520 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-04T05:05:44,522 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-04T05:05:44,525 creating build/lib/evalscope/benchmarks/humaneval 2024-12-04T05:05:44,526 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-04T05:05:44,528 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-04T05:05:44,530 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-04T05:05:44,533 creating build/lib/evalscope/benchmarks/truthful_qa 2024-12-04T05:05:44,534 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-04T05:05:44,537 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-04T05:05:44,539 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-04T05:05:44,542 creating build/lib/evalscope/benchmarks/arc 2024-12-04T05:05:44,544 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2024-12-04T05:05:44,546 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2024-12-04T05:05:44,549 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2024-12-04T05:05:44,551 creating build/lib/evalscope/benchmarks/gsm8k 2024-12-04T05:05:44,553 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-04T05:05:44,556 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-04T05:05:44,558 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-04T05:05:44,561 creating build/lib/evalscope/benchmarks/ceval 2024-12-04T05:05:44,562 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2024-12-04T05:05:44,564 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2024-12-04T05:05:44,567 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2024-12-04T05:05:44,570 creating build/lib/evalscope/benchmarks/race 2024-12-04T05:05:44,572 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2024-12-04T05:05:44,575 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2024-12-04T05:05:44,577 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2024-12-04T05:05:44,579 creating build/lib/evalscope/benchmarks/cmmlu 2024-12-04T05:05:44,580 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-04T05:05:44,583 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-04T05:05:44,585 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-04T05:05:44,589 creating build/lib/evalscope/benchmarks/hellaswag 2024-12-04T05:05:44,590 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-04T05:05:44,593 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-04T05:05:44,596 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-04T05:05:44,599 creating build/lib/evalscope/backend/opencompass 2024-12-04T05:05:44,600 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2024-12-04T05:05:44,602 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2024-12-04T05:05:44,605 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2024-12-04T05:05:44,608 creating build/lib/evalscope/backend/vlm_eval_kit 2024-12-04T05:05:44,609 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-04T05:05:44,612 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-04T05:05:44,614 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-04T05:05:44,617 creating build/lib/evalscope/backend/rag_eval 2024-12-04T05:05:44,618 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2024-12-04T05:05:44,620 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2024-12-04T05:05:44,623 creating build/lib/evalscope/backend/opencompass/tasks 2024-12-04T05:05:44,624 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-04T05:05:44,627 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-04T05:05:44,629 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-04T05:05:44,632 creating build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,633 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,635 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,638 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,640 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,642 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-04T05:05:44,645 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:44,647 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:44,649 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:44,651 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:44,653 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:44,656 creating build/lib/evalscope/backend/rag_eval/ragas 2024-12-04T05:05:44,657 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-04T05:05:44,659 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-04T05:05:44,661 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-04T05:05:44,664 creating build/lib/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:44,665 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:44,667 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:44,669 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:44,671 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:44,674 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:44,675 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:44,677 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:44,679 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:44,682 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:44,685 creating build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:44,686 copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:44,688 copying evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:44,690 copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:44,693 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:44,694 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:44,697 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:44,701 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:44,703 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,705 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,707 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,710 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,712 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,715 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,717 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,720 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,723 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:44,726 creating build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:44,727 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:44,729 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:44,732 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:44,734 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:44,738 creating build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,739 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,742 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,744 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,746 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,749 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:44,752 creating build/lib/evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:44,753 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:44,756 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:44,758 creating build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:44,760 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:44,762 creating build/lib/evalscope/third_party/longbench_write/tools 2024-12-04T05:05:44,764 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-04T05:05:44,766 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-04T05:05:44,769 creating build/lib/evalscope/perf/utils 2024-12-04T05:05:44,770 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,773 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,775 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,778 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,780 copying evalscope/perf/utils/chat_service.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,782 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,784 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2024-12-04T05:05:44,787 creating build/lib/evalscope/perf/plugin 2024-12-04T05:05:44,788 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2024-12-04T05:05:44,790 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2024-12-04T05:05:44,793 creating build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,794 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,796 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,798 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,804 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,807 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,808 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,811 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,813 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-04T05:05:44,815 creating build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,816 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,818 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,820 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,823 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,825 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-04T05:05:44,827 running egg_info 2024-12-04T05:05:44,856 writing evalscope.egg-info/PKG-INFO 2024-12-04T05:05:44,884 writing dependency_links to evalscope.egg-info/dependency_links.txt 2024-12-04T05:05:44,885 writing entry points to evalscope.egg-info/entry_points.txt 2024-12-04T05:05:44,899 writing requirements to evalscope.egg-info/requires.txt 2024-12-04T05:05:44,900 writing top-level names to evalscope.egg-info/top_level.txt 2024-12-04T05:05:44,991 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-04T05:05:45,018 reading manifest template 'MANIFEST.in' 2024-12-04T05:05:45,182 adding license file 'LICENSE' 2024-12-04T05:05:45,200 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-04T05:05:45,212 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2024-12-04T05:05:45,213 !! 2024-12-04T05:05:45,214 ******************************************************************************** 2024-12-04T05:05:45,214 ############################ 2024-12-04T05:05:45,215 # Package would be ignored # 2024-12-04T05:05:45,215 ############################ 2024-12-04T05:05:45,216 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2024-12-04T05:05:45,216 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,217 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,218 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2024-12-04T05:05:45,218 to the `packages` configuration field. 2024-12-04T05:05:45,219 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,220 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,220 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,221 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,222 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,223 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2024-12-04T05:05:45,223 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2024-12-04T05:05:45,223 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,224 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,224 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,225 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,226 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,227 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,227 even if it does not contain any `.py` files. 2024-12-04T05:05:45,228 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,228 directory, all directories are treated like packages. 2024-12-04T05:05:45,229 ******************************************************************************** 2024-12-04T05:05:45,229 !! 2024-12-04T05:05:45,230 check.warn(importable) 2024-12-04T05:05:45,230 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2024-12-04T05:05:45,231 !! 2024-12-04T05:05:45,231 ******************************************************************************** 2024-12-04T05:05:45,232 ############################ 2024-12-04T05:05:45,232 # Package would be ignored # 2024-12-04T05:05:45,233 ############################ 2024-12-04T05:05:45,233 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2024-12-04T05:05:45,234 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,234 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,235 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2024-12-04T05:05:45,235 to the `packages` configuration field. 2024-12-04T05:05:45,236 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,237 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,237 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,238 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,239 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,240 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2024-12-04T05:05:45,240 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2024-12-04T05:05:45,240 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,241 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,241 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,242 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,243 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,245 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,245 even if it does not contain any `.py` files. 2024-12-04T05:05:45,246 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,246 directory, all directories are treated like packages. 2024-12-04T05:05:45,246 ******************************************************************************** 2024-12-04T05:05:45,247 !! 2024-12-04T05:05:45,247 check.warn(importable) 2024-12-04T05:05:45,248 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is absent from the `packages` configuration. 2024-12-04T05:05:45,248 !! 2024-12-04T05:05:45,249 ******************************************************************************** 2024-12-04T05:05:45,249 ############################ 2024-12-04T05:05:45,250 # Package would be ignored # 2024-12-04T05:05:45,250 ############################ 2024-12-04T05:05:45,251 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' as an importable package[^1], 2024-12-04T05:05:45,251 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,252 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,252 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is explicitly added 2024-12-04T05:05:45,252 to the `packages` configuration field. 2024-12-04T05:05:45,253 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,254 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,254 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,255 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,256 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,257 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' to be distributed and are 2024-12-04T05:05:45,257 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' via 2024-12-04T05:05:45,258 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,258 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,259 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,259 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,260 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,262 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,262 even if it does not contain any `.py` files. 2024-12-04T05:05:45,262 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,263 directory, all directories are treated like packages. 2024-12-04T05:05:45,263 ******************************************************************************** 2024-12-04T05:05:45,264 !! 2024-12-04T05:05:45,265 check.warn(importable) 2024-12-04T05:05:45,265 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is absent from the `packages` configuration. 2024-12-04T05:05:45,266 !! 2024-12-04T05:05:45,267 ******************************************************************************** 2024-12-04T05:05:45,267 ############################ 2024-12-04T05:05:45,268 # Package would be ignored # 2024-12-04T05:05:45,268 ############################ 2024-12-04T05:05:45,269 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' as an importable package[^1], 2024-12-04T05:05:45,269 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,270 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,270 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is explicitly added 2024-12-04T05:05:45,270 to the `packages` configuration field. 2024-12-04T05:05:45,271 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,271 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,272 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,273 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,274 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,274 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' to be distributed and are 2024-12-04T05:05:45,275 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' via 2024-12-04T05:05:45,275 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,278 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,279 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,284 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,286 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,290 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,291 even if it does not contain any `.py` files. 2024-12-04T05:05:45,291 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,292 directory, all directories are treated like packages. 2024-12-04T05:05:45,293 ******************************************************************************** 2024-12-04T05:05:45,294 !! 2024-12-04T05:05:45,295 check.warn(importable) 2024-12-04T05:05:45,295 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is absent from the `packages` configuration. 2024-12-04T05:05:45,296 !! 2024-12-04T05:05:45,298 ******************************************************************************** 2024-12-04T05:05:45,298 ############################ 2024-12-04T05:05:45,299 # Package would be ignored # 2024-12-04T05:05:45,299 ############################ 2024-12-04T05:05:45,300 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' as an importable package[^1], 2024-12-04T05:05:45,301 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,302 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,303 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is explicitly added 2024-12-04T05:05:45,303 to the `packages` configuration field. 2024-12-04T05:05:45,304 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,307 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,307 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,308 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,310 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,311 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' to be distributed and are 2024-12-04T05:05:45,312 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' via 2024-12-04T05:05:45,313 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,313 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,314 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,316 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,316 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,318 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,319 even if it does not contain any `.py` files. 2024-12-04T05:05:45,319 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,320 directory, all directories are treated like packages. 2024-12-04T05:05:45,320 ******************************************************************************** 2024-12-04T05:05:45,321 !! 2024-12-04T05:05:45,322 check.warn(importable) 2024-12-04T05:05:45,322 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is absent from the `packages` configuration. 2024-12-04T05:05:45,323 !! 2024-12-04T05:05:45,324 ******************************************************************************** 2024-12-04T05:05:45,324 ############################ 2024-12-04T05:05:45,325 # Package would be ignored # 2024-12-04T05:05:45,325 ############################ 2024-12-04T05:05:45,326 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' as an importable package[^1], 2024-12-04T05:05:45,326 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,328 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,328 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is explicitly added 2024-12-04T05:05:45,329 to the `packages` configuration field. 2024-12-04T05:05:45,330 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,331 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,332 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,333 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,334 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' to be distributed and are 2024-12-04T05:05:45,334 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' via 2024-12-04T05:05:45,335 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,335 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,336 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,337 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,338 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,340 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,340 even if it does not contain any `.py` files. 2024-12-04T05:05:45,341 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,341 directory, all directories are treated like packages. 2024-12-04T05:05:45,342 ******************************************************************************** 2024-12-04T05:05:45,342 !! 2024-12-04T05:05:45,343 check.warn(importable) 2024-12-04T05:05:45,343 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is absent from the `packages` configuration. 2024-12-04T05:05:45,344 !! 2024-12-04T05:05:45,345 ******************************************************************************** 2024-12-04T05:05:45,346 ############################ 2024-12-04T05:05:45,346 # Package would be ignored # 2024-12-04T05:05:45,346 ############################ 2024-12-04T05:05:45,347 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' as an importable package[^1], 2024-12-04T05:05:45,347 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,348 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,349 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is explicitly added 2024-12-04T05:05:45,349 to the `packages` configuration field. 2024-12-04T05:05:45,350 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,351 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,351 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,352 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,353 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,354 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' to be distributed and are 2024-12-04T05:05:45,354 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' via 2024-12-04T05:05:45,355 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,355 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,356 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,357 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,358 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,359 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,360 even if it does not contain any `.py` files. 2024-12-04T05:05:45,360 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,361 directory, all directories are treated like packages. 2024-12-04T05:05:45,361 ******************************************************************************** 2024-12-04T05:05:45,362 !! 2024-12-04T05:05:45,363 check.warn(importable) 2024-12-04T05:05:45,363 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is absent from the `packages` configuration. 2024-12-04T05:05:45,364 !! 2024-12-04T05:05:45,365 ******************************************************************************** 2024-12-04T05:05:45,365 ############################ 2024-12-04T05:05:45,366 # Package would be ignored # 2024-12-04T05:05:45,366 ############################ 2024-12-04T05:05:45,367 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' as an importable package[^1], 2024-12-04T05:05:45,367 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,368 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,369 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is explicitly added 2024-12-04T05:05:45,369 to the `packages` configuration field. 2024-12-04T05:05:45,370 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,371 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,371 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,372 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,373 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,374 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' to be distributed and are 2024-12-04T05:05:45,374 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' via 2024-12-04T05:05:45,374 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,375 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,375 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,376 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,377 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,379 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,379 even if it does not contain any `.py` files. 2024-12-04T05:05:45,380 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,380 directory, all directories are treated like packages. 2024-12-04T05:05:45,381 ******************************************************************************** 2024-12-04T05:05:45,382 !! 2024-12-04T05:05:45,382 check.warn(importable) 2024-12-04T05:05:45,383 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-04T05:05:45,383 !! 2024-12-04T05:05:45,384 ******************************************************************************** 2024-12-04T05:05:45,385 ############################ 2024-12-04T05:05:45,385 # Package would be ignored # 2024-12-04T05:05:45,386 ############################ 2024-12-04T05:05:45,387 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-04T05:05:45,387 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,388 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,389 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is explicitly added 2024-12-04T05:05:45,389 to the `packages` configuration field. 2024-12-04T05:05:45,390 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,391 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,391 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,392 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,393 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,394 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' to be distributed and are 2024-12-04T05:05:45,395 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' via 2024-12-04T05:05:45,395 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,396 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,396 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,397 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,398 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,399 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,399 even if it does not contain any `.py` files. 2024-12-04T05:05:45,400 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,400 directory, all directories are treated like packages. 2024-12-04T05:05:45,401 ******************************************************************************** 2024-12-04T05:05:45,402 !! 2024-12-04T05:05:45,402 check.warn(importable) 2024-12-04T05:05:45,403 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is absent from the `packages` configuration. 2024-12-04T05:05:45,403 !! 2024-12-04T05:05:45,404 ******************************************************************************** 2024-12-04T05:05:45,405 ############################ 2024-12-04T05:05:45,405 # Package would be ignored # 2024-12-04T05:05:45,406 ############################ 2024-12-04T05:05:45,406 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' as an importable package[^1], 2024-12-04T05:05:45,407 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,408 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,408 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is explicitly added 2024-12-04T05:05:45,409 to the `packages` configuration field. 2024-12-04T05:05:45,410 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,410 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,411 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,412 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,413 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,414 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' to be distributed and are 2024-12-04T05:05:45,415 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' via 2024-12-04T05:05:45,415 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,416 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,417 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,418 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,419 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,420 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,421 even if it does not contain any `.py` files. 2024-12-04T05:05:45,421 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,422 directory, all directories are treated like packages. 2024-12-04T05:05:45,422 ******************************************************************************** 2024-12-04T05:05:45,423 !! 2024-12-04T05:05:45,424 check.warn(importable) 2024-12-04T05:05:45,424 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is absent from the `packages` configuration. 2024-12-04T05:05:45,425 !! 2024-12-04T05:05:45,426 ******************************************************************************** 2024-12-04T05:05:45,426 ############################ 2024-12-04T05:05:45,427 # Package would be ignored # 2024-12-04T05:05:45,427 ############################ 2024-12-04T05:05:45,428 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' as an importable package[^1], 2024-12-04T05:05:45,428 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,429 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,430 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is explicitly added 2024-12-04T05:05:45,430 to the `packages` configuration field. 2024-12-04T05:05:45,431 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,432 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,432 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,434 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,434 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,435 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' to be distributed and are 2024-12-04T05:05:45,436 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' via 2024-12-04T05:05:45,436 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,437 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,437 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,439 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,440 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,441 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,442 even if it does not contain any `.py` files. 2024-12-04T05:05:45,442 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,443 directory, all directories are treated like packages. 2024-12-04T05:05:45,443 ******************************************************************************** 2024-12-04T05:05:45,445 !! 2024-12-04T05:05:45,445 check.warn(importable) 2024-12-04T05:05:45,446 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is absent from the `packages` configuration. 2024-12-04T05:05:45,447 !! 2024-12-04T05:05:45,448 ******************************************************************************** 2024-12-04T05:05:45,448 ############################ 2024-12-04T05:05:45,449 # Package would be ignored # 2024-12-04T05:05:45,450 ############################ 2024-12-04T05:05:45,450 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' as an importable package[^1], 2024-12-04T05:05:45,450 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,451 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,452 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is explicitly added 2024-12-04T05:05:45,452 to the `packages` configuration field. 2024-12-04T05:05:45,454 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,454 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,454 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,455 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,456 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,457 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' to be distributed and are 2024-12-04T05:05:45,458 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' via 2024-12-04T05:05:45,458 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,459 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,459 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,460 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,462 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,464 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,464 even if it does not contain any `.py` files. 2024-12-04T05:05:45,465 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,465 directory, all directories are treated like packages. 2024-12-04T05:05:45,466 ******************************************************************************** 2024-12-04T05:05:45,467 !! 2024-12-04T05:05:45,467 check.warn(importable) 2024-12-04T05:05:45,468 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-12-04T05:05:45,468 !! 2024-12-04T05:05:45,470 ******************************************************************************** 2024-12-04T05:05:45,470 ############################ 2024-12-04T05:05:45,471 # Package would be ignored # 2024-12-04T05:05:45,473 ############################ 2024-12-04T05:05:45,477 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' as an importable package[^1], 2024-12-04T05:05:45,478 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,479 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,480 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is explicitly added 2024-12-04T05:05:45,480 to the `packages` configuration field. 2024-12-04T05:05:45,482 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,482 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,483 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,484 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,485 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,486 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' to be distributed and are 2024-12-04T05:05:45,487 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' via 2024-12-04T05:05:45,490 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,497 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,505 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,506 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,507 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,509 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,509 even if it does not contain any `.py` files. 2024-12-04T05:05:45,510 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,510 directory, all directories are treated like packages. 2024-12-04T05:05:45,511 ******************************************************************************** 2024-12-04T05:05:45,512 !! 2024-12-04T05:05:45,512 check.warn(importable) 2024-12-04T05:05:45,513 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is absent from the `packages` configuration. 2024-12-04T05:05:45,513 !! 2024-12-04T05:05:45,515 ******************************************************************************** 2024-12-04T05:05:45,515 ############################ 2024-12-04T05:05:45,515 # Package would be ignored # 2024-12-04T05:05:45,516 ############################ 2024-12-04T05:05:45,517 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' as an importable package[^1], 2024-12-04T05:05:45,517 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,518 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,519 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is explicitly added 2024-12-04T05:05:45,519 to the `packages` configuration field. 2024-12-04T05:05:45,520 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,521 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,521 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,522 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,524 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,525 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' to be distributed and are 2024-12-04T05:05:45,525 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' via 2024-12-04T05:05:45,526 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,527 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,527 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,528 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,531 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,532 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,533 even if it does not contain any `.py` files. 2024-12-04T05:05:45,534 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,534 directory, all directories are treated like packages. 2024-12-04T05:05:45,535 ******************************************************************************** 2024-12-04T05:05:45,536 !! 2024-12-04T05:05:45,536 check.warn(importable) 2024-12-04T05:05:45,537 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is absent from the `packages` configuration. 2024-12-04T05:05:45,538 !! 2024-12-04T05:05:45,538 ******************************************************************************** 2024-12-04T05:05:45,539 ############################ 2024-12-04T05:05:45,539 # Package would be ignored # 2024-12-04T05:05:45,540 ############################ 2024-12-04T05:05:45,540 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' as an importable package[^1], 2024-12-04T05:05:45,541 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,542 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,542 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is explicitly added 2024-12-04T05:05:45,543 to the `packages` configuration field. 2024-12-04T05:05:45,544 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,545 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,545 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,546 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,548 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,549 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' to be distributed and are 2024-12-04T05:05:45,550 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' via 2024-12-04T05:05:45,550 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,551 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,551 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,553 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,554 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,555 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,556 even if it does not contain any `.py` files. 2024-12-04T05:05:45,557 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,557 directory, all directories are treated like packages. 2024-12-04T05:05:45,558 ******************************************************************************** 2024-12-04T05:05:45,559 !! 2024-12-04T05:05:45,560 check.warn(importable) 2024-12-04T05:05:45,560 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2024-12-04T05:05:45,561 !! 2024-12-04T05:05:45,562 ******************************************************************************** 2024-12-04T05:05:45,563 ############################ 2024-12-04T05:05:45,564 # Package would be ignored # 2024-12-04T05:05:45,566 ############################ 2024-12-04T05:05:45,568 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2024-12-04T05:05:45,569 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,570 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,571 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2024-12-04T05:05:45,571 to the `packages` configuration field. 2024-12-04T05:05:45,572 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,573 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,573 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,574 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,575 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,576 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2024-12-04T05:05:45,577 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2024-12-04T05:05:45,577 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,578 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,578 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,579 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,580 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,581 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,582 even if it does not contain any `.py` files. 2024-12-04T05:05:45,582 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,583 directory, all directories are treated like packages. 2024-12-04T05:05:45,583 ******************************************************************************** 2024-12-04T05:05:45,584 !! 2024-12-04T05:05:45,584 check.warn(importable) 2024-12-04T05:05:45,585 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2024-12-04T05:05:45,585 !! 2024-12-04T05:05:45,586 ******************************************************************************** 2024-12-04T05:05:45,587 ############################ 2024-12-04T05:05:45,587 # Package would be ignored # 2024-12-04T05:05:45,588 ############################ 2024-12-04T05:05:45,588 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2024-12-04T05:05:45,589 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,590 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,590 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2024-12-04T05:05:45,591 to the `packages` configuration field. 2024-12-04T05:05:45,592 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,593 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,593 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,595 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,596 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,597 If you don't want 'evalscope.metrics.resources' to be distributed and are 2024-12-04T05:05:45,597 already explicitly excluding 'evalscope.metrics.resources' via 2024-12-04T05:05:45,598 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,598 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,599 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,600 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,601 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,602 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,603 even if it does not contain any `.py` files. 2024-12-04T05:05:45,603 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,604 directory, all directories are treated like packages. 2024-12-04T05:05:45,604 ******************************************************************************** 2024-12-04T05:05:45,605 !! 2024-12-04T05:05:45,606 check.warn(importable) 2024-12-04T05:05:45,606 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2024-12-04T05:05:45,607 !! 2024-12-04T05:05:45,608 ******************************************************************************** 2024-12-04T05:05:45,609 ############################ 2024-12-04T05:05:45,610 # Package would be ignored # 2024-12-04T05:05:45,610 ############################ 2024-12-04T05:05:45,610 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2024-12-04T05:05:45,611 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,612 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,613 package, please make sure that 'evalscope.registry.config' is explicitly added 2024-12-04T05:05:45,613 to the `packages` configuration field. 2024-12-04T05:05:45,614 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,615 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,616 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,616 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,618 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,619 If you don't want 'evalscope.registry.config' to be distributed and are 2024-12-04T05:05:45,619 already explicitly excluding 'evalscope.registry.config' via 2024-12-04T05:05:45,620 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,620 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,621 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,622 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,623 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,624 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,625 even if it does not contain any `.py` files. 2024-12-04T05:05:45,625 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,626 directory, all directories are treated like packages. 2024-12-04T05:05:45,626 ******************************************************************************** 2024-12-04T05:05:45,627 !! 2024-12-04T05:05:45,628 check.warn(importable) 2024-12-04T05:05:45,628 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2024-12-04T05:05:45,629 !! 2024-12-04T05:05:45,630 ******************************************************************************** 2024-12-04T05:05:45,630 ############################ 2024-12-04T05:05:45,631 # Package would be ignored # 2024-12-04T05:05:45,631 ############################ 2024-12-04T05:05:45,632 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2024-12-04T05:05:45,632 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,633 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,634 package, please make sure that 'evalscope.registry.data' is explicitly added 2024-12-04T05:05:45,634 to the `packages` configuration field. 2024-12-04T05:05:45,635 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,635 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,636 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,637 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,638 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,639 If you don't want 'evalscope.registry.data' to be distributed and are 2024-12-04T05:05:45,639 already explicitly excluding 'evalscope.registry.data' via 2024-12-04T05:05:45,640 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,640 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,641 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,642 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,643 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,644 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,645 even if it does not contain any `.py` files. 2024-12-04T05:05:45,645 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,646 directory, all directories are treated like packages. 2024-12-04T05:05:45,646 ******************************************************************************** 2024-12-04T05:05:45,647 !! 2024-12-04T05:05:45,648 check.warn(importable) 2024-12-04T05:05:45,648 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2024-12-04T05:05:45,649 !! 2024-12-04T05:05:45,650 ******************************************************************************** 2024-12-04T05:05:45,650 ############################ 2024-12-04T05:05:45,651 # Package would be ignored # 2024-12-04T05:05:45,651 ############################ 2024-12-04T05:05:45,652 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2024-12-04T05:05:45,652 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,654 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,654 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2024-12-04T05:05:45,655 to the `packages` configuration field. 2024-12-04T05:05:45,656 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,656 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,657 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,658 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,659 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,659 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2024-12-04T05:05:45,660 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2024-12-04T05:05:45,660 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,661 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,661 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,662 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,663 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,665 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,665 even if it does not contain any `.py` files. 2024-12-04T05:05:45,666 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,666 directory, all directories are treated like packages. 2024-12-04T05:05:45,666 ******************************************************************************** 2024-12-04T05:05:45,667 !! 2024-12-04T05:05:45,668 check.warn(importable) 2024-12-04T05:05:45,668 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2024-12-04T05:05:45,669 !! 2024-12-04T05:05:45,670 ******************************************************************************** 2024-12-04T05:05:45,671 ############################ 2024-12-04T05:05:45,671 # Package would be ignored # 2024-12-04T05:05:45,671 ############################ 2024-12-04T05:05:45,672 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2024-12-04T05:05:45,673 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,674 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,675 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2024-12-04T05:05:45,675 to the `packages` configuration field. 2024-12-04T05:05:45,676 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,676 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,677 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,678 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,679 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,680 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2024-12-04T05:05:45,681 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2024-12-04T05:05:45,681 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,682 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,682 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,683 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,684 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,686 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,687 even if it does not contain any `.py` files. 2024-12-04T05:05:45,687 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,687 directory, all directories are treated like packages. 2024-12-04T05:05:45,688 ******************************************************************************** 2024-12-04T05:05:45,689 !! 2024-12-04T05:05:45,689 check.warn(importable) 2024-12-04T05:05:45,690 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2024-12-04T05:05:45,690 !! 2024-12-04T05:05:45,691 ******************************************************************************** 2024-12-04T05:05:45,691 ############################ 2024-12-04T05:05:45,692 # Package would be ignored # 2024-12-04T05:05:45,692 ############################ 2024-12-04T05:05:45,693 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2024-12-04T05:05:45,693 but it is absent from setuptools' `packages` configuration. 2024-12-04T05:05:45,694 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-04T05:05:45,695 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2024-12-04T05:05:45,695 to the `packages` configuration field. 2024-12-04T05:05:45,696 Alternatively, you can also rely on setuptools' discovery methods 2024-12-04T05:05:45,697 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-04T05:05:45,697 instead of `find_packages(...)`/`find:`). 2024-12-04T05:05:45,698 You can read more about "package discovery" on setuptools documentation page: 2024-12-04T05:05:45,699 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-04T05:05:45,700 If you don't want 'evalscope.registry.tasks' to be distributed and are 2024-12-04T05:05:45,701 already explicitly excluding 'evalscope.registry.tasks' via 2024-12-04T05:05:45,701 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-04T05:05:45,702 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-04T05:05:45,702 combination with a more fine grained `package-data` configuration. 2024-12-04T05:05:45,703 You can read more about "package data files" on setuptools documentation page: 2024-12-04T05:05:45,705 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-04T05:05:45,706 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-04T05:05:45,707 even if it does not contain any `.py` files. 2024-12-04T05:05:45,708 On the other hand, currently there is no concept of package data 2024-12-04T05:05:45,708 directory, all directories are treated like packages. 2024-12-04T05:05:45,709 ******************************************************************************** 2024-12-04T05:05:45,710 !! 2024-12-04T05:05:45,710 check.warn(importable) 2024-12-04T05:05:45,711 creating build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,711 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,712 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,713 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,714 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,714 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,715 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,715 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,716 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,716 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,717 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,717 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2024-12-04T05:05:45,718 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,718 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,719 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,719 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,720 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,720 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,721 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,721 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,722 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,722 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,723 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,723 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,724 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,724 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,725 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,725 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,726 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,727 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,727 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,728 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,728 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,729 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,729 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,730 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,730 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,731 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,732 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,732 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:45,732 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:45,733 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:45,733 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:45,734 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:45,734 creating build/lib/evalscope/metrics/resources 2024-12-04T05:05:45,735 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2024-12-04T05:05:45,735 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2024-12-04T05:05:45,736 creating build/lib/evalscope/registry/config 2024-12-04T05:05:45,736 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2024-12-04T05:05:45,737 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2024-12-04T05:05:45,737 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2024-12-04T05:05:45,738 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2024-12-04T05:05:45,738 creating build/lib/evalscope/registry/data 2024-12-04T05:05:45,739 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2024-12-04T05:05:45,739 creating build/lib/evalscope/registry/data/prompt_template 2024-12-04T05:05:45,740 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-04T05:05:45,740 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-04T05:05:45,741 creating build/lib/evalscope/registry/data/qa_browser 2024-12-04T05:05:45,741 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2024-12-04T05:05:45,742 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2024-12-04T05:05:45,742 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:45,743 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2024-12-04T05:05:45,743 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2024-12-04T05:05:45,744 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2024-12-04T05:05:45,744 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2024-12-04T05:05:45,745 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:45,745 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:45,746 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:45,746 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-04T05:05:45,747 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-04T05:05:45,748 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:45,748 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:45,748 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:45,749 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-04T05:05:45,749 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-04T05:05:45,750 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-04T05:05:45,750 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-04T05:05:45,751 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:45,751 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:45,752 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:45,752 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-04T05:05:45,753 copying evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-04T05:05:45,753 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:45,754 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:45,754 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:45,755 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:45,755 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:45,756 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:45,756 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:45,757 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-04T05:05:45,758 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-04T05:05:45,758 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-04T05:05:45,759 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-04T05:05:45,759 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-04T05:05:45,760 copying evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-04T05:05:45,760 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:45,761 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:45,762 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:45,762 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-04T05:05:45,762 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-04T05:05:45,763 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-04T05:05:45,763 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-04T05:05:45,764 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:45,765 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:45,765 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:45,766 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2024-12-04T05:05:45,766 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:45,767 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:45,767 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2024-12-04T05:05:45,781 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-04T05:05:45,782 !! 2024-12-04T05:05:45,783 ******************************************************************************** 2024-12-04T05:05:45,783 Please avoid running ``setup.py`` directly. 2024-12-04T05:05:45,784 Instead, use pypa/build, pypa/installer or other 2024-12-04T05:05:45,784 standards-based tools. 2024-12-04T05:05:45,786 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-04T05:05:45,786 ******************************************************************************** 2024-12-04T05:05:45,787 !! 2024-12-04T05:05:45,788 self.initialize_options() 2024-12-04T05:05:45,811 installing to build/bdist.linux-armv7l/wheel 2024-12-04T05:05:45,811 running install 2024-12-04T05:05:45,836 running install_lib 2024-12-04T05:05:45,865 creating build/bdist.linux-armv7l/wheel 2024-12-04T05:05:45,867 creating build/bdist.linux-armv7l/wheel/tests 2024-12-04T05:05:45,868 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-04T05:05:45,871 creating build/bdist.linux-armv7l/wheel/tests/rag 2024-12-04T05:05:45,872 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-04T05:05:45,874 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-04T05:05:45,876 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-04T05:05:45,878 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-04T05:05:45,880 creating build/bdist.linux-armv7l/wheel/tests/cli 2024-12-04T05:05:45,881 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-04T05:05:45,883 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-04T05:05:45,885 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-04T05:05:45,888 creating build/bdist.linux-armv7l/wheel/tests/vlm 2024-12-04T05:05:45,889 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-04T05:05:45,891 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-04T05:05:45,893 creating build/bdist.linux-armv7l/wheel/tests/perf 2024-12-04T05:05:45,895 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-04T05:05:45,897 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-04T05:05:45,899 creating build/bdist.linux-armv7l/wheel/tests/swift 2024-12-04T05:05:45,900 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-04T05:05:45,903 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-04T05:05:45,904 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-04T05:05:45,907 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-04T05:05:45,910 creating build/bdist.linux-armv7l/wheel/evalscope 2024-12-04T05:05:45,911 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2024-12-04T05:05:45,913 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2024-12-04T05:05:45,915 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-04T05:05:45,942 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-04T05:05:45,952 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-04T05:05:45,954 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-04T05:05:45,956 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-04T05:05:45,959 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:45,961 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:45,963 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-04T05:05:45,965 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-04T05:05:45,968 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-04T05:05:45,972 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2024-12-04T05:05:45,973 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,975 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,979 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,981 copying build/lib/evalscope/utils/task_cfg_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,983 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,986 copying build/lib/evalscope/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,988 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-04T05:05:45,990 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:45,993 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2024-12-04T05:05:45,995 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2024-12-04T05:05:45,997 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-04T05:05:45,999 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-04T05:05:46,003 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-04T05:05:46,006 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-04T05:05:46,008 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-04T05:05:46,011 creating build/bdist.linux-armv7l/wheel/evalscope/models 2024-12-04T05:05:46,012 copying build/lib/evalscope/models/template.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,016 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,019 copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,020 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,023 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2024-12-04T05:05:46,024 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-04T05:05:46,026 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-04T05:05:46,028 copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,030 copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-04T05:05:46,033 creating build/bdist.linux-armv7l/wheel/evalscope/models/api 2024-12-04T05:05:46,035 copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-04T05:05:46,037 copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-04T05:05:46,040 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2024-12-04T05:05:46,042 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2024-12-04T05:05:46,045 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2024-12-04T05:05:46,046 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,048 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,050 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,051 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,054 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,055 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,058 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,060 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,062 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,063 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,066 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-04T05:05:46,068 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2024-12-04T05:05:46,070 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2024-12-04T05:05:46,072 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-04T05:05:46,074 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-04T05:05:46,093 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2024-12-04T05:05:46,096 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2024-12-04T05:05:46,097 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-04T05:05:46,100 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-04T05:05:46,103 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2024-12-04T05:05:46,104 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-04T05:05:46,106 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-04T05:05:46,108 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-04T05:05:46,111 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-04T05:05:46,114 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2024-12-04T05:05:46,115 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-04T05:05:46,118 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2024-12-04T05:05:46,119 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-04T05:05:46,121 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-04T05:05:46,124 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2024-12-04T05:05:46,125 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-04T05:05:46,127 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-04T05:05:46,130 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-04T05:05:46,132 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-04T05:05:46,134 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2024-12-04T05:05:46,135 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-04T05:05:46,139 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,140 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,142 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,144 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,147 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,149 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,151 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,153 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,155 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,157 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,159 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,161 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,163 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,166 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,168 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,170 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,172 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,174 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,176 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,178 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,180 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,182 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,184 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,187 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,189 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,191 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,193 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,195 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-04T05:05:46,198 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-04T05:05:46,200 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2024-12-04T05:05:46,202 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-04T05:05:46,204 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-04T05:05:46,206 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-04T05:05:46,208 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-04T05:05:46,210 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-04T05:05:46,213 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2024-12-04T05:05:46,214 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-04T05:05:46,216 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-04T05:05:46,219 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-04T05:05:46,220 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-04T05:05:46,223 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2024-12-04T05:05:46,224 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-04T05:05:46,227 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-04T05:05:46,228 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-04T05:05:46,231 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2024-12-04T05:05:46,232 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-04T05:05:46,234 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-04T05:05:46,236 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-04T05:05:46,240 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2024-12-04T05:05:46,241 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-04T05:05:46,243 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-04T05:05:46,246 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-04T05:05:46,248 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2024-12-04T05:05:46,250 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-04T05:05:46,252 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-04T05:05:46,255 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-04T05:05:46,257 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2024-12-04T05:05:46,258 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-04T05:05:46,261 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-04T05:05:46,263 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-04T05:05:46,265 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-04T05:05:46,269 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2024-12-04T05:05:46,270 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-04T05:05:46,272 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-04T05:05:46,274 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-04T05:05:46,276 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-04T05:05:46,279 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2024-12-04T05:05:46,280 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-04T05:05:46,283 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-04T05:05:46,285 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-04T05:05:46,287 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-04T05:05:46,290 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2024-12-04T05:05:46,292 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-04T05:05:46,293 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-04T05:05:46,296 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-04T05:05:46,298 copying build/lib/evalscope/run_ms.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,300 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,303 copying build/lib/evalscope/cache.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,306 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2024-12-04T05:05:46,308 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2024-12-04T05:05:46,309 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-04T05:05:46,311 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-04T05:05:46,313 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-04T05:05:46,316 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2024-12-04T05:05:46,317 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-04T05:05:46,319 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-04T05:05:46,321 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-04T05:05:46,323 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-04T05:05:46,325 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-04T05:05:46,327 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2024-12-04T05:05:46,328 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-04T05:05:46,330 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-04T05:05:46,332 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-04T05:05:46,335 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2024-12-04T05:05:46,337 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,338 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,340 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,343 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,345 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,347 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-04T05:05:46,349 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-04T05:05:46,351 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-04T05:05:46,354 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:46,356 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:46,357 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:46,360 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-04T05:05:46,362 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:46,364 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:46,366 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:46,368 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-04T05:05:46,371 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:46,372 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:46,374 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:46,376 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:46,378 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-04T05:05:46,382 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2024-12-04T05:05:46,383 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:46,385 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:46,387 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:46,389 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-12-04T05:05:46,392 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2024-12-04T05:05:46,394 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese 2024-12-04T05:05:46,396 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:46,397 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:46,399 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:46,401 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-12-04T05:05:46,404 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-04T05:05:46,405 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-12-04T05:05:46,408 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-04T05:05:46,409 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-12-04T05:05:46,412 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:46,413 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:46,415 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-12-04T05:05:46,418 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-04T05:05:46,419 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-12-04T05:05:46,422 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-04T05:05:46,423 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-12-04T05:05:46,426 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:46,427 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:46,429 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-12-04T05:05:46,432 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:46,433 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:46,435 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-12-04T05:05:46,438 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-04T05:05:46,440 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-12-04T05:05:46,442 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-04T05:05:46,444 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-12-04T05:05:46,447 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-04T05:05:46,448 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-12-04T05:05:46,451 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-04T05:05:46,452 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-12-04T05:05:46,455 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:46,456 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:46,459 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-12-04T05:05:46,461 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2024-12-04T05:05:46,463 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-04T05:05:46,465 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-04T05:05:46,467 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-04T05:05:46,469 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:46,471 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:46,472 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:46,475 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-04T05:05:46,477 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:46,478 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:46,480 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:46,482 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:46,484 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-04T05:05:46,487 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,488 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,490 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,492 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,494 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,498 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,500 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,503 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,506 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-04T05:05:46,509 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2024-12-04T05:05:46,510 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-04T05:05:46,512 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-04T05:05:46,515 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-04T05:05:46,517 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-04T05:05:46,519 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-04T05:05:46,521 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,524 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,527 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,530 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,533 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-04T05:05:46,536 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2024-12-04T05:05:46,538 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2024-12-04T05:05:46,541 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2024-12-04T05:05:46,542 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,545 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,548 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:46,549 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:46,551 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-04T05:05:46,554 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,556 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,558 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,561 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,564 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,567 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-04T05:05:46,570 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2024-12-04T05:05:46,571 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,574 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,577 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,579 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,583 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,586 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,588 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,592 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-04T05:05:46,595 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,597 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,600 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,603 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,606 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,609 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-04T05:05:46,613 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2024-12-04T05:05:46,614 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-04T05:05:46,618 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-04T05:05:46,621 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2024-12-04T05:05:46,623 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2024-12-04T05:05:46,625 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,628 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,631 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,634 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,636 copying build/lib/evalscope/perf/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,639 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,644 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-04T05:05:46,647 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-04T05:05:46,651 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2024-12-04T05:05:46,653 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-04T05:05:46,656 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2024-12-04T05:05:46,658 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,661 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,663 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,666 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,668 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,670 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,673 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,675 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-04T05:05:46,678 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-04T05:05:46,681 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2024-12-04T05:05:46,682 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-04T05:05:46,684 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-04T05:05:46,686 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-04T05:05:46,688 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-04T05:05:46,690 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-04T05:05:46,692 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-04T05:05:46,694 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-04T05:05:46,697 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-04T05:05:46,699 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-04T05:05:46,702 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2024-12-04T05:05:46,704 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-04T05:05:46,706 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-04T05:05:46,708 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-04T05:05:46,711 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-04T05:05:46,712 running install_egg_info 2024-12-04T05:05:46,747 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.7.2-py3.11.egg-info 2024-12-04T05:05:46,764 running install_scripts 2024-12-04T05:05:46,814 creating build/bdist.linux-armv7l/wheel/evalscope-0.7.2.dist-info/WHEEL 2024-12-04T05:05:46,817 creating '/tmp/pip-wheel-_t7ekcgw/evalscope-0.7.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-04T05:05:46,820 adding 'evalscope/__init__.py' 2024-12-04T05:05:46,821 adding 'evalscope/cache.py' 2024-12-04T05:05:46,823 adding 'evalscope/config.py' 2024-12-04T05:05:46,825 adding 'evalscope/constants.py' 2024-12-04T05:05:46,827 adding 'evalscope/run.py' 2024-12-04T05:05:46,829 adding 'evalscope/run_arena.py' 2024-12-04T05:05:46,831 adding 'evalscope/run_ms.py' 2024-12-04T05:05:46,833 adding 'evalscope/summarizer.py' 2024-12-04T05:05:46,834 adding 'evalscope/version.py' 2024-12-04T05:05:46,835 adding 'evalscope/backend/__init__.py' 2024-12-04T05:05:46,837 adding 'evalscope/backend/base.py' 2024-12-04T05:05:46,838 adding 'evalscope/backend/opencompass/__init__.py' 2024-12-04T05:05:46,840 adding 'evalscope/backend/opencompass/api_meta_template.py' 2024-12-04T05:05:46,841 adding 'evalscope/backend/opencompass/backend_manager.py' 2024-12-04T05:05:46,843 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2024-12-04T05:05:46,844 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2024-12-04T05:05:46,846 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2024-12-04T05:05:46,848 adding 'evalscope/backend/rag_eval/__init__.py' 2024-12-04T05:05:46,849 adding 'evalscope/backend/rag_eval/backend_manager.py' 2024-12-04T05:05:46,850 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2024-12-04T05:05:46,852 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2024-12-04T05:05:46,853 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2024-12-04T05:05:46,855 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2024-12-04T05:05:46,856 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2024-12-04T05:05:46,858 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2024-12-04T05:05:46,859 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2024-12-04T05:05:46,861 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2024-12-04T05:05:46,864 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2024-12-04T05:05:46,865 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2024-12-04T05:05:46,867 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2024-12-04T05:05:46,868 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2024-12-04T05:05:46,870 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2024-12-04T05:05:46,871 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2024-12-04T05:05:46,874 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2024-12-04T05:05:46,875 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2024-12-04T05:05:46,877 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2024-12-04T05:05:46,878 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2024-12-04T05:05:46,879 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2024-12-04T05:05:46,881 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2024-12-04T05:05:46,883 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2024-12-04T05:05:46,884 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2024-12-04T05:05:46,886 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2024-12-04T05:05:46,887 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2024-12-04T05:05:46,889 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2024-12-04T05:05:46,890 adding 'evalscope/backend/rag_eval/ragas/metrics/__init__.py' 2024-12-04T05:05:46,892 adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py' 2024-12-04T05:05:46,893 adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py' 2024-12-04T05:05:46,895 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2024-12-04T05:05:46,898 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json' 2024-12-04T05:05:46,899 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json' 2024-12-04T05:05:46,901 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json' 2024-12-04T05:05:46,903 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json' 2024-12-04T05:05:46,905 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json' 2024-12-04T05:05:46,906 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json' 2024-12-04T05:05:46,908 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json' 2024-12-04T05:05:46,910 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json' 2024-12-04T05:05:46,911 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-04T05:05:46,912 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-04T05:05:46,914 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-04T05:05:46,916 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-04T05:05:46,917 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json' 2024-12-04T05:05:46,919 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json' 2024-12-04T05:05:46,921 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json' 2024-12-04T05:05:46,923 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-12-04T05:05:46,924 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-12-04T05:05:46,926 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json' 2024-12-04T05:05:46,928 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json' 2024-12-04T05:05:46,930 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2024-12-04T05:05:46,932 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2024-12-04T05:05:46,933 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2024-12-04T05:05:46,935 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2024-12-04T05:05:46,936 adding 'evalscope/backend/rag_eval/utils/clip.py' 2024-12-04T05:05:46,938 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2024-12-04T05:05:46,939 adding 'evalscope/backend/rag_eval/utils/llm.py' 2024-12-04T05:05:46,940 adding 'evalscope/backend/rag_eval/utils/tools.py' 2024-12-04T05:05:46,942 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2024-12-04T05:05:46,943 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2024-12-04T05:05:46,945 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2024-12-04T05:05:46,947 adding 'evalscope/benchmarks/__init__.py' 2024-12-04T05:05:46,948 adding 'evalscope/benchmarks/benchmark.py' 2024-12-04T05:05:46,950 adding 'evalscope/benchmarks/data_adapter.py' 2024-12-04T05:05:46,952 adding 'evalscope/benchmarks/arc/__init__.py' 2024-12-04T05:05:46,954 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2024-12-04T05:05:46,956 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2024-12-04T05:05:46,957 adding 'evalscope/benchmarks/bbh/__init__.py' 2024-12-04T05:05:46,959 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2024-12-04T05:05:46,962 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2024-12-04T05:05:46,963 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2024-12-04T05:05:46,965 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2024-12-04T05:05:46,966 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2024-12-04T05:05:46,967 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2024-12-04T05:05:46,969 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2024-12-04T05:05:46,970 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2024-12-04T05:05:46,971 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2024-12-04T05:05:46,973 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2024-12-04T05:05:46,974 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2024-12-04T05:05:46,975 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2024-12-04T05:05:46,976 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2024-12-04T05:05:46,978 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2024-12-04T05:05:46,979 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2024-12-04T05:05:46,980 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2024-12-04T05:05:46,981 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2024-12-04T05:05:46,983 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2024-12-04T05:05:46,984 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2024-12-04T05:05:46,986 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2024-12-04T05:05:46,987 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2024-12-04T05:05:46,988 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2024-12-04T05:05:46,990 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2024-12-04T05:05:46,991 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2024-12-04T05:05:46,993 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2024-12-04T05:05:46,994 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2024-12-04T05:05:46,996 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2024-12-04T05:05:46,998 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2024-12-04T05:05:46,999 adding 'evalscope/benchmarks/ceval/__init__.py' 2024-12-04T05:05:47,001 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2024-12-04T05:05:47,003 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2024-12-04T05:05:47,004 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2024-12-04T05:05:47,006 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2024-12-04T05:05:47,007 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2024-12-04T05:05:47,010 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2024-12-04T05:05:47,011 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2024-12-04T05:05:47,013 adding 'evalscope/benchmarks/competition_math/__init__.py' 2024-12-04T05:05:47,014 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2024-12-04T05:05:47,016 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2024-12-04T05:05:47,018 adding 'evalscope/benchmarks/general_qa/__init__.py' 2024-12-04T05:05:47,020 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2024-12-04T05:05:47,022 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2024-12-04T05:05:47,023 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2024-12-04T05:05:47,025 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2024-12-04T05:05:47,028 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2024-12-04T05:05:47,029 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2024-12-04T05:05:47,031 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2024-12-04T05:05:47,032 adding 'evalscope/benchmarks/humaneval/__init__.py' 2024-12-04T05:05:47,034 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2024-12-04T05:05:47,035 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2024-12-04T05:05:47,037 adding 'evalscope/benchmarks/mmlu/__init__.py' 2024-12-04T05:05:47,039 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2024-12-04T05:05:47,041 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2024-12-04T05:05:47,042 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2024-12-04T05:05:47,044 adding 'evalscope/benchmarks/race/__init__.py' 2024-12-04T05:05:47,045 adding 'evalscope/benchmarks/race/race.py' 2024-12-04T05:05:47,047 adding 'evalscope/benchmarks/race/race_adapter.py' 2024-12-04T05:05:47,048 adding 'evalscope/benchmarks/race/samples.jsonl' 2024-12-04T05:05:47,049 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2024-12-04T05:05:47,051 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2024-12-04T05:05:47,052 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2024-12-04T05:05:47,054 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2024-12-04T05:05:47,056 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2024-12-04T05:05:47,057 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2024-12-04T05:05:47,059 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2024-12-04T05:05:47,061 adding 'evalscope/cli/__init__.py' 2024-12-04T05:05:47,062 adding 'evalscope/cli/base.py' 2024-12-04T05:05:47,064 adding 'evalscope/cli/cli.py' 2024-12-04T05:05:47,065 adding 'evalscope/cli/start_perf.py' 2024-12-04T05:05:47,066 adding 'evalscope/cli/start_server.py' 2024-12-04T05:05:47,068 adding 'evalscope/evaluator/__init__.py' 2024-12-04T05:05:47,072 adding 'evalscope/evaluator/evaluator.py' 2024-12-04T05:05:47,073 adding 'evalscope/evaluator/rating_eval.py' 2024-12-04T05:05:47,075 adding 'evalscope/evaluator/reviewer/__init__.py' 2024-12-04T05:05:47,077 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2024-12-04T05:05:47,079 adding 'evalscope/metrics/__init__.py' 2024-12-04T05:05:47,080 adding 'evalscope/metrics/code_metric.py' 2024-12-04T05:05:47,082 adding 'evalscope/metrics/math_accuracy.py' 2024-12-04T05:05:47,084 adding 'evalscope/metrics/metrics.py' 2024-12-04T05:05:47,085 adding 'evalscope/metrics/rouge_metric.py' 2024-12-04T05:05:47,087 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2024-12-04T05:05:47,089 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2024-12-04T05:05:47,249 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2024-12-04T05:05:47,496 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2024-12-04T05:05:47,505 adding 'evalscope/models/__init__.py' 2024-12-04T05:05:47,507 adding 'evalscope/models/dummy_chat_model.py' 2024-12-04T05:05:47,508 adding 'evalscope/models/model.py' 2024-12-04T05:05:47,511 adding 'evalscope/models/model_adapter.py' 2024-12-04T05:05:47,512 adding 'evalscope/models/openai_model.py' 2024-12-04T05:05:47,518 adding 'evalscope/models/template.py' 2024-12-04T05:05:47,520 adding 'evalscope/models/api/__init__.py' 2024-12-04T05:05:47,522 adding 'evalscope/models/api/openai_api.py' 2024-12-04T05:05:47,523 adding 'evalscope/models/custom/__init__.py' 2024-12-04T05:05:47,525 adding 'evalscope/models/custom/custom_model.py' 2024-12-04T05:05:47,526 adding 'evalscope/perf/__init__.py' 2024-12-04T05:05:47,528 adding 'evalscope/perf/arguments.py' 2024-12-04T05:05:47,530 adding 'evalscope/perf/benchmark.py' 2024-12-04T05:05:47,531 adding 'evalscope/perf/http_client.py' 2024-12-04T05:05:47,533 adding 'evalscope/perf/main.py' 2024-12-04T05:05:47,534 adding 'evalscope/perf/plugin/__init__.py' 2024-12-04T05:05:47,536 adding 'evalscope/perf/plugin/registry.py' 2024-12-04T05:05:47,537 adding 'evalscope/perf/plugin/api/__init__.py' 2024-12-04T05:05:47,539 adding 'evalscope/perf/plugin/api/base.py' 2024-12-04T05:05:47,540 adding 'evalscope/perf/plugin/api/custom_api.py' 2024-12-04T05:05:47,542 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2024-12-04T05:05:47,544 adding 'evalscope/perf/plugin/api/openai_api.py' 2024-12-04T05:05:47,545 adding 'evalscope/perf/plugin/datasets/__init__.py' 2024-12-04T05:05:47,547 adding 'evalscope/perf/plugin/datasets/base.py' 2024-12-04T05:05:47,548 adding 'evalscope/perf/plugin/datasets/custom.py' 2024-12-04T05:05:47,549 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2024-12-04T05:05:47,550 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2024-12-04T05:05:47,552 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2024-12-04T05:05:47,553 adding 'evalscope/perf/plugin/datasets/openqa.py' 2024-12-04T05:05:47,554 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2024-12-04T05:05:47,556 adding 'evalscope/perf/utils/__init__.py' 2024-12-04T05:05:47,557 adding 'evalscope/perf/utils/analysis_result.py' 2024-12-04T05:05:47,558 adding 'evalscope/perf/utils/benchmark_util.py' 2024-12-04T05:05:47,560 adding 'evalscope/perf/utils/chat_service.py' 2024-12-04T05:05:47,562 adding 'evalscope/perf/utils/db_util.py' 2024-12-04T05:05:47,563 adding 'evalscope/perf/utils/handler.py' 2024-12-04T05:05:47,564 adding 'evalscope/perf/utils/local_server.py' 2024-12-04T05:05:47,566 adding 'evalscope/registry/__init__.py' 2024-12-04T05:05:47,568 adding 'evalscope/registry/config/cfg_arena.yaml' 2024-12-04T05:05:47,569 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2024-12-04T05:05:47,570 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2024-12-04T05:05:47,571 adding 'evalscope/registry/config/cfg_single.yaml' 2024-12-04T05:05:47,574 adding 'evalscope/registry/data/question.jsonl' 2024-12-04T05:05:47,576 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2024-12-04T05:05:47,578 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2024-12-04T05:05:47,743 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2024-12-04T05:05:47,752 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2024-12-04T05:05:47,754 adding 'evalscope/registry/tasks/arc.yaml' 2024-12-04T05:05:47,755 adding 'evalscope/registry/tasks/bbh.yaml' 2024-12-04T05:05:47,757 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2024-12-04T05:05:47,758 adding 'evalscope/registry/tasks/ceval.yaml' 2024-12-04T05:05:47,759 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2024-12-04T05:05:47,760 adding 'evalscope/registry/tasks/cmmlu.yaml' 2024-12-04T05:05:47,761 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2024-12-04T05:05:47,763 adding 'evalscope/registry/tasks/general_qa.yaml' 2024-12-04T05:05:47,764 adding 'evalscope/registry/tasks/gsm8k.yaml' 2024-12-04T05:05:47,766 adding 'evalscope/registry/tasks/mmlu.yaml' 2024-12-04T05:05:47,767 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2024-12-04T05:05:47,768 adding 'evalscope/third_party/__init__.py' 2024-12-04T05:05:47,770 adding 'evalscope/third_party/longbench_write/README.md' 2024-12-04T05:05:47,772 adding 'evalscope/third_party/longbench_write/__init__.py' 2024-12-04T05:05:47,773 adding 'evalscope/third_party/longbench_write/default_task.json' 2024-12-04T05:05:47,774 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2024-12-04T05:05:47,776 adding 'evalscope/third_party/longbench_write/eval.py' 2024-12-04T05:05:47,778 adding 'evalscope/third_party/longbench_write/infer.py' 2024-12-04T05:05:47,780 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2024-12-04T05:05:47,781 adding 'evalscope/third_party/longbench_write/utils.py' 2024-12-04T05:05:47,782 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2024-12-04T05:05:47,784 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2024-12-04T05:05:47,791 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2024-12-04T05:05:47,795 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2024-12-04T05:05:47,797 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2024-12-04T05:05:47,798 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2024-12-04T05:05:47,800 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2024-12-04T05:05:47,802 adding 'evalscope/third_party/toolbench_static/README.md' 2024-12-04T05:05:47,803 adding 'evalscope/third_party/toolbench_static/__init__.py' 2024-12-04T05:05:47,804 adding 'evalscope/third_party/toolbench_static/config_default.json' 2024-12-04T05:05:47,813 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2024-12-04T05:05:47,814 adding 'evalscope/third_party/toolbench_static/eval.py' 2024-12-04T05:05:47,816 adding 'evalscope/third_party/toolbench_static/infer.py' 2024-12-04T05:05:47,817 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2024-12-04T05:05:47,819 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2024-12-04T05:05:47,820 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2024-12-04T05:05:47,822 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2024-12-04T05:05:47,823 adding 'evalscope/tools/__init__.py' 2024-12-04T05:05:47,825 adding 'evalscope/tools/combine_reports.py' 2024-12-04T05:05:47,826 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2024-12-04T05:05:47,827 adding 'evalscope/tools/rewrite_eval_results.py' 2024-12-04T05:05:47,829 adding 'evalscope/utils/__init__.py' 2024-12-04T05:05:47,831 adding 'evalscope/utils/arena_utils.py' 2024-12-04T05:05:47,832 adding 'evalscope/utils/completion_parsers.py' 2024-12-04T05:05:47,834 adding 'evalscope/utils/logger.py' 2024-12-04T05:05:47,835 adding 'evalscope/utils/task_cfg_parser.py' 2024-12-04T05:05:47,836 adding 'evalscope/utils/task_utils.py' 2024-12-04T05:05:47,838 adding 'evalscope/utils/utils.py' 2024-12-04T05:05:47,841 adding 'tests/__init__.py' 2024-12-04T05:05:47,842 adding 'tests/test_run_all.py' 2024-12-04T05:05:47,844 adding 'tests/cli/__init__.py' 2024-12-04T05:05:47,845 adding 'tests/cli/test_run.py' 2024-12-04T05:05:47,847 adding 'tests/perf/__init__.py' 2024-12-04T05:05:47,848 adding 'tests/perf/test_perf.py' 2024-12-04T05:05:47,850 adding 'tests/rag/__init__.py' 2024-12-04T05:05:47,852 adding 'tests/rag/test_clip_benchmark.py' 2024-12-04T05:05:47,853 adding 'tests/rag/test_mteb.py' 2024-12-04T05:05:47,855 adding 'tests/rag/test_ragas.py' 2024-12-04T05:05:47,856 adding 'tests/swift/__init__.py' 2024-12-04T05:05:47,858 adding 'tests/swift/test_run_swift_eval.py' 2024-12-04T05:05:47,860 adding 'tests/swift/test_run_swift_vlm_eval.py' 2024-12-04T05:05:47,862 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2024-12-04T05:05:47,863 adding 'tests/vlm/__init__.py' 2024-12-04T05:05:47,865 adding 'tests/vlm/test_vlmeval.py' 2024-12-04T05:05:47,867 adding 'evalscope-0.7.2.dist-info/LICENSE' 2024-12-04T05:05:47,870 adding 'evalscope-0.7.2.dist-info/METADATA' 2024-12-04T05:05:47,871 adding 'evalscope-0.7.2.dist-info/WHEEL' 2024-12-04T05:05:47,872 adding 'evalscope-0.7.2.dist-info/entry_points.txt' 2024-12-04T05:05:47,873 adding 'evalscope-0.7.2.dist-info/top_level.txt' 2024-12-04T05:05:47,877 adding 'evalscope-0.7.2.dist-info/RECORD' 2024-12-04T05:05:47,896 removing build/bdist.linux-armv7l/wheel 2024-12-04T05:05:48,117 Building wheel for evalscope (setup.py): finished with status 'done' 2024-12-04T05:05:48,134 Created wheel for evalscope: filename=evalscope-0.7.2-py3-none-any.whl size=1428170 sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 2024-12-04T05:05:48,135 Stored in directory: /tmp/pip-ephem-wheel-cache-aleia0ju/wheels/19/3b/97/050561a421cbdec4b9dadca9cf8bc876c32219532f6a732b61 2024-12-04T05:05:48,161 Successfully built evalscope 2024-12-04T05:05:48,204 Removed build tracker: '/tmp/pip-build-tracker-z1kln_1c'