2024-11-29T16:34:43,891 Created temporary directory: /tmp/pip-build-tracker-pi_dipr0 2024-11-29T16:34:43,893 Initialized build tracking at /tmp/pip-build-tracker-pi_dipr0 2024-11-29T16:34:43,893 Created build tracker: /tmp/pip-build-tracker-pi_dipr0 2024-11-29T16:34:43,893 Entered build tracker: /tmp/pip-build-tracker-pi_dipr0 2024-11-29T16:34:43,894 Created temporary directory: /tmp/pip-wheel-nt7fyscp 2024-11-29T16:34:43,898 Created temporary directory: /tmp/pip-ephem-wheel-cache-wht66mz0 2024-11-29T16:34:43,941 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-11-29T16:34:43,943 2 location(s) to search for versions of evalscope: 2024-11-29T16:34:43,943 * https://pypi.org/simple/evalscope/ 2024-11-29T16:34:43,943 * https://www.piwheels.org/simple/evalscope/ 2024-11-29T16:34:43,944 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2024-11-29T16:34:43,945 Getting page https://pypi.org/simple/evalscope/ 2024-11-29T16:34:43,946 Found index url https://pypi.org/simple/ 2024-11-29T16:34:44,093 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2024-11-29T16:34:44,099 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,100 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2024-11-29T16:34:44,101 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,102 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2024-11-29T16:34:44,102 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,103 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2024-11-29T16:34:44,104 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,105 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2024-11-29T16:34:44,106 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,107 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2024-11-29T16:34:44,107 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,108 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,109 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2024-11-29T16:34:44,110 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,111 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2024-11-29T16:34:44,111 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,112 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2024-11-29T16:34:44,113 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,114 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2024-11-29T16:34:44,114 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,115 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2024-11-29T16:34:44,116 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,117 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2024-11-29T16:34:44,117 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,118 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2024-11-29T16:34:44,119 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2024-11-29T16:34:44,119 Getting page https://www.piwheels.org/simple/evalscope/ 2024-11-29T16:34:44,121 Found index url https://www.piwheels.org/simple/ 2024-11-29T16:34:44,292 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2024-11-29T16:34:44,293 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-11-29T16:34:44,294 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2024-11-29T16:34:44,295 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2024-11-29T16:34:44,313 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2024-11-29T16:34:44,315 Collecting evalscope==0.7.1 2024-11-29T16:34:44,317 Created temporary directory: /tmp/pip-unpack-w6f3jjdh 2024-11-29T16:34:44,537 Downloading evalscope-0.7.1.tar.gz (1.3 MB) 2024-11-29T16:34:45,469 Added evalscope==0.7.1 from https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz to build tracker '/tmp/pip-build-tracker-pi_dipr0' 2024-11-29T16:34:45,471 Running setup.py (path:/tmp/pip-wheel-nt7fyscp/evalscope_f631f41cef9a471e95fc146507e4325d/setup.py) egg_info for package evalscope 2024-11-29T16:34:45,472 Created temporary directory: /tmp/pip-pip-egg-info-ky_nemw5 2024-11-29T16:34:45,473 Preparing metadata (setup.py): started 2024-11-29T16:34:45,474 Running command python setup.py egg_info 2024-11-29T16:34:46,059 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-11-29T16:34:46,060 !! 2024-11-29T16:34:46,063 ******************************************************************************** 2024-11-29T16:34:46,063 Usage of dash-separated 'index-url' will not be supported in future 2024-11-29T16:34:46,064 versions. Please use the underscore name 'index_url' instead. 2024-11-29T16:34:46,065 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-11-29T16:34:46,066 or your builds will no longer be supported. 2024-11-29T16:34:46,067 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-11-29T16:34:46,068 ******************************************************************************** 2024-11-29T16:34:46,069 !! 2024-11-29T16:34:46,069 opt = self.warn_dash_deprecation(opt, section) 2024-11-29T16:34:46,862 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-11-29T16:34:46,863 !! 2024-11-29T16:34:46,864 ******************************************************************************** 2024-11-29T16:34:46,865 Usage of dash-separated 'index-url' will not be supported in future 2024-11-29T16:34:46,866 versions. Please use the underscore name 'index_url' instead. 2024-11-29T16:34:46,867 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-11-29T16:34:46,867 or your builds will no longer be supported. 2024-11-29T16:34:46,868 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-11-29T16:34:46,869 ******************************************************************************** 2024-11-29T16:34:46,870 !! 2024-11-29T16:34:46,871 opt = self.warn_dash_deprecation(opt, section) 2024-11-29T16:34:46,902 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-11-29T16:34:46,902 running egg_info 2024-11-29T16:34:46,930 creating /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info 2024-11-29T16:34:46,931 writing /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/PKG-INFO 2024-11-29T16:34:46,960 writing dependency_links to /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/dependency_links.txt 2024-11-29T16:34:46,961 writing entry points to /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/entry_points.txt 2024-11-29T16:34:46,975 writing requirements to /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/requires.txt 2024-11-29T16:34:46,976 writing top-level names to /tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/top_level.txt 2024-11-29T16:34:46,978 writing manifest file '/tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/SOURCES.txt' 2024-11-29T16:34:47,128 reading manifest file '/tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/SOURCES.txt' 2024-11-29T16:34:47,130 reading manifest template 'MANIFEST.in' 2024-11-29T16:34:47,259 adding license file 'LICENSE' 2024-11-29T16:34:47,273 writing manifest file '/tmp/pip-pip-egg-info-ky_nemw5/evalscope.egg-info/SOURCES.txt' 2024-11-29T16:34:47,383 Preparing metadata (setup.py): finished with status 'done' 2024-11-29T16:34:47,389 Source in /tmp/pip-wheel-nt7fyscp/evalscope_f631f41cef9a471e95fc146507e4325d has version 0.7.1, which satisfies requirement evalscope==0.7.1 from https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz 2024-11-29T16:34:47,390 Removed evalscope==0.7.1 from https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz from build tracker '/tmp/pip-build-tracker-pi_dipr0' 2024-11-29T16:34:47,443 Created temporary directory: /tmp/pip-unpack-mdddue7t 2024-11-29T16:34:47,444 Created temporary directory: /tmp/pip-unpack-yy6gsrh4 2024-11-29T16:34:47,444 Building wheels for collected packages: evalscope 2024-11-29T16:34:47,448 Created temporary directory: /tmp/pip-wheel-3jwxlb7w 2024-11-29T16:34:47,449 Building wheel for evalscope (setup.py): started 2024-11-29T16:34:47,450 Destination directory: /tmp/pip-wheel-3jwxlb7w 2024-11-29T16:34:47,450 Running command python setup.py bdist_wheel 2024-11-29T16:34:47,903 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-11-29T16:34:48,005 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-11-29T16:34:48,005 !! 2024-11-29T16:34:48,006 ******************************************************************************** 2024-11-29T16:34:48,007 Usage of dash-separated 'index-url' will not be supported in future 2024-11-29T16:34:48,008 versions. Please use the underscore name 'index_url' instead. 2024-11-29T16:34:48,009 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-11-29T16:34:48,009 or your builds will no longer be supported. 2024-11-29T16:34:48,010 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-11-29T16:34:48,011 ******************************************************************************** 2024-11-29T16:34:48,012 !! 2024-11-29T16:34:48,013 opt = self.warn_dash_deprecation(opt, section) 2024-11-29T16:34:48,803 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-11-29T16:34:48,803 !! 2024-11-29T16:34:48,804 ******************************************************************************** 2024-11-29T16:34:48,805 Usage of dash-separated 'index-url' will not be supported in future 2024-11-29T16:34:48,805 versions. Please use the underscore name 'index_url' instead. 2024-11-29T16:34:48,806 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-11-29T16:34:48,807 or your builds will no longer be supported. 2024-11-29T16:34:48,808 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-11-29T16:34:48,809 ******************************************************************************** 2024-11-29T16:34:48,810 !! 2024-11-29T16:34:48,810 opt = self.warn_dash_deprecation(opt, section) 2024-11-29T16:34:48,812 running bdist_wheel 2024-11-29T16:34:48,947 running build 2024-11-29T16:34:48,948 running build_py 2024-11-29T16:34:48,977 creating build/lib/evalscope 2024-11-29T16:34:48,980 copying evalscope/summarizer.py -> build/lib/evalscope 2024-11-29T16:34:48,983 copying evalscope/constants.py -> build/lib/evalscope 2024-11-29T16:34:48,985 copying evalscope/version.py -> build/lib/evalscope 2024-11-29T16:34:48,986 copying evalscope/cache.py -> build/lib/evalscope 2024-11-29T16:34:48,988 copying evalscope/run.py -> build/lib/evalscope 2024-11-29T16:34:48,991 copying evalscope/config.py -> build/lib/evalscope 2024-11-29T16:34:48,993 copying evalscope/__init__.py -> build/lib/evalscope 2024-11-29T16:34:48,995 copying evalscope/run_ms.py -> build/lib/evalscope 2024-11-29T16:34:48,997 copying evalscope/run_arena.py -> build/lib/evalscope 2024-11-29T16:34:49,000 creating build/lib/tests 2024-11-29T16:34:49,001 copying tests/__init__.py -> build/lib/tests 2024-11-29T16:34:49,003 copying tests/test_run_all.py -> build/lib/tests 2024-11-29T16:34:49,005 creating build/lib/evalscope/models 2024-11-29T16:34:49,006 copying evalscope/models/openai_model.py -> build/lib/evalscope/models 2024-11-29T16:34:49,008 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2024-11-29T16:34:49,010 copying evalscope/models/model.py -> build/lib/evalscope/models 2024-11-29T16:34:49,011 copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models 2024-11-29T16:34:49,013 copying evalscope/models/template.py -> build/lib/evalscope/models 2024-11-29T16:34:49,016 copying evalscope/models/model_adapter.py -> build/lib/evalscope/models 2024-11-29T16:34:49,020 creating build/lib/evalscope/registry 2024-11-29T16:34:49,021 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2024-11-29T16:34:49,023 creating build/lib/evalscope/metrics 2024-11-29T16:34:49,024 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2024-11-29T16:34:49,026 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2024-11-29T16:34:49,028 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2024-11-29T16:34:49,030 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2024-11-29T16:34:49,033 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2024-11-29T16:34:49,035 creating build/lib/evalscope/utils 2024-11-29T16:34:49,036 copying evalscope/utils/task_cfg_parser.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,038 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,041 copying evalscope/utils/task_utils.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,043 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,044 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,047 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,048 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2024-11-29T16:34:49,051 creating build/lib/evalscope/perf 2024-11-29T16:34:49,052 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2024-11-29T16:34:49,054 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2024-11-29T16:34:49,055 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2024-11-29T16:34:49,058 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2024-11-29T16:34:49,060 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2024-11-29T16:34:49,063 creating build/lib/evalscope/cli 2024-11-29T16:34:49,064 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2024-11-29T16:34:49,066 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2024-11-29T16:34:49,069 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2024-11-29T16:34:49,071 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2024-11-29T16:34:49,073 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2024-11-29T16:34:49,075 creating build/lib/evalscope/benchmarks 2024-11-29T16:34:49,076 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2024-11-29T16:34:49,079 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2024-11-29T16:34:49,081 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2024-11-29T16:34:49,083 creating build/lib/evalscope/evaluator 2024-11-29T16:34:49,084 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2024-11-29T16:34:49,087 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2024-11-29T16:34:49,089 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2024-11-29T16:34:49,091 creating build/lib/evalscope/tools 2024-11-29T16:34:49,092 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2024-11-29T16:34:49,095 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2024-11-29T16:34:49,097 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2024-11-29T16:34:49,099 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2024-11-29T16:34:49,102 creating build/lib/evalscope/third_party 2024-11-29T16:34:49,103 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2024-11-29T16:34:49,105 creating build/lib/evalscope/backend 2024-11-29T16:34:49,106 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2024-11-29T16:34:49,108 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2024-11-29T16:34:49,110 creating build/lib/evalscope/models/api 2024-11-29T16:34:49,111 copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api 2024-11-29T16:34:49,113 copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api 2024-11-29T16:34:49,116 creating build/lib/evalscope/models/custom 2024-11-29T16:34:49,117 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2024-11-29T16:34:49,119 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2024-11-29T16:34:49,121 creating build/lib/evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:49,123 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:49,125 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:49,128 creating build/lib/evalscope/perf/utils 2024-11-29T16:34:49,129 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,131 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,133 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,135 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,137 copying evalscope/perf/utils/chat_service.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,139 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,141 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2024-11-29T16:34:49,144 creating build/lib/evalscope/perf/plugin 2024-11-29T16:34:49,145 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2024-11-29T16:34:49,147 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2024-11-29T16:34:49,150 creating build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,151 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,153 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,155 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,157 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,160 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2024-11-29T16:34:49,162 creating build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,163 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,165 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,167 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,169 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,170 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,172 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,174 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,175 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2024-11-29T16:34:49,178 creating build/lib/evalscope/benchmarks/general_qa 2024-11-29T16:34:49,179 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2024-11-29T16:34:49,181 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2024-11-29T16:34:49,183 creating build/lib/evalscope/benchmarks/arc 2024-11-29T16:34:49,184 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2024-11-29T16:34:49,187 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2024-11-29T16:34:49,188 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2024-11-29T16:34:49,191 creating build/lib/evalscope/benchmarks/ceval 2024-11-29T16:34:49,192 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2024-11-29T16:34:49,194 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2024-11-29T16:34:49,196 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2024-11-29T16:34:49,199 creating build/lib/evalscope/benchmarks/truthful_qa 2024-11-29T16:34:49,200 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-11-29T16:34:49,203 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-11-29T16:34:49,205 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-11-29T16:34:49,207 creating build/lib/evalscope/benchmarks/competition_math 2024-11-29T16:34:49,209 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2024-11-29T16:34:49,211 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2024-11-29T16:34:49,213 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2024-11-29T16:34:49,216 creating build/lib/evalscope/benchmarks/gsm8k 2024-11-29T16:34:49,217 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2024-11-29T16:34:49,219 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2024-11-29T16:34:49,221 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2024-11-29T16:34:49,224 creating build/lib/evalscope/benchmarks/humaneval 2024-11-29T16:34:49,226 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2024-11-29T16:34:49,227 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2024-11-29T16:34:49,229 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2024-11-29T16:34:49,232 creating build/lib/evalscope/benchmarks/mmlu 2024-11-29T16:34:49,233 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2024-11-29T16:34:49,235 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2024-11-29T16:34:49,237 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2024-11-29T16:34:49,240 creating build/lib/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:49,241 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:49,243 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:49,245 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:49,247 creating build/lib/evalscope/benchmarks/race 2024-11-29T16:34:49,249 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2024-11-29T16:34:49,251 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2024-11-29T16:34:49,253 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2024-11-29T16:34:49,255 creating build/lib/evalscope/benchmarks/hellaswag 2024-11-29T16:34:49,256 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2024-11-29T16:34:49,259 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2024-11-29T16:34:49,260 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2024-11-29T16:34:49,263 creating build/lib/evalscope/benchmarks/cmmlu 2024-11-29T16:34:49,264 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2024-11-29T16:34:49,266 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2024-11-29T16:34:49,268 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2024-11-29T16:34:49,271 creating build/lib/evalscope/benchmarks/bbh 2024-11-29T16:34:49,272 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2024-11-29T16:34:49,275 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2024-11-29T16:34:49,277 creating build/lib/evalscope/evaluator/reviewer 2024-11-29T16:34:49,278 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2024-11-29T16:34:49,280 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2024-11-29T16:34:49,283 creating build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,284 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,285 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,288 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,289 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,291 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:49,294 creating build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:49,295 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:49,298 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:49,300 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:49,301 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:49,304 creating build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:49,305 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:49,308 creating build/lib/evalscope/third_party/longbench_write/tools 2024-11-29T16:34:49,309 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-11-29T16:34:49,311 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-11-29T16:34:49,313 creating build/lib/evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:49,314 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:49,316 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:49,318 creating build/lib/evalscope/backend/rag_eval 2024-11-29T16:34:49,319 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2024-11-29T16:34:49,322 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2024-11-29T16:34:49,324 creating build/lib/evalscope/backend/opencompass 2024-11-29T16:34:49,325 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2024-11-29T16:34:49,327 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2024-11-29T16:34:49,329 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2024-11-29T16:34:49,332 creating build/lib/evalscope/backend/vlm_eval_kit 2024-11-29T16:34:49,333 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-11-29T16:34:49,335 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-11-29T16:34:49,336 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-11-29T16:34:49,339 creating build/lib/evalscope/backend/rag_eval/ragas 2024-11-29T16:34:49,340 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-11-29T16:34:49,342 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-11-29T16:34:49,344 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-11-29T16:34:49,346 creating build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,347 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,349 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,352 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,354 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,355 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2024-11-29T16:34:49,358 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:49,359 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:49,361 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:49,363 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:49,365 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:49,368 creating build/lib/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:49,369 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:49,371 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:49,373 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:49,375 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:49,377 creating build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:49,378 copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:49,380 copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:49,382 copying evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:49,385 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:49,386 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:49,388 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:49,390 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:49,393 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:49,394 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:49,396 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:49,398 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:49,400 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:49,403 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,404 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,407 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,408 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,411 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,413 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,415 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,417 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,419 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:49,422 creating build/lib/evalscope/backend/opencompass/tasks 2024-11-29T16:34:49,423 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2024-11-29T16:34:49,425 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2024-11-29T16:34:49,428 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2024-11-29T16:34:49,430 creating build/lib/tests/perf 2024-11-29T16:34:49,431 copying tests/perf/test_perf.py -> build/lib/tests/perf 2024-11-29T16:34:49,434 copying tests/perf/__init__.py -> build/lib/tests/perf 2024-11-29T16:34:49,436 creating build/lib/tests/cli 2024-11-29T16:34:49,438 copying tests/cli/test_run.py -> build/lib/tests/cli 2024-11-29T16:34:49,439 copying tests/cli/__init__.py -> build/lib/tests/cli 2024-11-29T16:34:49,442 creating build/lib/tests/swift 2024-11-29T16:34:49,443 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2024-11-29T16:34:49,446 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2024-11-29T16:34:49,448 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2024-11-29T16:34:49,450 copying tests/swift/__init__.py -> build/lib/tests/swift 2024-11-29T16:34:49,452 creating build/lib/tests/rag 2024-11-29T16:34:49,454 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2024-11-29T16:34:49,455 copying tests/rag/__init__.py -> build/lib/tests/rag 2024-11-29T16:34:49,457 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2024-11-29T16:34:49,459 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2024-11-29T16:34:49,462 creating build/lib/tests/vlm 2024-11-29T16:34:49,463 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2024-11-29T16:34:49,465 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2024-11-29T16:34:49,467 running egg_info 2024-11-29T16:34:49,495 writing evalscope.egg-info/PKG-INFO 2024-11-29T16:34:49,522 writing dependency_links to evalscope.egg-info/dependency_links.txt 2024-11-29T16:34:49,524 writing entry points to evalscope.egg-info/entry_points.txt 2024-11-29T16:34:49,538 writing requirements to evalscope.egg-info/requires.txt 2024-11-29T16:34:49,539 writing top-level names to evalscope.egg-info/top_level.txt 2024-11-29T16:34:49,622 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2024-11-29T16:34:49,642 reading manifest template 'MANIFEST.in' 2024-11-29T16:34:49,760 adding license file 'LICENSE' 2024-11-29T16:34:49,778 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2024-11-29T16:34:49,782 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2024-11-29T16:34:49,782 !! 2024-11-29T16:34:49,784 ******************************************************************************** 2024-11-29T16:34:49,785 ############################ 2024-11-29T16:34:49,785 # Package would be ignored # 2024-11-29T16:34:49,786 ############################ 2024-11-29T16:34:49,787 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2024-11-29T16:34:49,787 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,789 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,789 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2024-11-29T16:34:49,790 to the `packages` configuration field. 2024-11-29T16:34:49,791 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,792 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,792 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,797 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,798 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,799 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2024-11-29T16:34:49,799 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2024-11-29T16:34:49,800 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,801 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,801 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,803 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,804 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,805 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,805 even if it does not contain any `.py` files. 2024-11-29T16:34:49,805 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,806 directory, all directories are treated like packages. 2024-11-29T16:34:49,806 ******************************************************************************** 2024-11-29T16:34:49,807 !! 2024-11-29T16:34:49,807 check.warn(importable) 2024-11-29T16:34:49,808 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2024-11-29T16:34:49,808 !! 2024-11-29T16:34:49,809 ******************************************************************************** 2024-11-29T16:34:49,810 ############################ 2024-11-29T16:34:49,810 # Package would be ignored # 2024-11-29T16:34:49,811 ############################ 2024-11-29T16:34:49,811 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2024-11-29T16:34:49,811 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,812 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,813 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2024-11-29T16:34:49,813 to the `packages` configuration field. 2024-11-29T16:34:49,814 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,815 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,815 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,816 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,817 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,818 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2024-11-29T16:34:49,819 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2024-11-29T16:34:49,819 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,820 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,820 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,821 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,822 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,823 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,824 even if it does not contain any `.py` files. 2024-11-29T16:34:49,824 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,825 directory, all directories are treated like packages. 2024-11-29T16:34:49,825 ******************************************************************************** 2024-11-29T16:34:49,826 !! 2024-11-29T16:34:49,827 check.warn(importable) 2024-11-29T16:34:49,827 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is absent from the `packages` configuration. 2024-11-29T16:34:49,828 !! 2024-11-29T16:34:49,829 ******************************************************************************** 2024-11-29T16:34:49,829 ############################ 2024-11-29T16:34:49,830 # Package would be ignored # 2024-11-29T16:34:49,830 ############################ 2024-11-29T16:34:49,830 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' as an importable package[^1], 2024-11-29T16:34:49,831 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,831 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,832 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is explicitly added 2024-11-29T16:34:49,832 to the `packages` configuration field. 2024-11-29T16:34:49,833 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,833 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,834 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,834 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,835 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,836 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' to be distributed and are 2024-11-29T16:34:49,836 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' via 2024-11-29T16:34:49,837 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,837 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,838 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,839 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,839 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,841 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,842 even if it does not contain any `.py` files. 2024-11-29T16:34:49,842 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,843 directory, all directories are treated like packages. 2024-11-29T16:34:49,843 ******************************************************************************** 2024-11-29T16:34:49,844 !! 2024-11-29T16:34:49,844 check.warn(importable) 2024-11-29T16:34:49,845 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is absent from the `packages` configuration. 2024-11-29T16:34:49,845 !! 2024-11-29T16:34:49,846 ******************************************************************************** 2024-11-29T16:34:49,847 ############################ 2024-11-29T16:34:49,847 # Package would be ignored # 2024-11-29T16:34:49,847 ############################ 2024-11-29T16:34:49,848 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' as an importable package[^1], 2024-11-29T16:34:49,849 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,850 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,850 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is explicitly added 2024-11-29T16:34:49,851 to the `packages` configuration field. 2024-11-29T16:34:49,852 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,853 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,854 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,854 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,855 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,856 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' to be distributed and are 2024-11-29T16:34:49,856 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' via 2024-11-29T16:34:49,856 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,857 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,857 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,858 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,858 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,859 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,860 even if it does not contain any `.py` files. 2024-11-29T16:34:49,860 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,861 directory, all directories are treated like packages. 2024-11-29T16:34:49,861 ******************************************************************************** 2024-11-29T16:34:49,862 !! 2024-11-29T16:34:49,862 check.warn(importable) 2024-11-29T16:34:49,863 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is absent from the `packages` configuration. 2024-11-29T16:34:49,864 !! 2024-11-29T16:34:49,865 ******************************************************************************** 2024-11-29T16:34:49,865 ############################ 2024-11-29T16:34:49,866 # Package would be ignored # 2024-11-29T16:34:49,866 ############################ 2024-11-29T16:34:49,867 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' as an importable package[^1], 2024-11-29T16:34:49,867 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,868 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,869 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is explicitly added 2024-11-29T16:34:49,869 to the `packages` configuration field. 2024-11-29T16:34:49,870 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,870 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,871 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,872 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,873 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,874 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' to be distributed and are 2024-11-29T16:34:49,874 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' via 2024-11-29T16:34:49,875 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,877 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,877 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,879 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,880 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,881 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,882 even if it does not contain any `.py` files. 2024-11-29T16:34:49,882 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,883 directory, all directories are treated like packages. 2024-11-29T16:34:49,883 ******************************************************************************** 2024-11-29T16:34:49,884 !! 2024-11-29T16:34:49,885 check.warn(importable) 2024-11-29T16:34:49,885 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is absent from the `packages` configuration. 2024-11-29T16:34:49,886 !! 2024-11-29T16:34:49,887 ******************************************************************************** 2024-11-29T16:34:49,887 ############################ 2024-11-29T16:34:49,888 # Package would be ignored # 2024-11-29T16:34:49,888 ############################ 2024-11-29T16:34:49,889 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' as an importable package[^1], 2024-11-29T16:34:49,890 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,891 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,891 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is explicitly added 2024-11-29T16:34:49,892 to the `packages` configuration field. 2024-11-29T16:34:49,893 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,893 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,894 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,895 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,896 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,897 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' to be distributed and are 2024-11-29T16:34:49,898 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' via 2024-11-29T16:34:49,899 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,899 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,900 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,901 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,902 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,904 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,904 even if it does not contain any `.py` files. 2024-11-29T16:34:49,905 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,906 directory, all directories are treated like packages. 2024-11-29T16:34:49,906 ******************************************************************************** 2024-11-29T16:34:49,907 !! 2024-11-29T16:34:49,908 check.warn(importable) 2024-11-29T16:34:49,909 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is absent from the `packages` configuration. 2024-11-29T16:34:49,909 !! 2024-11-29T16:34:49,911 ******************************************************************************** 2024-11-29T16:34:49,911 ############################ 2024-11-29T16:34:49,912 # Package would be ignored # 2024-11-29T16:34:49,913 ############################ 2024-11-29T16:34:49,913 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' as an importable package[^1], 2024-11-29T16:34:49,914 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,915 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,915 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is explicitly added 2024-11-29T16:34:49,916 to the `packages` configuration field. 2024-11-29T16:34:49,916 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,917 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,917 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,918 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,919 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,920 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' to be distributed and are 2024-11-29T16:34:49,921 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' via 2024-11-29T16:34:49,922 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,922 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,923 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,924 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,925 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,926 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,927 even if it does not contain any `.py` files. 2024-11-29T16:34:49,928 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,928 directory, all directories are treated like packages. 2024-11-29T16:34:49,929 ******************************************************************************** 2024-11-29T16:34:49,930 !! 2024-11-29T16:34:49,931 check.warn(importable) 2024-11-29T16:34:49,931 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is absent from the `packages` configuration. 2024-11-29T16:34:49,931 !! 2024-11-29T16:34:49,933 ******************************************************************************** 2024-11-29T16:34:49,933 ############################ 2024-11-29T16:34:49,934 # Package would be ignored # 2024-11-29T16:34:49,935 ############################ 2024-11-29T16:34:49,935 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' as an importable package[^1], 2024-11-29T16:34:49,936 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,937 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,938 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is explicitly added 2024-11-29T16:34:49,938 to the `packages` configuration field. 2024-11-29T16:34:49,939 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,940 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,941 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,943 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,944 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,945 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' to be distributed and are 2024-11-29T16:34:49,946 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' via 2024-11-29T16:34:49,946 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,947 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,947 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,948 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,950 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,952 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,953 even if it does not contain any `.py` files. 2024-11-29T16:34:49,953 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,954 directory, all directories are treated like packages. 2024-11-29T16:34:49,955 ******************************************************************************** 2024-11-29T16:34:49,956 !! 2024-11-29T16:34:49,957 check.warn(importable) 2024-11-29T16:34:49,957 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-11-29T16:34:49,958 !! 2024-11-29T16:34:49,959 ******************************************************************************** 2024-11-29T16:34:49,960 ############################ 2024-11-29T16:34:49,960 # Package would be ignored # 2024-11-29T16:34:49,961 ############################ 2024-11-29T16:34:49,961 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' as an importable package[^1], 2024-11-29T16:34:49,962 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,963 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,963 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is explicitly added 2024-11-29T16:34:49,964 to the `packages` configuration field. 2024-11-29T16:34:49,965 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,965 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,966 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,967 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,968 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,969 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' to be distributed and are 2024-11-29T16:34:49,970 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' via 2024-11-29T16:34:49,970 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,971 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,971 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,973 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,974 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,975 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,975 even if it does not contain any `.py` files. 2024-11-29T16:34:49,976 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,976 directory, all directories are treated like packages. 2024-11-29T16:34:49,977 ******************************************************************************** 2024-11-29T16:34:49,978 !! 2024-11-29T16:34:49,978 check.warn(importable) 2024-11-29T16:34:49,978 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is absent from the `packages` configuration. 2024-11-29T16:34:49,979 !! 2024-11-29T16:34:49,980 ******************************************************************************** 2024-11-29T16:34:49,980 ############################ 2024-11-29T16:34:49,981 # Package would be ignored # 2024-11-29T16:34:49,981 ############################ 2024-11-29T16:34:49,982 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' as an importable package[^1], 2024-11-29T16:34:49,982 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:49,983 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:49,984 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is explicitly added 2024-11-29T16:34:49,984 to the `packages` configuration field. 2024-11-29T16:34:49,985 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:49,986 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:49,987 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:49,988 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:49,989 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:49,990 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' to be distributed and are 2024-11-29T16:34:49,990 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' via 2024-11-29T16:34:49,991 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:49,991 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:49,992 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:49,993 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:49,994 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:49,995 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:49,996 even if it does not contain any `.py` files. 2024-11-29T16:34:49,997 On the other hand, currently there is no concept of package data 2024-11-29T16:34:49,997 directory, all directories are treated like packages. 2024-11-29T16:34:49,998 ******************************************************************************** 2024-11-29T16:34:49,999 !! 2024-11-29T16:34:49,999 check.warn(importable) 2024-11-29T16:34:50,000 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is absent from the `packages` configuration. 2024-11-29T16:34:50,000 !! 2024-11-29T16:34:50,001 ******************************************************************************** 2024-11-29T16:34:50,002 ############################ 2024-11-29T16:34:50,002 # Package would be ignored # 2024-11-29T16:34:50,003 ############################ 2024-11-29T16:34:50,003 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' as an importable package[^1], 2024-11-29T16:34:50,003 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,004 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,005 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is explicitly added 2024-11-29T16:34:50,005 to the `packages` configuration field. 2024-11-29T16:34:50,006 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,007 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,007 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,008 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,009 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,010 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' to be distributed and are 2024-11-29T16:34:50,010 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' via 2024-11-29T16:34:50,011 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,011 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,012 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,013 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,014 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,015 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,016 even if it does not contain any `.py` files. 2024-11-29T16:34:50,016 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,017 directory, all directories are treated like packages. 2024-11-29T16:34:50,017 ******************************************************************************** 2024-11-29T16:34:50,018 !! 2024-11-29T16:34:50,019 check.warn(importable) 2024-11-29T16:34:50,019 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is absent from the `packages` configuration. 2024-11-29T16:34:50,020 !! 2024-11-29T16:34:50,021 ******************************************************************************** 2024-11-29T16:34:50,021 ############################ 2024-11-29T16:34:50,022 # Package would be ignored # 2024-11-29T16:34:50,022 ############################ 2024-11-29T16:34:50,023 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' as an importable package[^1], 2024-11-29T16:34:50,023 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,024 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,025 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is explicitly added 2024-11-29T16:34:50,025 to the `packages` configuration field. 2024-11-29T16:34:50,027 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,027 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,027 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,028 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,029 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,030 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' to be distributed and are 2024-11-29T16:34:50,030 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' via 2024-11-29T16:34:50,031 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,031 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,032 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,033 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,034 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,035 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,035 even if it does not contain any `.py` files. 2024-11-29T16:34:50,036 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,036 directory, all directories are treated like packages. 2024-11-29T16:34:50,037 ******************************************************************************** 2024-11-29T16:34:50,038 !! 2024-11-29T16:34:50,039 check.warn(importable) 2024-11-29T16:34:50,039 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is absent from the `packages` configuration. 2024-11-29T16:34:50,040 !! 2024-11-29T16:34:50,041 ******************************************************************************** 2024-11-29T16:34:50,042 ############################ 2024-11-29T16:34:50,042 # Package would be ignored # 2024-11-29T16:34:50,042 ############################ 2024-11-29T16:34:50,043 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' as an importable package[^1], 2024-11-29T16:34:50,043 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,045 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,048 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is explicitly added 2024-11-29T16:34:50,048 to the `packages` configuration field. 2024-11-29T16:34:50,049 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,050 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,050 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,051 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,052 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,053 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' to be distributed and are 2024-11-29T16:34:50,054 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' via 2024-11-29T16:34:50,054 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,055 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,055 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,057 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,058 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,059 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,059 even if it does not contain any `.py` files. 2024-11-29T16:34:50,060 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,060 directory, all directories are treated like packages. 2024-11-29T16:34:50,061 ******************************************************************************** 2024-11-29T16:34:50,062 !! 2024-11-29T16:34:50,062 check.warn(importable) 2024-11-29T16:34:50,062 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is absent from the `packages` configuration. 2024-11-29T16:34:50,063 !! 2024-11-29T16:34:50,064 ******************************************************************************** 2024-11-29T16:34:50,064 ############################ 2024-11-29T16:34:50,065 # Package would be ignored # 2024-11-29T16:34:50,065 ############################ 2024-11-29T16:34:50,066 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' as an importable package[^1], 2024-11-29T16:34:50,066 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,067 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,068 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is explicitly added 2024-11-29T16:34:50,068 to the `packages` configuration field. 2024-11-29T16:34:50,069 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,070 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,070 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,071 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,072 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,073 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' to be distributed and are 2024-11-29T16:34:50,074 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' via 2024-11-29T16:34:50,074 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,075 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,075 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,076 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,077 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,079 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,080 even if it does not contain any `.py` files. 2024-11-29T16:34:50,080 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,085 directory, all directories are treated like packages. 2024-11-29T16:34:50,091 ******************************************************************************** 2024-11-29T16:34:50,093 !! 2024-11-29T16:34:50,094 check.warn(importable) 2024-11-29T16:34:50,094 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is absent from the `packages` configuration. 2024-11-29T16:34:50,095 !! 2024-11-29T16:34:50,096 ******************************************************************************** 2024-11-29T16:34:50,096 ############################ 2024-11-29T16:34:50,097 # Package would be ignored # 2024-11-29T16:34:50,097 ############################ 2024-11-29T16:34:50,098 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' as an importable package[^1], 2024-11-29T16:34:50,098 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,099 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,099 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is explicitly added 2024-11-29T16:34:50,100 to the `packages` configuration field. 2024-11-29T16:34:50,100 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,101 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,101 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,102 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,103 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,104 If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' to be distributed and are 2024-11-29T16:34:50,104 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' via 2024-11-29T16:34:50,105 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,105 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,106 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,107 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,108 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,109 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,110 even if it does not contain any `.py` files. 2024-11-29T16:34:50,110 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,111 directory, all directories are treated like packages. 2024-11-29T16:34:50,112 ******************************************************************************** 2024-11-29T16:34:50,113 !! 2024-11-29T16:34:50,113 check.warn(importable) 2024-11-29T16:34:50,114 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2024-11-29T16:34:50,115 !! 2024-11-29T16:34:50,116 ******************************************************************************** 2024-11-29T16:34:50,116 ############################ 2024-11-29T16:34:50,117 # Package would be ignored # 2024-11-29T16:34:50,117 ############################ 2024-11-29T16:34:50,118 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2024-11-29T16:34:50,119 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,120 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,121 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2024-11-29T16:34:50,122 to the `packages` configuration field. 2024-11-29T16:34:50,123 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,123 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,124 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,125 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,126 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,126 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2024-11-29T16:34:50,127 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2024-11-29T16:34:50,127 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,128 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,128 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,129 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,130 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,132 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,132 even if it does not contain any `.py` files. 2024-11-29T16:34:50,133 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,133 directory, all directories are treated like packages. 2024-11-29T16:34:50,134 ******************************************************************************** 2024-11-29T16:34:50,135 !! 2024-11-29T16:34:50,136 check.warn(importable) 2024-11-29T16:34:50,136 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2024-11-29T16:34:50,137 !! 2024-11-29T16:34:50,138 ******************************************************************************** 2024-11-29T16:34:50,139 ############################ 2024-11-29T16:34:50,139 # Package would be ignored # 2024-11-29T16:34:50,140 ############################ 2024-11-29T16:34:50,141 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2024-11-29T16:34:50,141 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,142 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,143 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2024-11-29T16:34:50,144 to the `packages` configuration field. 2024-11-29T16:34:50,145 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,146 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,146 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,147 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,148 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,150 If you don't want 'evalscope.metrics.resources' to be distributed and are 2024-11-29T16:34:50,152 already explicitly excluding 'evalscope.metrics.resources' via 2024-11-29T16:34:50,153 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,155 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,156 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,157 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,159 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,161 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,161 even if it does not contain any `.py` files. 2024-11-29T16:34:50,162 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,163 directory, all directories are treated like packages. 2024-11-29T16:34:50,163 ******************************************************************************** 2024-11-29T16:34:50,164 !! 2024-11-29T16:34:50,164 check.warn(importable) 2024-11-29T16:34:50,165 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2024-11-29T16:34:50,165 !! 2024-11-29T16:34:50,166 ******************************************************************************** 2024-11-29T16:34:50,167 ############################ 2024-11-29T16:34:50,167 # Package would be ignored # 2024-11-29T16:34:50,168 ############################ 2024-11-29T16:34:50,168 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2024-11-29T16:34:50,168 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,169 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,170 package, please make sure that 'evalscope.registry.config' is explicitly added 2024-11-29T16:34:50,170 to the `packages` configuration field. 2024-11-29T16:34:50,171 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,172 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,172 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,173 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,174 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,175 If you don't want 'evalscope.registry.config' to be distributed and are 2024-11-29T16:34:50,176 already explicitly excluding 'evalscope.registry.config' via 2024-11-29T16:34:50,176 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,177 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,177 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,178 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,179 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,181 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,182 even if it does not contain any `.py` files. 2024-11-29T16:34:50,182 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,183 directory, all directories are treated like packages. 2024-11-29T16:34:50,183 ******************************************************************************** 2024-11-29T16:34:50,184 !! 2024-11-29T16:34:50,185 check.warn(importable) 2024-11-29T16:34:50,185 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2024-11-29T16:34:50,186 !! 2024-11-29T16:34:50,187 ******************************************************************************** 2024-11-29T16:34:50,188 ############################ 2024-11-29T16:34:50,188 # Package would be ignored # 2024-11-29T16:34:50,189 ############################ 2024-11-29T16:34:50,189 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2024-11-29T16:34:50,190 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,191 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,191 package, please make sure that 'evalscope.registry.data' is explicitly added 2024-11-29T16:34:50,192 to the `packages` configuration field. 2024-11-29T16:34:50,193 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,193 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,194 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,195 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,195 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,196 If you don't want 'evalscope.registry.data' to be distributed and are 2024-11-29T16:34:50,197 already explicitly excluding 'evalscope.registry.data' via 2024-11-29T16:34:50,197 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,198 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,198 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,199 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,200 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,202 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,202 even if it does not contain any `.py` files. 2024-11-29T16:34:50,203 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,203 directory, all directories are treated like packages. 2024-11-29T16:34:50,204 ******************************************************************************** 2024-11-29T16:34:50,205 !! 2024-11-29T16:34:50,205 check.warn(importable) 2024-11-29T16:34:50,206 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2024-11-29T16:34:50,206 !! 2024-11-29T16:34:50,207 ******************************************************************************** 2024-11-29T16:34:50,208 ############################ 2024-11-29T16:34:50,209 # Package would be ignored # 2024-11-29T16:34:50,209 ############################ 2024-11-29T16:34:50,210 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2024-11-29T16:34:50,210 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,211 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,212 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2024-11-29T16:34:50,213 to the `packages` configuration field. 2024-11-29T16:34:50,214 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,214 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,215 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,216 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,217 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,218 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2024-11-29T16:34:50,219 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2024-11-29T16:34:50,219 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,220 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,221 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,222 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,223 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,224 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,225 even if it does not contain any `.py` files. 2024-11-29T16:34:50,225 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,226 directory, all directories are treated like packages. 2024-11-29T16:34:50,226 ******************************************************************************** 2024-11-29T16:34:50,227 !! 2024-11-29T16:34:50,227 check.warn(importable) 2024-11-29T16:34:50,228 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2024-11-29T16:34:50,228 !! 2024-11-29T16:34:50,229 ******************************************************************************** 2024-11-29T16:34:50,230 ############################ 2024-11-29T16:34:50,230 # Package would be ignored # 2024-11-29T16:34:50,231 ############################ 2024-11-29T16:34:50,231 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2024-11-29T16:34:50,232 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,233 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,233 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2024-11-29T16:34:50,234 to the `packages` configuration field. 2024-11-29T16:34:50,235 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,236 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,236 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,237 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,238 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,239 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2024-11-29T16:34:50,240 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2024-11-29T16:34:50,240 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,241 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,241 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,242 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,243 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,245 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,246 even if it does not contain any `.py` files. 2024-11-29T16:34:50,246 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,247 directory, all directories are treated like packages. 2024-11-29T16:34:50,247 ******************************************************************************** 2024-11-29T16:34:50,249 !! 2024-11-29T16:34:50,249 check.warn(importable) 2024-11-29T16:34:50,250 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2024-11-29T16:34:50,250 !! 2024-11-29T16:34:50,252 ******************************************************************************** 2024-11-29T16:34:50,252 ############################ 2024-11-29T16:34:50,252 # Package would be ignored # 2024-11-29T16:34:50,253 ############################ 2024-11-29T16:34:50,253 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2024-11-29T16:34:50,254 but it is absent from setuptools' `packages` configuration. 2024-11-29T16:34:50,255 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-29T16:34:50,255 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2024-11-29T16:34:50,255 to the `packages` configuration field. 2024-11-29T16:34:50,256 Alternatively, you can also rely on setuptools' discovery methods 2024-11-29T16:34:50,257 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-29T16:34:50,257 instead of `find_packages(...)`/`find:`). 2024-11-29T16:34:50,258 You can read more about "package discovery" on setuptools documentation page: 2024-11-29T16:34:50,259 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-29T16:34:50,260 If you don't want 'evalscope.registry.tasks' to be distributed and are 2024-11-29T16:34:50,261 already explicitly excluding 'evalscope.registry.tasks' via 2024-11-29T16:34:50,261 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-29T16:34:50,262 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-29T16:34:50,262 combination with a more fine grained `package-data` configuration. 2024-11-29T16:34:50,263 You can read more about "package data files" on setuptools documentation page: 2024-11-29T16:34:50,264 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-29T16:34:50,266 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-29T16:34:50,266 even if it does not contain any `.py` files. 2024-11-29T16:34:50,267 On the other hand, currently there is no concept of package data 2024-11-29T16:34:50,267 directory, all directories are treated like packages. 2024-11-29T16:34:50,268 ******************************************************************************** 2024-11-29T16:34:50,269 !! 2024-11-29T16:34:50,270 check.warn(importable) 2024-11-29T16:34:50,270 creating build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,271 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,272 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,272 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,273 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,273 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,274 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,274 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,275 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,276 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,276 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,277 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2024-11-29T16:34:50,277 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,278 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,278 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,279 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,280 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,280 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,281 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,281 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,282 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,282 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,283 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,283 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,284 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,284 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,285 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,285 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,286 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,286 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,287 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,287 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,288 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,288 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,289 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,289 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,290 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,291 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,291 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,292 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,292 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,293 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,294 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,294 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,294 creating build/lib/evalscope/registry/config 2024-11-29T16:34:50,295 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2024-11-29T16:34:50,295 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2024-11-29T16:34:50,296 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2024-11-29T16:34:50,296 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2024-11-29T16:34:50,297 creating build/lib/evalscope/registry/data 2024-11-29T16:34:50,297 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2024-11-29T16:34:50,298 creating build/lib/evalscope/registry/data/prompt_template 2024-11-29T16:34:50,298 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-11-29T16:34:50,299 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-11-29T16:34:50,299 creating build/lib/evalscope/registry/data/qa_browser 2024-11-29T16:34:50,300 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2024-11-29T16:34:50,300 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2024-11-29T16:34:50,301 creating build/lib/evalscope/metrics/resources 2024-11-29T16:34:50,305 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2024-11-29T16:34:50,306 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2024-11-29T16:34:50,306 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2024-11-29T16:34:50,307 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2024-11-29T16:34:50,307 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,308 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2024-11-29T16:34:50,308 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,309 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:50,309 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:50,310 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2024-11-29T16:34:50,310 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:50,311 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:50,312 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:50,312 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2024-11-29T16:34:50,313 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-11-29T16:34:50,313 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-11-29T16:34:50,314 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:50,314 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:50,315 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:50,316 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-11-29T16:34:50,316 copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-11-29T16:34:50,316 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-11-29T16:34:50,317 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-11-29T16:34:50,317 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:50,318 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:50,318 copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:50,319 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-11-29T16:34:50,319 copying evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-11-29T16:34:50,320 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:50,320 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:50,321 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:50,321 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:50,322 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:50,323 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:50,323 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:50,324 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-11-29T16:34:50,324 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-11-29T16:34:50,325 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-11-29T16:34:50,325 copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-11-29T16:34:50,326 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-11-29T16:34:50,327 copying evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-11-29T16:34:50,327 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:50,328 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:50,328 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:50,329 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-11-29T16:34:50,329 copying evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-11-29T16:34:50,330 creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-11-29T16:34:50,330 copying evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-11-29T16:34:50,331 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:50,331 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:50,332 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:50,352 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-11-29T16:34:50,352 !! 2024-11-29T16:34:50,353 ******************************************************************************** 2024-11-29T16:34:50,354 Please avoid running ``setup.py`` directly. 2024-11-29T16:34:50,355 Instead, use pypa/build, pypa/installer or other 2024-11-29T16:34:50,355 standards-based tools. 2024-11-29T16:34:50,356 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-11-29T16:34:50,357 ******************************************************************************** 2024-11-29T16:34:50,358 !! 2024-11-29T16:34:50,359 self.initialize_options() 2024-11-29T16:34:50,381 installing to build/bdist.linux-armv7l/wheel 2024-11-29T16:34:50,381 running install 2024-11-29T16:34:50,407 running install_lib 2024-11-29T16:34:50,445 creating build/bdist.linux-armv7l/wheel 2024-11-29T16:34:50,448 creating build/bdist.linux-armv7l/wheel/evalscope 2024-11-29T16:34:50,450 creating build/bdist.linux-armv7l/wheel/evalscope/models 2024-11-29T16:34:50,452 copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,455 creating build/bdist.linux-armv7l/wheel/evalscope/models/api 2024-11-29T16:34:50,456 copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-11-29T16:34:50,459 copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-11-29T16:34:50,462 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2024-11-29T16:34:50,464 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-11-29T16:34:50,466 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-11-29T16:34:50,468 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,471 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,474 copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,476 copying build/lib/evalscope/models/template.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,480 copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-11-29T16:34:50,484 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2024-11-29T16:34:50,486 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2024-11-29T16:34:50,488 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2024-11-29T16:34:50,489 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-11-29T16:34:50,492 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-11-29T16:34:50,496 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2024-11-29T16:34:50,497 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-11-29T16:34:50,521 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-11-29T16:34:50,522 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2024-11-29T16:34:50,526 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2024-11-29T16:34:50,527 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,529 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,531 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,532 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,534 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,536 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,537 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,539 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,541 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,543 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,545 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-11-29T16:34:50,547 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2024-11-29T16:34:50,548 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-11-29T16:34:50,550 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-11-29T16:34:50,552 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-11-29T16:34:50,554 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-11-29T16:34:50,556 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2024-11-29T16:34:50,558 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,560 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,563 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2024-11-29T16:34:50,564 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-11-29T16:34:50,566 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2024-11-29T16:34:50,567 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-11-29T16:34:50,588 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-11-29T16:34:50,597 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-11-29T16:34:50,599 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-11-29T16:34:50,602 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:50,603 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:50,606 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-11-29T16:34:50,607 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-11-29T16:34:50,610 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-11-29T16:34:50,612 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2024-11-29T16:34:50,613 copying build/lib/evalscope/utils/task_cfg_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,615 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,617 copying build/lib/evalscope/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,619 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,621 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,623 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,625 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-11-29T16:34:50,628 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2024-11-29T16:34:50,629 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-11-29T16:34:50,631 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2024-11-29T16:34:50,632 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,635 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,637 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,639 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,641 copying build/lib/evalscope/perf/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,643 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,645 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-11-29T16:34:50,648 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2024-11-29T16:34:50,649 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-11-29T16:34:50,651 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2024-11-29T16:34:50,653 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-11-29T16:34:50,655 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-11-29T16:34:50,656 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-11-29T16:34:50,658 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-11-29T16:34:50,660 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-11-29T16:34:50,662 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-11-29T16:34:50,665 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2024-11-29T16:34:50,666 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,668 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,670 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,672 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,674 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,676 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,678 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,680 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-11-29T16:34:50,682 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-11-29T16:34:50,683 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-11-29T16:34:50,686 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-11-29T16:34:50,688 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-11-29T16:34:50,690 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,692 copying build/lib/evalscope/cache.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,694 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2024-11-29T16:34:50,695 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-11-29T16:34:50,697 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-11-29T16:34:50,699 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-11-29T16:34:50,701 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-11-29T16:34:50,702 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-11-29T16:34:50,704 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,708 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2024-11-29T16:34:50,709 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2024-11-29T16:34:50,711 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-11-29T16:34:50,713 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-11-29T16:34:50,715 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2024-11-29T16:34:50,716 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-11-29T16:34:50,719 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-11-29T16:34:50,721 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-11-29T16:34:50,723 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2024-11-29T16:34:50,724 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-11-29T16:34:50,726 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-11-29T16:34:50,728 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-11-29T16:34:50,731 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-11-29T16:34:50,732 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-11-29T16:34:50,735 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2024-11-29T16:34:50,736 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-11-29T16:34:50,739 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-11-29T16:34:50,741 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-11-29T16:34:50,744 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2024-11-29T16:34:50,745 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-11-29T16:34:50,747 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-11-29T16:34:50,749 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-11-29T16:34:50,751 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-11-29T16:34:50,754 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2024-11-29T16:34:50,755 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-11-29T16:34:50,758 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-11-29T16:34:50,759 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-11-29T16:34:50,762 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2024-11-29T16:34:50,763 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-11-29T16:34:50,765 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-11-29T16:34:50,767 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-11-29T16:34:50,769 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2024-11-29T16:34:50,770 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-11-29T16:34:50,772 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-11-29T16:34:50,774 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-11-29T16:34:50,776 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-11-29T16:34:50,779 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,780 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,786 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,788 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,790 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-11-29T16:34:50,792 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2024-11-29T16:34:50,793 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-11-29T16:34:50,796 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-11-29T16:34:50,798 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-11-29T16:34:50,799 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-11-29T16:34:50,802 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2024-11-29T16:34:50,803 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-11-29T16:34:50,805 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-11-29T16:34:50,808 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-11-29T16:34:50,811 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-11-29T16:34:50,813 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,814 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,817 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,819 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,823 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-11-29T16:34:50,825 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2024-11-29T16:34:50,826 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-11-29T16:34:50,831 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,832 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,835 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,837 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,839 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,841 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,843 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,853 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,855 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,856 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,858 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,860 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,862 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,864 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,865 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,868 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,869 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,871 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,873 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,875 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,877 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,880 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,882 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,884 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,886 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,888 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,890 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,892 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-11-29T16:34:50,894 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-11-29T16:34:50,895 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,898 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,900 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2024-11-29T16:34:50,901 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-11-29T16:34:50,904 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2024-11-29T16:34:50,906 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-11-29T16:34:50,907 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-11-29T16:34:50,910 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-11-29T16:34:50,914 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-11-29T16:34:50,916 copying build/lib/evalscope/run_ms.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,921 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2024-11-29T16:34:50,922 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-11-29T16:34:50,925 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-11-29T16:34:50,927 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-11-29T16:34:50,929 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-11-29T16:34:50,931 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-11-29T16:34:50,934 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2024-11-29T16:34:50,935 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2024-11-29T16:34:50,937 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2024-11-29T16:34:50,939 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,942 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,944 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,947 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,948 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,950 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,953 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,956 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,958 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-11-29T16:34:50,960 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,962 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2024-11-29T16:34:50,963 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-11-29T16:34:50,965 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-11-29T16:34:50,967 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,969 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,971 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,973 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-11-29T16:34:50,976 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2024-11-29T16:34:50,977 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,979 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,980 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,984 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,986 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:50,987 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:50,989 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-11-29T16:34:50,991 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,993 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,995 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:50,998 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-11-29T16:34:51,001 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2024-11-29T16:34:51,002 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-11-29T16:34:51,005 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2024-11-29T16:34:51,007 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2024-11-29T16:34:51,008 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:51,010 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:51,012 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:51,013 copying build/lib/evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics 2024-11-29T16:34:51,023 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:51,031 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:51,033 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:51,035 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-11-29T16:34:51,037 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-11-29T16:34:51,039 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2024-11-29T16:34:51,041 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese 2024-11-29T16:34:51,043 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-11-29T16:34:51,044 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor 2024-11-29T16:34:51,047 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:51,048 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:51,050 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer 2024-11-29T16:34:51,053 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:51,054 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:51,056 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness 2024-11-29T16:34:51,059 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-11-29T16:34:51,060 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance 2024-11-29T16:34:51,063 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-11-29T16:34:51,064 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy 2024-11-29T16:34:51,067 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-11-29T16:34:51,068 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness 2024-11-29T16:34:51,071 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:51,072 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:51,074 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer 2024-11-29T16:34:51,077 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-11-29T16:34:51,078 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor 2024-11-29T16:34:51,080 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-11-29T16:34:51,082 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor 2024-11-29T16:34:51,084 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:51,086 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:51,088 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:51,090 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer 2024-11-29T16:34:51,092 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:51,094 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:51,096 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness 2024-11-29T16:34:51,099 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-11-29T16:34:51,100 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision 2024-11-29T16:34:51,103 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-11-29T16:34:51,104 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor 2024-11-29T16:34:51,106 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2024-11-29T16:34:51,108 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-11-29T16:34:51,111 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-11-29T16:34:51,113 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,115 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,116 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,118 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,120 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,122 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-11-29T16:34:51,125 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:51,126 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:51,128 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:51,130 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-11-29T16:34:51,134 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:51,136 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:51,138 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:51,141 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:51,142 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-11-29T16:34:51,145 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:51,148 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:51,150 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:51,152 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-11-29T16:34:51,155 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-11-29T16:34:51,158 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:51,160 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,162 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,165 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,167 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,170 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,172 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,174 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,176 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,178 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-11-29T16:34:51,181 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:51,183 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:51,184 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:51,186 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-11-29T16:34:51,188 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-11-29T16:34:51,190 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-11-29T16:34:51,192 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2024-11-29T16:34:51,194 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2024-11-29T16:34:51,195 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-11-29T16:34:51,197 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-11-29T16:34:51,200 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-11-29T16:34:51,202 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-11-29T16:34:51,204 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-11-29T16:34:51,206 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-11-29T16:34:51,209 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2024-11-29T16:34:51,211 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-11-29T16:34:51,213 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-11-29T16:34:51,215 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-11-29T16:34:51,219 creating build/bdist.linux-armv7l/wheel/tests 2024-11-29T16:34:51,221 creating build/bdist.linux-armv7l/wheel/tests/perf 2024-11-29T16:34:51,223 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-11-29T16:34:51,225 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-11-29T16:34:51,228 creating build/bdist.linux-armv7l/wheel/tests/cli 2024-11-29T16:34:51,229 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-11-29T16:34:51,232 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-11-29T16:34:51,234 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2024-11-29T16:34:51,236 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2024-11-29T16:34:51,239 creating build/bdist.linux-armv7l/wheel/tests/swift 2024-11-29T16:34:51,240 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-11-29T16:34:51,243 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-11-29T16:34:51,246 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-11-29T16:34:51,248 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-11-29T16:34:51,251 creating build/bdist.linux-armv7l/wheel/tests/rag 2024-11-29T16:34:51,252 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-11-29T16:34:51,255 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-11-29T16:34:51,257 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-11-29T16:34:51,259 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-11-29T16:34:51,262 creating build/bdist.linux-armv7l/wheel/tests/vlm 2024-11-29T16:34:51,264 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-11-29T16:34:51,266 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-11-29T16:34:51,268 running install_egg_info 2024-11-29T16:34:51,315 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.7.1-py3.11.egg-info 2024-11-29T16:34:51,330 running install_scripts 2024-11-29T16:34:51,378 creating build/bdist.linux-armv7l/wheel/evalscope-0.7.1.dist-info/WHEEL 2024-11-29T16:34:51,381 creating '/tmp/pip-wheel-3jwxlb7w/evalscope-0.7.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-11-29T16:34:51,383 adding 'evalscope/__init__.py' 2024-11-29T16:34:51,385 adding 'evalscope/cache.py' 2024-11-29T16:34:51,387 adding 'evalscope/config.py' 2024-11-29T16:34:51,388 adding 'evalscope/constants.py' 2024-11-29T16:34:51,391 adding 'evalscope/run.py' 2024-11-29T16:34:51,393 adding 'evalscope/run_arena.py' 2024-11-29T16:34:51,395 adding 'evalscope/run_ms.py' 2024-11-29T16:34:51,396 adding 'evalscope/summarizer.py' 2024-11-29T16:34:51,398 adding 'evalscope/version.py' 2024-11-29T16:34:51,399 adding 'evalscope/backend/__init__.py' 2024-11-29T16:34:51,401 adding 'evalscope/backend/base.py' 2024-11-29T16:34:51,402 adding 'evalscope/backend/opencompass/__init__.py' 2024-11-29T16:34:51,404 adding 'evalscope/backend/opencompass/api_meta_template.py' 2024-11-29T16:34:51,405 adding 'evalscope/backend/opencompass/backend_manager.py' 2024-11-29T16:34:51,407 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2024-11-29T16:34:51,408 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2024-11-29T16:34:51,410 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2024-11-29T16:34:51,411 adding 'evalscope/backend/rag_eval/__init__.py' 2024-11-29T16:34:51,413 adding 'evalscope/backend/rag_eval/backend_manager.py' 2024-11-29T16:34:51,415 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2024-11-29T16:34:51,416 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2024-11-29T16:34:51,417 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2024-11-29T16:34:51,419 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2024-11-29T16:34:51,420 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2024-11-29T16:34:51,422 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2024-11-29T16:34:51,423 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2024-11-29T16:34:51,425 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2024-11-29T16:34:51,427 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2024-11-29T16:34:51,428 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2024-11-29T16:34:51,430 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2024-11-29T16:34:51,431 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2024-11-29T16:34:51,432 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2024-11-29T16:34:51,434 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2024-11-29T16:34:51,436 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2024-11-29T16:34:51,437 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2024-11-29T16:34:51,439 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2024-11-29T16:34:51,440 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2024-11-29T16:34:51,442 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2024-11-29T16:34:51,443 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2024-11-29T16:34:51,445 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2024-11-29T16:34:51,446 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2024-11-29T16:34:51,448 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2024-11-29T16:34:51,449 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2024-11-29T16:34:51,450 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2024-11-29T16:34:51,452 adding 'evalscope/backend/rag_eval/ragas/metrics/__init__.py' 2024-11-29T16:34:51,454 adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py' 2024-11-29T16:34:51,455 adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py' 2024-11-29T16:34:51,457 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2024-11-29T16:34:51,459 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json' 2024-11-29T16:34:51,461 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json' 2024-11-29T16:34:51,462 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json' 2024-11-29T16:34:51,464 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json' 2024-11-29T16:34:51,466 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json' 2024-11-29T16:34:51,467 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json' 2024-11-29T16:34:51,469 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json' 2024-11-29T16:34:51,471 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json' 2024-11-29T16:34:51,472 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-11-29T16:34:51,474 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-11-29T16:34:51,475 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-11-29T16:34:51,477 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-11-29T16:34:51,478 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json' 2024-11-29T16:34:51,480 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json' 2024-11-29T16:34:51,482 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json' 2024-11-29T16:34:51,483 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json' 2024-11-29T16:34:51,484 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json' 2024-11-29T16:34:51,486 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json' 2024-11-29T16:34:51,488 adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json' 2024-11-29T16:34:51,489 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2024-11-29T16:34:51,491 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2024-11-29T16:34:51,492 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2024-11-29T16:34:51,494 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2024-11-29T16:34:51,495 adding 'evalscope/backend/rag_eval/utils/clip.py' 2024-11-29T16:34:51,497 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2024-11-29T16:34:51,498 adding 'evalscope/backend/rag_eval/utils/llm.py' 2024-11-29T16:34:51,500 adding 'evalscope/backend/rag_eval/utils/tools.py' 2024-11-29T16:34:51,501 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2024-11-29T16:34:51,503 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2024-11-29T16:34:51,504 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2024-11-29T16:34:51,506 adding 'evalscope/benchmarks/__init__.py' 2024-11-29T16:34:51,507 adding 'evalscope/benchmarks/benchmark.py' 2024-11-29T16:34:51,509 adding 'evalscope/benchmarks/data_adapter.py' 2024-11-29T16:34:51,511 adding 'evalscope/benchmarks/arc/__init__.py' 2024-11-29T16:34:51,512 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2024-11-29T16:34:51,514 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2024-11-29T16:34:51,516 adding 'evalscope/benchmarks/bbh/__init__.py' 2024-11-29T16:34:51,518 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2024-11-29T16:34:51,520 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2024-11-29T16:34:51,522 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2024-11-29T16:34:51,523 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2024-11-29T16:34:51,524 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2024-11-29T16:34:51,525 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2024-11-29T16:34:51,527 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2024-11-29T16:34:51,528 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2024-11-29T16:34:51,530 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2024-11-29T16:34:51,531 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2024-11-29T16:34:51,532 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2024-11-29T16:34:51,534 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2024-11-29T16:34:51,535 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2024-11-29T16:34:51,536 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2024-11-29T16:34:51,538 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2024-11-29T16:34:51,539 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2024-11-29T16:34:51,540 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2024-11-29T16:34:51,542 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2024-11-29T16:34:51,543 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2024-11-29T16:34:51,544 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2024-11-29T16:34:51,546 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2024-11-29T16:34:51,547 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2024-11-29T16:34:51,548 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2024-11-29T16:34:51,550 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2024-11-29T16:34:51,551 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2024-11-29T16:34:51,552 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2024-11-29T16:34:51,554 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2024-11-29T16:34:51,555 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2024-11-29T16:34:51,557 adding 'evalscope/benchmarks/ceval/__init__.py' 2024-11-29T16:34:51,559 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2024-11-29T16:34:51,560 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2024-11-29T16:34:51,561 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2024-11-29T16:34:51,563 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2024-11-29T16:34:51,564 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2024-11-29T16:34:51,566 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2024-11-29T16:34:51,568 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2024-11-29T16:34:51,570 adding 'evalscope/benchmarks/competition_math/__init__.py' 2024-11-29T16:34:51,571 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2024-11-29T16:34:51,574 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2024-11-29T16:34:51,575 adding 'evalscope/benchmarks/general_qa/__init__.py' 2024-11-29T16:34:51,577 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2024-11-29T16:34:51,579 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2024-11-29T16:34:51,580 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2024-11-29T16:34:51,582 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2024-11-29T16:34:51,584 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2024-11-29T16:34:51,586 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2024-11-29T16:34:51,587 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2024-11-29T16:34:51,589 adding 'evalscope/benchmarks/humaneval/__init__.py' 2024-11-29T16:34:51,591 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2024-11-29T16:34:51,592 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2024-11-29T16:34:51,594 adding 'evalscope/benchmarks/mmlu/__init__.py' 2024-11-29T16:34:51,595 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2024-11-29T16:34:51,598 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2024-11-29T16:34:51,599 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2024-11-29T16:34:51,601 adding 'evalscope/benchmarks/race/__init__.py' 2024-11-29T16:34:51,602 adding 'evalscope/benchmarks/race/race.py' 2024-11-29T16:34:51,604 adding 'evalscope/benchmarks/race/race_adapter.py' 2024-11-29T16:34:51,605 adding 'evalscope/benchmarks/race/samples.jsonl' 2024-11-29T16:34:51,607 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2024-11-29T16:34:51,608 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2024-11-29T16:34:51,610 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2024-11-29T16:34:51,611 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2024-11-29T16:34:51,613 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2024-11-29T16:34:51,615 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2024-11-29T16:34:51,617 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2024-11-29T16:34:51,619 adding 'evalscope/cli/__init__.py' 2024-11-29T16:34:51,620 adding 'evalscope/cli/base.py' 2024-11-29T16:34:51,621 adding 'evalscope/cli/cli.py' 2024-11-29T16:34:51,623 adding 'evalscope/cli/start_perf.py' 2024-11-29T16:34:51,624 adding 'evalscope/cli/start_server.py' 2024-11-29T16:34:51,626 adding 'evalscope/evaluator/__init__.py' 2024-11-29T16:34:51,629 adding 'evalscope/evaluator/evaluator.py' 2024-11-29T16:34:51,631 adding 'evalscope/evaluator/rating_eval.py' 2024-11-29T16:34:51,632 adding 'evalscope/evaluator/reviewer/__init__.py' 2024-11-29T16:34:51,634 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2024-11-29T16:34:51,636 adding 'evalscope/metrics/__init__.py' 2024-11-29T16:34:51,637 adding 'evalscope/metrics/code_metric.py' 2024-11-29T16:34:51,639 adding 'evalscope/metrics/math_accuracy.py' 2024-11-29T16:34:51,641 adding 'evalscope/metrics/metrics.py' 2024-11-29T16:34:51,643 adding 'evalscope/metrics/rouge_metric.py' 2024-11-29T16:34:51,645 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2024-11-29T16:34:51,648 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2024-11-29T16:34:51,806 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2024-11-29T16:34:52,054 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2024-11-29T16:34:52,063 adding 'evalscope/models/__init__.py' 2024-11-29T16:34:52,065 adding 'evalscope/models/dummy_chat_model.py' 2024-11-29T16:34:52,066 adding 'evalscope/models/model.py' 2024-11-29T16:34:52,069 adding 'evalscope/models/model_adapter.py' 2024-11-29T16:34:52,070 adding 'evalscope/models/openai_model.py' 2024-11-29T16:34:52,076 adding 'evalscope/models/template.py' 2024-11-29T16:34:52,078 adding 'evalscope/models/api/__init__.py' 2024-11-29T16:34:52,079 adding 'evalscope/models/api/openai_api.py' 2024-11-29T16:34:52,081 adding 'evalscope/models/custom/__init__.py' 2024-11-29T16:34:52,082 adding 'evalscope/models/custom/custom_model.py' 2024-11-29T16:34:52,084 adding 'evalscope/perf/__init__.py' 2024-11-29T16:34:52,086 adding 'evalscope/perf/arguments.py' 2024-11-29T16:34:52,088 adding 'evalscope/perf/benchmark.py' 2024-11-29T16:34:52,090 adding 'evalscope/perf/http_client.py' 2024-11-29T16:34:52,091 adding 'evalscope/perf/main.py' 2024-11-29T16:34:52,094 adding 'evalscope/perf/plugin/__init__.py' 2024-11-29T16:34:52,096 adding 'evalscope/perf/plugin/registry.py' 2024-11-29T16:34:52,097 adding 'evalscope/perf/plugin/api/__init__.py' 2024-11-29T16:34:52,099 adding 'evalscope/perf/plugin/api/base.py' 2024-11-29T16:34:52,100 adding 'evalscope/perf/plugin/api/custom_api.py' 2024-11-29T16:34:52,102 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2024-11-29T16:34:52,103 adding 'evalscope/perf/plugin/api/openai_api.py' 2024-11-29T16:34:52,105 adding 'evalscope/perf/plugin/datasets/__init__.py' 2024-11-29T16:34:52,106 adding 'evalscope/perf/plugin/datasets/base.py' 2024-11-29T16:34:52,108 adding 'evalscope/perf/plugin/datasets/custom.py' 2024-11-29T16:34:52,109 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2024-11-29T16:34:52,110 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2024-11-29T16:34:52,111 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2024-11-29T16:34:52,113 adding 'evalscope/perf/plugin/datasets/openqa.py' 2024-11-29T16:34:52,114 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2024-11-29T16:34:52,116 adding 'evalscope/perf/utils/__init__.py' 2024-11-29T16:34:52,117 adding 'evalscope/perf/utils/analysis_result.py' 2024-11-29T16:34:52,118 adding 'evalscope/perf/utils/benchmark_util.py' 2024-11-29T16:34:52,120 adding 'evalscope/perf/utils/chat_service.py' 2024-11-29T16:34:52,122 adding 'evalscope/perf/utils/db_util.py' 2024-11-29T16:34:52,123 adding 'evalscope/perf/utils/handler.py' 2024-11-29T16:34:52,125 adding 'evalscope/perf/utils/local_server.py' 2024-11-29T16:34:52,126 adding 'evalscope/registry/__init__.py' 2024-11-29T16:34:52,128 adding 'evalscope/registry/config/cfg_arena.yaml' 2024-11-29T16:34:52,129 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2024-11-29T16:34:52,131 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2024-11-29T16:34:52,132 adding 'evalscope/registry/config/cfg_single.yaml' 2024-11-29T16:34:52,134 adding 'evalscope/registry/data/question.jsonl' 2024-11-29T16:34:52,136 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2024-11-29T16:34:52,138 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2024-11-29T16:34:52,302 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2024-11-29T16:34:52,311 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2024-11-29T16:34:52,313 adding 'evalscope/registry/tasks/arc.yaml' 2024-11-29T16:34:52,314 adding 'evalscope/registry/tasks/bbh.yaml' 2024-11-29T16:34:52,315 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2024-11-29T16:34:52,316 adding 'evalscope/registry/tasks/ceval.yaml' 2024-11-29T16:34:52,317 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2024-11-29T16:34:52,319 adding 'evalscope/registry/tasks/cmmlu.yaml' 2024-11-29T16:34:52,320 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2024-11-29T16:34:52,321 adding 'evalscope/registry/tasks/general_qa.yaml' 2024-11-29T16:34:52,322 adding 'evalscope/registry/tasks/gsm8k.yaml' 2024-11-29T16:34:52,323 adding 'evalscope/registry/tasks/mmlu.yaml' 2024-11-29T16:34:52,324 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2024-11-29T16:34:52,326 adding 'evalscope/third_party/__init__.py' 2024-11-29T16:34:52,328 adding 'evalscope/third_party/longbench_write/README.md' 2024-11-29T16:34:52,329 adding 'evalscope/third_party/longbench_write/__init__.py' 2024-11-29T16:34:52,331 adding 'evalscope/third_party/longbench_write/default_task.json' 2024-11-29T16:34:52,332 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2024-11-29T16:34:52,334 adding 'evalscope/third_party/longbench_write/eval.py' 2024-11-29T16:34:52,336 adding 'evalscope/third_party/longbench_write/infer.py' 2024-11-29T16:34:52,337 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2024-11-29T16:34:52,339 adding 'evalscope/third_party/longbench_write/utils.py' 2024-11-29T16:34:52,340 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2024-11-29T16:34:52,342 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2024-11-29T16:34:52,349 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2024-11-29T16:34:52,353 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2024-11-29T16:34:52,354 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2024-11-29T16:34:52,356 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2024-11-29T16:34:52,358 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2024-11-29T16:34:52,360 adding 'evalscope/third_party/toolbench_static/README.md' 2024-11-29T16:34:52,361 adding 'evalscope/third_party/toolbench_static/__init__.py' 2024-11-29T16:34:52,362 adding 'evalscope/third_party/toolbench_static/config_default.json' 2024-11-29T16:34:52,364 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2024-11-29T16:34:52,365 adding 'evalscope/third_party/toolbench_static/eval.py' 2024-11-29T16:34:52,367 adding 'evalscope/third_party/toolbench_static/infer.py' 2024-11-29T16:34:52,368 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2024-11-29T16:34:52,369 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2024-11-29T16:34:52,371 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2024-11-29T16:34:52,372 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2024-11-29T16:34:52,374 adding 'evalscope/tools/__init__.py' 2024-11-29T16:34:52,376 adding 'evalscope/tools/combine_reports.py' 2024-11-29T16:34:52,377 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2024-11-29T16:34:52,378 adding 'evalscope/tools/rewrite_eval_results.py' 2024-11-29T16:34:52,380 adding 'evalscope/utils/__init__.py' 2024-11-29T16:34:52,381 adding 'evalscope/utils/arena_utils.py' 2024-11-29T16:34:52,383 adding 'evalscope/utils/completion_parsers.py' 2024-11-29T16:34:52,384 adding 'evalscope/utils/logger.py' 2024-11-29T16:34:52,385 adding 'evalscope/utils/task_cfg_parser.py' 2024-11-29T16:34:52,386 adding 'evalscope/utils/task_utils.py' 2024-11-29T16:34:52,388 adding 'evalscope/utils/utils.py' 2024-11-29T16:34:52,391 adding 'tests/__init__.py' 2024-11-29T16:34:52,392 adding 'tests/test_run_all.py' 2024-11-29T16:34:52,394 adding 'tests/cli/__init__.py' 2024-11-29T16:34:52,395 adding 'tests/cli/test_run.py' 2024-11-29T16:34:52,396 adding 'tests/perf/__init__.py' 2024-11-29T16:34:52,398 adding 'tests/perf/test_perf.py' 2024-11-29T16:34:52,399 adding 'tests/rag/__init__.py' 2024-11-29T16:34:52,401 adding 'tests/rag/test_clip_benchmark.py' 2024-11-29T16:34:52,402 adding 'tests/rag/test_mteb.py' 2024-11-29T16:34:52,403 adding 'tests/rag/test_ragas.py' 2024-11-29T16:34:52,405 adding 'tests/swift/__init__.py' 2024-11-29T16:34:52,407 adding 'tests/swift/test_run_swift_eval.py' 2024-11-29T16:34:52,408 adding 'tests/swift/test_run_swift_vlm_eval.py' 2024-11-29T16:34:52,410 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2024-11-29T16:34:52,412 adding 'tests/vlm/__init__.py' 2024-11-29T16:34:52,413 adding 'tests/vlm/test_vlmeval.py' 2024-11-29T16:34:52,415 adding 'evalscope-0.7.1.dist-info/LICENSE' 2024-11-29T16:34:52,418 adding 'evalscope-0.7.1.dist-info/METADATA' 2024-11-29T16:34:52,419 adding 'evalscope-0.7.1.dist-info/WHEEL' 2024-11-29T16:34:52,420 adding 'evalscope-0.7.1.dist-info/entry_points.txt' 2024-11-29T16:34:52,421 adding 'evalscope-0.7.1.dist-info/top_level.txt' 2024-11-29T16:34:52,426 adding 'evalscope-0.7.1.dist-info/RECORD' 2024-11-29T16:34:52,444 removing build/bdist.linux-armv7l/wheel 2024-11-29T16:34:52,647 Building wheel for evalscope (setup.py): finished with status 'done' 2024-11-29T16:34:52,663 Created wheel for evalscope: filename=evalscope-0.7.1-py3-none-any.whl size=1428130 sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 2024-11-29T16:34:52,664 Stored in directory: /tmp/pip-ephem-wheel-cache-wht66mz0/wheels/9c/4f/70/cb328ba70b9a9dfe52d6ec4c30af447a88f493ecc73e40544f 2024-11-29T16:34:52,690 Successfully built evalscope 2024-11-29T16:34:52,729 Removed build tracker: '/tmp/pip-build-tracker-pi_dipr0'