2024-12-28T23:20:34,439 Created temporary directory: /tmp/pip-build-tracker-649t13sy 2024-12-28T23:20:34,440 Initialized build tracking at /tmp/pip-build-tracker-649t13sy 2024-12-28T23:20:34,441 Created build tracker: /tmp/pip-build-tracker-649t13sy 2024-12-28T23:20:34,441 Entered build tracker: /tmp/pip-build-tracker-649t13sy 2024-12-28T23:20:34,442 Created temporary directory: /tmp/pip-wheel-ozjs41gh 2024-12-28T23:20:34,446 Created temporary directory: /tmp/pip-ephem-wheel-cache-vw7o4iyt 2024-12-28T23:20:34,491 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-28T23:20:34,493 2 location(s) to search for versions of evalscope: 2024-12-28T23:20:34,493 * https://pypi.org/simple/evalscope/ 2024-12-28T23:20:34,493 * https://www.piwheels.org/simple/evalscope/ 2024-12-28T23:20:34,494 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2024-12-28T23:20:34,495 Getting page https://pypi.org/simple/evalscope/ 2024-12-28T23:20:34,496 Found index url https://pypi.org/simple/ 2024-12-28T23:20:34,885 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2024-12-28T23:20:34,902 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,904 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2024-12-28T23:20:34,905 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,907 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2024-12-28T23:20:34,908 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,909 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2024-12-28T23:20:34,911 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,913 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2024-12-28T23:20:34,914 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,916 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2024-12-28T23:20:34,917 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,918 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,920 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2024-12-28T23:20:34,921 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,922 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2024-12-28T23:20:34,924 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,925 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2024-12-28T23:20:34,926 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,928 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2024-12-28T23:20:34,929 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,931 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2024-12-28T23:20:34,932 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,934 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2024-12-28T23:20:34,935 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,937 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2024-12-28T23:20:34,938 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,939 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2024-12-28T23:20:34,941 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,943 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2024-12-28T23:20:34,944 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,946 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2024-12-28T23:20:34,947 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:34,948 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2024-12-28T23:20:34,950 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2024-12-28T23:20:34,951 Getting page https://www.piwheels.org/simple/evalscope/ 2024-12-28T23:20:34,954 Found index url https://www.piwheels.org/simple/ 2024-12-28T23:20:35,130 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2024-12-28T23:20:35,133 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:35,134 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:35,134 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:35,135 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:35,136 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2024-12-28T23:20:35,136 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2024-12-28T23:20:35,137 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2024-12-28T23:20:35,158 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2024-12-28T23:20:35,159 Collecting evalscope==0.8.2 2024-12-28T23:20:35,162 Created temporary directory: /tmp/pip-unpack-id381eur 2024-12-28T23:20:35,308 Downloading evalscope-0.8.2.tar.gz (1.3 MB) 2024-12-28T23:20:36,144 Added evalscope==0.8.2 from https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz to build tracker '/tmp/pip-build-tracker-649t13sy' 2024-12-28T23:20:36,146 Running setup.py (path:/tmp/pip-wheel-ozjs41gh/evalscope_02bb46e0be02450e81cc90c506a9cc39/setup.py) egg_info for package evalscope 2024-12-28T23:20:36,147 Created temporary directory: /tmp/pip-pip-egg-info-kcqlcs1x 2024-12-28T23:20:36,148 Preparing metadata (setup.py): started 2024-12-28T23:20:36,149 Running command python setup.py egg_info 2024-12-28T23:20:36,733 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-28T23:20:36,733 !! 2024-12-28T23:20:36,734 ******************************************************************************** 2024-12-28T23:20:36,735 Usage of dash-separated 'index-url' will not be supported in future 2024-12-28T23:20:36,735 versions. Please use the underscore name 'index_url' instead. 2024-12-28T23:20:36,737 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-28T23:20:36,737 or your builds will no longer be supported. 2024-12-28T23:20:36,738 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-28T23:20:36,739 ******************************************************************************** 2024-12-28T23:20:36,740 !! 2024-12-28T23:20:36,740 opt = self.warn_dash_deprecation(opt, section) 2024-12-28T23:20:37,316 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-28T23:20:37,317 !! 2024-12-28T23:20:37,318 ******************************************************************************** 2024-12-28T23:20:37,319 Usage of dash-separated 'index-url' will not be supported in future 2024-12-28T23:20:37,319 versions. Please use the underscore name 'index_url' instead. 2024-12-28T23:20:37,320 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-28T23:20:37,321 or your builds will no longer be supported. 2024-12-28T23:20:37,323 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-28T23:20:37,324 ******************************************************************************** 2024-12-28T23:20:37,325 !! 2024-12-28T23:20:37,325 opt = self.warn_dash_deprecation(opt, section) 2024-12-28T23:20:37,356 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-28T23:20:37,357 running egg_info 2024-12-28T23:20:37,385 creating /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info 2024-12-28T23:20:37,386 writing /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/PKG-INFO 2024-12-28T23:20:37,414 writing dependency_links to /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/dependency_links.txt 2024-12-28T23:20:37,415 writing entry points to /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/entry_points.txt 2024-12-28T23:20:37,429 writing requirements to /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/requires.txt 2024-12-28T23:20:37,430 writing top-level names to /tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/top_level.txt 2024-12-28T23:20:37,432 writing manifest file '/tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/SOURCES.txt' 2024-12-28T23:20:37,583 reading manifest file '/tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/SOURCES.txt' 2024-12-28T23:20:37,584 reading manifest template 'MANIFEST.in' 2024-12-28T23:20:37,699 adding license file 'LICENSE' 2024-12-28T23:20:37,713 writing manifest file '/tmp/pip-pip-egg-info-kcqlcs1x/evalscope.egg-info/SOURCES.txt' 2024-12-28T23:20:37,824 Preparing metadata (setup.py): finished with status 'done' 2024-12-28T23:20:37,830 Source in /tmp/pip-wheel-ozjs41gh/evalscope_02bb46e0be02450e81cc90c506a9cc39 has version 0.8.2, which satisfies requirement evalscope==0.8.2 from https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz 2024-12-28T23:20:37,831 Removed evalscope==0.8.2 from https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz from build tracker '/tmp/pip-build-tracker-649t13sy' 2024-12-28T23:20:37,884 Created temporary directory: /tmp/pip-unpack-ictcbvn5 2024-12-28T23:20:37,885 Created temporary directory: /tmp/pip-unpack-vn6gt8c2 2024-12-28T23:20:37,885 Building wheels for collected packages: evalscope 2024-12-28T23:20:37,890 Created temporary directory: /tmp/pip-wheel-1_zv0rhj 2024-12-28T23:20:37,891 Building wheel for evalscope (setup.py): started 2024-12-28T23:20:37,892 Destination directory: /tmp/pip-wheel-1_zv0rhj 2024-12-28T23:20:37,892 Running command python setup.py bdist_wheel 2024-12-28T23:20:38,357 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2024-12-28T23:20:38,463 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-28T23:20:38,464 !! 2024-12-28T23:20:38,465 ******************************************************************************** 2024-12-28T23:20:38,466 Usage of dash-separated 'index-url' will not be supported in future 2024-12-28T23:20:38,466 versions. Please use the underscore name 'index_url' instead. 2024-12-28T23:20:38,467 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-28T23:20:38,468 or your builds will no longer be supported. 2024-12-28T23:20:38,469 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-28T23:20:38,469 ******************************************************************************** 2024-12-28T23:20:38,471 !! 2024-12-28T23:20:38,471 opt = self.warn_dash_deprecation(opt, section) 2024-12-28T23:20:39,044 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2024-12-28T23:20:39,045 !! 2024-12-28T23:20:39,046 ******************************************************************************** 2024-12-28T23:20:39,047 Usage of dash-separated 'index-url' will not be supported in future 2024-12-28T23:20:39,047 versions. Please use the underscore name 'index_url' instead. 2024-12-28T23:20:39,049 By 2025-Mar-03, you need to update your project and remove deprecated calls 2024-12-28T23:20:39,049 or your builds will no longer be supported. 2024-12-28T23:20:39,051 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2024-12-28T23:20:39,051 ******************************************************************************** 2024-12-28T23:20:39,052 !! 2024-12-28T23:20:39,053 opt = self.warn_dash_deprecation(opt, section) 2024-12-28T23:20:39,055 running bdist_wheel 2024-12-28T23:20:39,194 running build 2024-12-28T23:20:39,194 running build_py 2024-12-28T23:20:39,226 creating build/lib/evalscope 2024-12-28T23:20:39,228 copying evalscope/summarizer.py -> build/lib/evalscope 2024-12-28T23:20:39,230 copying evalscope/run.py -> build/lib/evalscope 2024-12-28T23:20:39,233 copying evalscope/arguments.py -> build/lib/evalscope 2024-12-28T23:20:39,235 copying evalscope/__init__.py -> build/lib/evalscope 2024-12-28T23:20:39,237 copying evalscope/constants.py -> build/lib/evalscope 2024-12-28T23:20:39,239 copying evalscope/run_arena.py -> build/lib/evalscope 2024-12-28T23:20:39,241 copying evalscope/config.py -> build/lib/evalscope 2024-12-28T23:20:39,244 copying evalscope/version.py -> build/lib/evalscope 2024-12-28T23:20:39,246 creating build/lib/tests 2024-12-28T23:20:39,247 copying tests/__init__.py -> build/lib/tests 2024-12-28T23:20:39,249 copying tests/test_run_all.py -> build/lib/tests 2024-12-28T23:20:39,252 creating build/lib/evalscope/benchmarks 2024-12-28T23:20:39,253 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2024-12-28T23:20:39,255 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2024-12-28T23:20:39,256 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2024-12-28T23:20:39,259 creating build/lib/evalscope/backend 2024-12-28T23:20:39,260 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2024-12-28T23:20:39,262 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2024-12-28T23:20:39,264 creating build/lib/evalscope/utils 2024-12-28T23:20:39,265 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,268 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,269 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,271 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,273 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,275 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,278 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,280 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2024-12-28T23:20:39,282 creating build/lib/evalscope/evaluator 2024-12-28T23:20:39,283 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2024-12-28T23:20:39,286 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2024-12-28T23:20:39,287 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2024-12-28T23:20:39,291 creating build/lib/evalscope/metrics 2024-12-28T23:20:39,292 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2024-12-28T23:20:39,294 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2024-12-28T23:20:39,297 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2024-12-28T23:20:39,300 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2024-12-28T23:20:39,302 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2024-12-28T23:20:39,304 creating build/lib/evalscope/perf 2024-12-28T23:20:39,305 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2024-12-28T23:20:39,308 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2024-12-28T23:20:39,310 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2024-12-28T23:20:39,312 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2024-12-28T23:20:39,314 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2024-12-28T23:20:39,317 creating build/lib/evalscope/models 2024-12-28T23:20:39,319 copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models 2024-12-28T23:20:39,321 copying evalscope/models/model.py -> build/lib/evalscope/models 2024-12-28T23:20:39,323 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2024-12-28T23:20:39,325 copying evalscope/models/openai_model.py -> build/lib/evalscope/models 2024-12-28T23:20:39,327 copying evalscope/models/model_adapter.py -> build/lib/evalscope/models 2024-12-28T23:20:39,330 creating build/lib/evalscope/third_party 2024-12-28T23:20:39,332 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2024-12-28T23:20:39,334 creating build/lib/evalscope/registry 2024-12-28T23:20:39,335 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2024-12-28T23:20:39,338 creating build/lib/evalscope/cli 2024-12-28T23:20:39,339 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,342 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,344 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,346 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,348 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,350 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2024-12-28T23:20:39,352 creating build/lib/evalscope/tools 2024-12-28T23:20:39,353 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2024-12-28T23:20:39,355 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2024-12-28T23:20:39,357 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2024-12-28T23:20:39,360 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2024-12-28T23:20:39,362 creating build/lib/evalscope/benchmarks/humaneval 2024-12-28T23:20:39,363 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-28T23:20:39,366 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-28T23:20:39,368 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2024-12-28T23:20:39,371 creating build/lib/evalscope/benchmarks/hellaswag 2024-12-28T23:20:39,372 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-28T23:20:39,374 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-28T23:20:39,377 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2024-12-28T23:20:39,379 creating build/lib/evalscope/benchmarks/competition_math 2024-12-28T23:20:39,380 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-28T23:20:39,383 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-28T23:20:39,386 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2024-12-28T23:20:39,388 creating build/lib/evalscope/benchmarks/bbh 2024-12-28T23:20:39,389 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2024-12-28T23:20:39,391 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2024-12-28T23:20:39,394 creating build/lib/evalscope/benchmarks/cmmlu 2024-12-28T23:20:39,395 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-28T23:20:39,398 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-28T23:20:39,401 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2024-12-28T23:20:39,403 creating build/lib/evalscope/benchmarks/race 2024-12-28T23:20:39,405 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2024-12-28T23:20:39,407 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2024-12-28T23:20:39,409 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2024-12-28T23:20:39,412 creating build/lib/evalscope/benchmarks/gsm8k 2024-12-28T23:20:39,413 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-28T23:20:39,415 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-28T23:20:39,417 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2024-12-28T23:20:39,420 creating build/lib/evalscope/benchmarks/ceval 2024-12-28T23:20:39,422 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2024-12-28T23:20:39,423 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2024-12-28T23:20:39,426 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2024-12-28T23:20:39,429 creating build/lib/evalscope/benchmarks/truthful_qa 2024-12-28T23:20:39,430 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-28T23:20:39,433 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-28T23:20:39,435 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2024-12-28T23:20:39,438 creating build/lib/evalscope/benchmarks/arc 2024-12-28T23:20:39,439 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2024-12-28T23:20:39,441 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2024-12-28T23:20:39,443 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2024-12-28T23:20:39,446 creating build/lib/evalscope/benchmarks/mmlu 2024-12-28T23:20:39,447 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-28T23:20:39,450 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-28T23:20:39,452 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2024-12-28T23:20:39,455 creating build/lib/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:39,456 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:39,458 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:39,461 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:39,463 creating build/lib/evalscope/benchmarks/general_qa 2024-12-28T23:20:39,465 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-28T23:20:39,467 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2024-12-28T23:20:39,470 creating build/lib/evalscope/backend/vlm_eval_kit 2024-12-28T23:20:39,471 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-28T23:20:39,474 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-28T23:20:39,476 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2024-12-28T23:20:39,478 creating build/lib/evalscope/backend/rag_eval 2024-12-28T23:20:39,479 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2024-12-28T23:20:39,482 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2024-12-28T23:20:39,490 creating build/lib/evalscope/backend/opencompass 2024-12-28T23:20:39,492 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2024-12-28T23:20:39,495 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2024-12-28T23:20:39,497 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2024-12-28T23:20:39,500 creating build/lib/evalscope/backend/rag_eval/ragas 2024-12-28T23:20:39,501 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-28T23:20:39,503 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-28T23:20:39,505 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2024-12-28T23:20:39,508 creating build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,509 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,512 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,513 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,516 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,518 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2024-12-28T23:20:39,520 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:39,521 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:39,523 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:39,525 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:39,527 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:39,530 creating build/lib/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:39,531 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:39,533 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:39,535 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:39,538 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:39,540 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,542 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,544 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,546 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,548 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,550 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:39,553 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:39,554 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:39,556 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:39,558 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:39,561 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:39,564 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,565 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,567 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,570 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,572 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,574 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,577 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,579 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,581 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:39,584 creating build/lib/evalscope/backend/opencompass/tasks 2024-12-28T23:20:39,586 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-28T23:20:39,588 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-28T23:20:39,590 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2024-12-28T23:20:39,593 creating build/lib/evalscope/evaluator/reviewer 2024-12-28T23:20:39,594 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2024-12-28T23:20:39,597 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2024-12-28T23:20:39,600 creating build/lib/evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:39,601 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:39,604 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:39,606 creating build/lib/evalscope/perf/utils 2024-12-28T23:20:39,607 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,610 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,613 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,615 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,617 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,619 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2024-12-28T23:20:39,622 creating build/lib/evalscope/perf/plugin 2024-12-28T23:20:39,623 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2024-12-28T23:20:39,625 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2024-12-28T23:20:39,628 creating build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,629 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,631 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,633 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,635 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,637 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,639 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,641 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,643 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2024-12-28T23:20:39,646 creating build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,647 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,649 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,651 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,654 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,656 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2024-12-28T23:20:39,658 creating build/lib/evalscope/models/custom 2024-12-28T23:20:39,660 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2024-12-28T23:20:39,662 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2024-12-28T23:20:39,664 creating build/lib/evalscope/models/api 2024-12-28T23:20:39,665 copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api 2024-12-28T23:20:39,667 copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api 2024-12-28T23:20:39,670 creating build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,671 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,673 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,675 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,677 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,679 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:39,681 creating build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:39,682 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:39,685 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:39,687 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:39,689 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:39,692 creating build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:39,693 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:39,695 creating build/lib/evalscope/third_party/longbench_write/tools 2024-12-28T23:20:39,696 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-28T23:20:39,699 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2024-12-28T23:20:39,701 creating build/lib/evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:39,702 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:39,704 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:39,707 creating build/lib/tests/vlm 2024-12-28T23:20:39,708 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2024-12-28T23:20:39,710 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2024-12-28T23:20:39,712 creating build/lib/tests/swift 2024-12-28T23:20:39,713 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2024-12-28T23:20:39,716 copying tests/swift/__init__.py -> build/lib/tests/swift 2024-12-28T23:20:39,718 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2024-12-28T23:20:39,720 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2024-12-28T23:20:39,723 creating build/lib/tests/perf 2024-12-28T23:20:39,725 copying tests/perf/test_perf.py -> build/lib/tests/perf 2024-12-28T23:20:39,727 copying tests/perf/__init__.py -> build/lib/tests/perf 2024-12-28T23:20:39,729 creating build/lib/tests/rag 2024-12-28T23:20:39,731 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2024-12-28T23:20:39,733 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2024-12-28T23:20:39,735 copying tests/rag/__init__.py -> build/lib/tests/rag 2024-12-28T23:20:39,737 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2024-12-28T23:20:39,740 creating build/lib/tests/cli 2024-12-28T23:20:39,741 copying tests/cli/__init__.py -> build/lib/tests/cli 2024-12-28T23:20:39,743 copying tests/cli/test_run.py -> build/lib/tests/cli 2024-12-28T23:20:39,745 running egg_info 2024-12-28T23:20:39,780 writing evalscope.egg-info/PKG-INFO 2024-12-28T23:20:39,807 writing dependency_links to evalscope.egg-info/dependency_links.txt 2024-12-28T23:20:39,809 writing entry points to evalscope.egg-info/entry_points.txt 2024-12-28T23:20:39,823 writing requirements to evalscope.egg-info/requires.txt 2024-12-28T23:20:39,824 writing top-level names to evalscope.egg-info/top_level.txt 2024-12-28T23:20:39,904 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-28T23:20:39,922 reading manifest template 'MANIFEST.in' 2024-12-28T23:20:40,051 adding license file 'LICENSE' 2024-12-28T23:20:40,069 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2024-12-28T23:20:40,072 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2024-12-28T23:20:40,073 !! 2024-12-28T23:20:40,073 ******************************************************************************** 2024-12-28T23:20:40,074 ############################ 2024-12-28T23:20:40,075 # Package would be ignored # 2024-12-28T23:20:40,075 ############################ 2024-12-28T23:20:40,076 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2024-12-28T23:20:40,076 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,077 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,078 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2024-12-28T23:20:40,079 to the `packages` configuration field. 2024-12-28T23:20:40,080 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,080 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,081 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,082 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,083 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,084 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2024-12-28T23:20:40,085 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2024-12-28T23:20:40,086 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,086 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,087 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,088 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,089 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,091 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,092 even if it does not contain any `.py` files. 2024-12-28T23:20:40,092 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,093 directory, all directories are treated like packages. 2024-12-28T23:20:40,093 ******************************************************************************** 2024-12-28T23:20:40,094 !! 2024-12-28T23:20:40,095 check.warn(importable) 2024-12-28T23:20:40,096 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2024-12-28T23:20:40,096 !! 2024-12-28T23:20:40,097 ******************************************************************************** 2024-12-28T23:20:40,098 ############################ 2024-12-28T23:20:40,098 # Package would be ignored # 2024-12-28T23:20:40,099 ############################ 2024-12-28T23:20:40,099 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2024-12-28T23:20:40,099 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,101 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,101 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2024-12-28T23:20:40,101 to the `packages` configuration field. 2024-12-28T23:20:40,102 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,103 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,103 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,104 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,105 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,106 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2024-12-28T23:20:40,107 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2024-12-28T23:20:40,107 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,108 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,108 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,109 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,110 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,112 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,113 even if it does not contain any `.py` files. 2024-12-28T23:20:40,113 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,114 directory, all directories are treated like packages. 2024-12-28T23:20:40,114 ******************************************************************************** 2024-12-28T23:20:40,116 !! 2024-12-28T23:20:40,116 check.warn(importable) 2024-12-28T23:20:40,117 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2024-12-28T23:20:40,117 !! 2024-12-28T23:20:40,118 ******************************************************************************** 2024-12-28T23:20:40,119 ############################ 2024-12-28T23:20:40,120 # Package would be ignored # 2024-12-28T23:20:40,120 ############################ 2024-12-28T23:20:40,121 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2024-12-28T23:20:40,121 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,123 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,123 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2024-12-28T23:20:40,124 to the `packages` configuration field. 2024-12-28T23:20:40,125 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,126 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,126 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,128 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,129 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,129 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2024-12-28T23:20:40,130 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2024-12-28T23:20:40,130 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,131 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,131 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,132 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,133 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,134 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,135 even if it does not contain any `.py` files. 2024-12-28T23:20:40,135 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,136 directory, all directories are treated like packages. 2024-12-28T23:20:40,136 ******************************************************************************** 2024-12-28T23:20:40,137 !! 2024-12-28T23:20:40,138 check.warn(importable) 2024-12-28T23:20:40,138 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2024-12-28T23:20:40,139 !! 2024-12-28T23:20:40,140 ******************************************************************************** 2024-12-28T23:20:40,140 ############################ 2024-12-28T23:20:40,141 # Package would be ignored # 2024-12-28T23:20:40,141 ############################ 2024-12-28T23:20:40,142 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2024-12-28T23:20:40,142 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,143 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,144 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2024-12-28T23:20:40,144 to the `packages` configuration field. 2024-12-28T23:20:40,145 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,146 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,146 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,147 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,148 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,149 If you don't want 'evalscope.metrics.resources' to be distributed and are 2024-12-28T23:20:40,150 already explicitly excluding 'evalscope.metrics.resources' via 2024-12-28T23:20:40,150 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,151 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,152 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,153 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,154 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,156 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,156 even if it does not contain any `.py` files. 2024-12-28T23:20:40,157 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,158 directory, all directories are treated like packages. 2024-12-28T23:20:40,158 ******************************************************************************** 2024-12-28T23:20:40,159 !! 2024-12-28T23:20:40,160 check.warn(importable) 2024-12-28T23:20:40,160 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2024-12-28T23:20:40,161 !! 2024-12-28T23:20:40,161 ******************************************************************************** 2024-12-28T23:20:40,162 ############################ 2024-12-28T23:20:40,162 # Package would be ignored # 2024-12-28T23:20:40,163 ############################ 2024-12-28T23:20:40,163 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2024-12-28T23:20:40,164 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,165 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,165 package, please make sure that 'evalscope.registry.config' is explicitly added 2024-12-28T23:20:40,166 to the `packages` configuration field. 2024-12-28T23:20:40,167 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,167 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,168 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,169 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,170 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,171 If you don't want 'evalscope.registry.config' to be distributed and are 2024-12-28T23:20:40,171 already explicitly excluding 'evalscope.registry.config' via 2024-12-28T23:20:40,172 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,172 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,173 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,174 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,175 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,176 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,177 even if it does not contain any `.py` files. 2024-12-28T23:20:40,177 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,178 directory, all directories are treated like packages. 2024-12-28T23:20:40,178 ******************************************************************************** 2024-12-28T23:20:40,180 !! 2024-12-28T23:20:40,180 check.warn(importable) 2024-12-28T23:20:40,181 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2024-12-28T23:20:40,181 !! 2024-12-28T23:20:40,182 ******************************************************************************** 2024-12-28T23:20:40,183 ############################ 2024-12-28T23:20:40,184 # Package would be ignored # 2024-12-28T23:20:40,184 ############################ 2024-12-28T23:20:40,185 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2024-12-28T23:20:40,185 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,186 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,187 package, please make sure that 'evalscope.registry.data' is explicitly added 2024-12-28T23:20:40,187 to the `packages` configuration field. 2024-12-28T23:20:40,189 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,189 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,190 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,191 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,192 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,193 If you don't want 'evalscope.registry.data' to be distributed and are 2024-12-28T23:20:40,193 already explicitly excluding 'evalscope.registry.data' via 2024-12-28T23:20:40,194 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,194 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,195 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,196 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,197 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,198 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,199 even if it does not contain any `.py` files. 2024-12-28T23:20:40,199 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,200 directory, all directories are treated like packages. 2024-12-28T23:20:40,200 ******************************************************************************** 2024-12-28T23:20:40,201 !! 2024-12-28T23:20:40,202 check.warn(importable) 2024-12-28T23:20:40,202 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2024-12-28T23:20:40,203 !! 2024-12-28T23:20:40,204 ******************************************************************************** 2024-12-28T23:20:40,204 ############################ 2024-12-28T23:20:40,205 # Package would be ignored # 2024-12-28T23:20:40,206 ############################ 2024-12-28T23:20:40,206 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2024-12-28T23:20:40,207 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,208 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,208 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2024-12-28T23:20:40,209 to the `packages` configuration field. 2024-12-28T23:20:40,210 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,210 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,211 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,212 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,213 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,215 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2024-12-28T23:20:40,215 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2024-12-28T23:20:40,216 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,216 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,217 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,219 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,220 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,221 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,222 even if it does not contain any `.py` files. 2024-12-28T23:20:40,222 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,222 directory, all directories are treated like packages. 2024-12-28T23:20:40,223 ******************************************************************************** 2024-12-28T23:20:40,224 !! 2024-12-28T23:20:40,225 check.warn(importable) 2024-12-28T23:20:40,225 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2024-12-28T23:20:40,226 !! 2024-12-28T23:20:40,227 ******************************************************************************** 2024-12-28T23:20:40,227 ############################ 2024-12-28T23:20:40,228 # Package would be ignored # 2024-12-28T23:20:40,228 ############################ 2024-12-28T23:20:40,229 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2024-12-28T23:20:40,229 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,230 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,230 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2024-12-28T23:20:40,231 to the `packages` configuration field. 2024-12-28T23:20:40,233 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,233 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,234 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,235 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,236 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,237 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2024-12-28T23:20:40,237 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2024-12-28T23:20:40,238 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,239 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,240 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,242 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,244 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,245 even if it does not contain any `.py` files. 2024-12-28T23:20:40,245 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,246 directory, all directories are treated like packages. 2024-12-28T23:20:40,246 ******************************************************************************** 2024-12-28T23:20:40,248 !! 2024-12-28T23:20:40,248 check.warn(importable) 2024-12-28T23:20:40,249 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2024-12-28T23:20:40,249 !! 2024-12-28T23:20:40,251 ******************************************************************************** 2024-12-28T23:20:40,253 ############################ 2024-12-28T23:20:40,256 # Package would be ignored # 2024-12-28T23:20:40,257 ############################ 2024-12-28T23:20:40,257 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2024-12-28T23:20:40,258 but it is absent from setuptools' `packages` configuration. 2024-12-28T23:20:40,259 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-28T23:20:40,259 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2024-12-28T23:20:40,260 to the `packages` configuration field. 2024-12-28T23:20:40,262 Alternatively, you can also rely on setuptools' discovery methods 2024-12-28T23:20:40,262 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-28T23:20:40,262 instead of `find_packages(...)`/`find:`). 2024-12-28T23:20:40,263 You can read more about "package discovery" on setuptools documentation page: 2024-12-28T23:20:40,264 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-28T23:20:40,265 If you don't want 'evalscope.registry.tasks' to be distributed and are 2024-12-28T23:20:40,268 already explicitly excluding 'evalscope.registry.tasks' via 2024-12-28T23:20:40,270 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-28T23:20:40,271 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-28T23:20:40,274 combination with a more fine grained `package-data` configuration. 2024-12-28T23:20:40,280 You can read more about "package data files" on setuptools documentation page: 2024-12-28T23:20:40,282 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-28T23:20:40,284 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-28T23:20:40,285 even if it does not contain any `.py` files. 2024-12-28T23:20:40,285 On the other hand, currently there is no concept of package data 2024-12-28T23:20:40,286 directory, all directories are treated like packages. 2024-12-28T23:20:40,287 ******************************************************************************** 2024-12-28T23:20:40,289 !! 2024-12-28T23:20:40,290 check.warn(importable) 2024-12-28T23:20:40,290 creating build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,291 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,291 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,292 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,293 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,293 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,294 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,295 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,296 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,296 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,297 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,297 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2024-12-28T23:20:40,298 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,298 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,299 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,300 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,301 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,302 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,302 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,303 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,303 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,304 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,304 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,305 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,305 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,306 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,306 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,307 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,307 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,308 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,308 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,309 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,309 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,310 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,311 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,311 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,312 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,313 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,313 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,314 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,315 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:40,316 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:40,318 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:40,318 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:40,321 creating build/lib/evalscope/metrics/resources 2024-12-28T23:20:40,324 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2024-12-28T23:20:40,326 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2024-12-28T23:20:40,327 creating build/lib/evalscope/registry/config 2024-12-28T23:20:40,328 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2024-12-28T23:20:40,328 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2024-12-28T23:20:40,329 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2024-12-28T23:20:40,329 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2024-12-28T23:20:40,330 creating build/lib/evalscope/registry/data 2024-12-28T23:20:40,330 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2024-12-28T23:20:40,331 creating build/lib/evalscope/registry/data/prompt_template 2024-12-28T23:20:40,332 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-28T23:20:40,332 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2024-12-28T23:20:40,333 creating build/lib/evalscope/registry/data/qa_browser 2024-12-28T23:20:40,333 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2024-12-28T23:20:40,334 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2024-12-28T23:20:40,352 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,354 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2024-12-28T23:20:40,357 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2024-12-28T23:20:40,360 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2024-12-28T23:20:40,362 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,365 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-28T23:20:40,367 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2024-12-28T23:20:40,370 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,372 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,375 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,378 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:40,381 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:40,384 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2024-12-28T23:20:40,386 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:40,389 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:40,392 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:40,395 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2024-12-28T23:20:40,451 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-28T23:20:40,452 !! 2024-12-28T23:20:40,453 ******************************************************************************** 2024-12-28T23:20:40,454 Please avoid running ``setup.py`` directly. 2024-12-28T23:20:40,454 Instead, use pypa/build, pypa/installer or other 2024-12-28T23:20:40,455 standards-based tools. 2024-12-28T23:20:40,455 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-28T23:20:40,456 ******************************************************************************** 2024-12-28T23:20:40,457 !! 2024-12-28T23:20:40,458 self.initialize_options() 2024-12-28T23:20:40,484 installing to build/bdist.linux-armv7l/wheel 2024-12-28T23:20:40,485 running install 2024-12-28T23:20:40,510 running install_lib 2024-12-28T23:20:40,540 creating build/bdist.linux-armv7l/wheel 2024-12-28T23:20:40,543 creating build/bdist.linux-armv7l/wheel/evalscope 2024-12-28T23:20:40,546 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2024-12-28T23:20:40,548 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2024-12-28T23:20:40,550 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-28T23:20:40,553 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-28T23:20:40,556 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2024-12-28T23:20:40,559 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2024-12-28T23:20:40,560 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-28T23:20:40,563 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-28T23:20:40,565 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2024-12-28T23:20:40,568 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2024-12-28T23:20:40,570 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-28T23:20:40,572 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-28T23:20:40,575 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2024-12-28T23:20:40,579 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2024-12-28T23:20:40,580 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-28T23:20:40,582 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2024-12-28T23:20:40,587 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,588 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,591 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,593 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,596 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,599 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,602 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,605 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,607 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,610 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,613 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,615 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,618 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,620 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,623 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,625 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,628 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,630 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,633 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,635 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,638 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,641 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,643 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,646 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,648 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,650 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,653 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,656 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2024-12-28T23:20:40,659 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,660 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,662 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,665 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,667 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2024-12-28T23:20:40,670 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2024-12-28T23:20:40,671 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-28T23:20:40,673 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-28T23:20:40,676 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-28T23:20:40,678 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2024-12-28T23:20:40,680 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2024-12-28T23:20:40,681 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-28T23:20:40,684 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-28T23:20:40,686 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2024-12-28T23:20:40,689 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2024-12-28T23:20:40,691 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-28T23:20:40,693 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-28T23:20:40,696 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-28T23:20:40,698 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2024-12-28T23:20:40,700 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-28T23:20:40,703 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2024-12-28T23:20:40,704 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-28T23:20:40,706 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-28T23:20:40,708 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2024-12-28T23:20:40,711 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-28T23:20:40,713 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2024-12-28T23:20:40,714 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-28T23:20:40,717 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-28T23:20:40,719 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2024-12-28T23:20:40,722 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2024-12-28T23:20:40,723 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-28T23:20:40,725 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-28T23:20:40,727 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-28T23:20:40,730 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2024-12-28T23:20:40,731 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2024-12-28T23:20:40,735 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,736 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,739 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,741 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,743 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2024-12-28T23:20:40,746 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2024-12-28T23:20:40,747 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-28T23:20:40,749 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2024-12-28T23:20:40,753 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2024-12-28T23:20:40,756 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2024-12-28T23:20:40,757 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-28T23:20:40,760 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-28T23:20:40,762 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2024-12-28T23:20:40,764 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-28T23:20:40,766 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2024-12-28T23:20:40,768 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2024-12-28T23:20:40,770 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-28T23:20:40,772 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-28T23:20:40,774 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2024-12-28T23:20:40,777 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2024-12-28T23:20:40,779 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2024-12-28T23:20:40,782 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,783 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,786 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,788 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,790 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,791 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2024-12-28T23:20:40,794 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-28T23:20:40,796 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,798 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,800 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,801 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,803 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,806 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2024-12-28T23:20:40,808 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:40,809 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:40,812 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,813 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,816 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2024-12-28T23:20:40,818 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:40,819 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:40,822 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2024-12-28T23:20:40,825 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:40,826 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:40,828 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:40,830 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:40,832 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2024-12-28T23:20:40,835 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2024-12-28T23:20:40,838 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:40,839 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:40,841 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:40,843 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:40,845 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2024-12-28T23:20:40,847 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,848 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,850 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,853 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,855 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,857 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,860 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,862 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,865 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2024-12-28T23:20:40,868 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2024-12-28T23:20:40,869 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-28T23:20:40,872 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-28T23:20:40,875 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2024-12-28T23:20:40,876 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-28T23:20:40,878 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-28T23:20:40,881 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2024-12-28T23:20:40,882 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2024-12-28T23:20:40,885 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2024-12-28T23:20:40,887 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,890 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,893 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,895 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2024-12-28T23:20:40,896 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,898 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,900 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,902 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,905 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,907 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,909 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,911 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2024-12-28T23:20:40,913 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2024-12-28T23:20:40,915 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-28T23:20:40,917 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-28T23:20:40,919 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2024-12-28T23:20:40,921 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-28T23:20:40,923 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2024-12-28T23:20:40,925 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2024-12-28T23:20:40,928 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,930 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2024-12-28T23:20:40,931 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-28T23:20:40,934 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-28T23:20:40,936 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-28T23:20:40,938 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-28T23:20:40,940 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2024-12-28T23:20:40,942 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2024-12-28T23:20:40,943 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-28T23:20:40,965 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2024-12-28T23:20:40,979 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:40,980 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:40,983 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2024-12-28T23:20:40,985 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,987 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:40,990 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2024-12-28T23:20:40,992 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-28T23:20:40,995 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2024-12-28T23:20:40,997 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:40,999 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:41,002 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:41,005 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:41,007 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:41,009 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2024-12-28T23:20:41,012 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2024-12-28T23:20:41,014 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-28T23:20:41,017 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2024-12-28T23:20:41,019 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,021 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,023 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,025 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,027 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,029 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,031 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,033 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2024-12-28T23:20:41,036 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2024-12-28T23:20:41,037 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-28T23:20:41,040 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-28T23:20:41,042 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-28T23:20:41,044 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-28T23:20:41,046 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2024-12-28T23:20:41,048 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2024-12-28T23:20:41,050 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-28T23:20:41,051 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-28T23:20:41,053 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-28T23:20:41,056 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2024-12-28T23:20:41,059 creating build/bdist.linux-armv7l/wheel/evalscope/models 2024-12-28T23:20:41,060 copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-28T23:20:41,062 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-28T23:20:41,065 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-28T23:20:41,066 copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-28T23:20:41,069 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2024-12-28T23:20:41,070 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-28T23:20:41,072 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2024-12-28T23:20:41,074 copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2024-12-28T23:20:41,077 creating build/bdist.linux-armv7l/wheel/evalscope/models/api 2024-12-28T23:20:41,078 copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-28T23:20:41,080 copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api 2024-12-28T23:20:41,083 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2024-12-28T23:20:41,084 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2024-12-28T23:20:41,087 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2024-12-28T23:20:41,088 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,090 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,093 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,094 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,097 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,099 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,101 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,105 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,107 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,109 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,114 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2024-12-28T23:20:41,119 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,121 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,123 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2024-12-28T23:20:41,126 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2024-12-28T23:20:41,127 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-28T23:20:41,130 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2024-12-28T23:20:41,132 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2024-12-28T23:20:41,133 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,136 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,139 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,141 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,143 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,145 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:41,146 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:41,149 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2024-12-28T23:20:41,153 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,156 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,160 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2024-12-28T23:20:41,164 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2024-12-28T23:20:41,166 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2024-12-28T23:20:41,168 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-28T23:20:41,171 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-28T23:20:41,173 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-28T23:20:41,176 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2024-12-28T23:20:41,178 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2024-12-28T23:20:41,181 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2024-12-28T23:20:41,183 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2024-12-28T23:20:41,185 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-28T23:20:41,188 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2024-12-28T23:20:41,192 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2024-12-28T23:20:41,198 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2024-12-28T23:20:41,200 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-28T23:20:41,205 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2024-12-28T23:20:41,235 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2024-12-28T23:20:41,237 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,239 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,241 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,243 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,245 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,247 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,249 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,251 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,253 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,255 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,257 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2024-12-28T23:20:41,260 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2024-12-28T23:20:41,261 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,264 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,266 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,268 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,270 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,271 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2024-12-28T23:20:41,273 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:41,276 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2024-12-28T23:20:41,280 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2024-12-28T23:20:41,281 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-28T23:20:41,285 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-28T23:20:41,287 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-28T23:20:41,291 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2024-12-28T23:20:41,294 creating build/bdist.linux-armv7l/wheel/tests 2024-12-28T23:20:41,296 creating build/bdist.linux-armv7l/wheel/tests/vlm 2024-12-28T23:20:41,298 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-28T23:20:41,300 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2024-12-28T23:20:41,302 creating build/bdist.linux-armv7l/wheel/tests/swift 2024-12-28T23:20:41,303 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-28T23:20:41,307 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-28T23:20:41,310 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-28T23:20:41,316 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2024-12-28T23:20:41,322 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-28T23:20:41,326 creating build/bdist.linux-armv7l/wheel/tests/perf 2024-12-28T23:20:41,327 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-28T23:20:41,329 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2024-12-28T23:20:41,331 creating build/bdist.linux-armv7l/wheel/tests/rag 2024-12-28T23:20:41,333 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-28T23:20:41,334 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-28T23:20:41,337 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-28T23:20:41,338 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2024-12-28T23:20:41,340 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2024-12-28T23:20:41,342 creating build/bdist.linux-armv7l/wheel/tests/cli 2024-12-28T23:20:41,343 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-28T23:20:41,345 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2024-12-28T23:20:41,347 running install_egg_info 2024-12-28T23:20:41,382 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.8.2-py3.11.egg-info 2024-12-28T23:20:41,396 running install_scripts 2024-12-28T23:20:41,446 creating build/bdist.linux-armv7l/wheel/evalscope-0.8.2.dist-info/WHEEL 2024-12-28T23:20:41,449 creating '/tmp/pip-wheel-1_zv0rhj/evalscope-0.8.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-28T23:20:41,452 adding 'evalscope/__init__.py' 2024-12-28T23:20:41,454 adding 'evalscope/arguments.py' 2024-12-28T23:20:41,457 adding 'evalscope/config.py' 2024-12-28T23:20:41,459 adding 'evalscope/constants.py' 2024-12-28T23:20:41,461 adding 'evalscope/run.py' 2024-12-28T23:20:41,463 adding 'evalscope/run_arena.py' 2024-12-28T23:20:41,466 adding 'evalscope/summarizer.py' 2024-12-28T23:20:41,467 adding 'evalscope/version.py' 2024-12-28T23:20:41,469 adding 'evalscope/backend/__init__.py' 2024-12-28T23:20:41,471 adding 'evalscope/backend/base.py' 2024-12-28T23:20:41,473 adding 'evalscope/backend/opencompass/__init__.py' 2024-12-28T23:20:41,475 adding 'evalscope/backend/opencompass/api_meta_template.py' 2024-12-28T23:20:41,477 adding 'evalscope/backend/opencompass/backend_manager.py' 2024-12-28T23:20:41,479 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2024-12-28T23:20:41,481 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2024-12-28T23:20:41,483 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2024-12-28T23:20:41,485 adding 'evalscope/backend/rag_eval/__init__.py' 2024-12-28T23:20:41,487 adding 'evalscope/backend/rag_eval/backend_manager.py' 2024-12-28T23:20:41,489 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2024-12-28T23:20:41,491 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2024-12-28T23:20:41,493 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2024-12-28T23:20:41,495 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2024-12-28T23:20:41,497 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2024-12-28T23:20:41,498 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2024-12-28T23:20:41,501 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2024-12-28T23:20:41,503 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2024-12-28T23:20:41,506 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2024-12-28T23:20:41,507 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2024-12-28T23:20:41,509 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2024-12-28T23:20:41,511 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2024-12-28T23:20:41,513 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2024-12-28T23:20:41,514 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2024-12-28T23:20:41,517 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2024-12-28T23:20:41,519 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2024-12-28T23:20:41,521 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2024-12-28T23:20:41,523 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2024-12-28T23:20:41,525 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2024-12-28T23:20:41,527 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2024-12-28T23:20:41,529 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2024-12-28T23:20:41,531 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2024-12-28T23:20:41,534 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2024-12-28T23:20:41,535 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2024-12-28T23:20:41,537 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2024-12-28T23:20:41,538 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2024-12-28T23:20:41,540 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2024-12-28T23:20:41,541 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2024-12-28T23:20:41,543 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2024-12-28T23:20:41,544 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2024-12-28T23:20:41,546 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2024-12-28T23:20:41,547 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2024-12-28T23:20:41,549 adding 'evalscope/backend/rag_eval/utils/clip.py' 2024-12-28T23:20:41,550 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2024-12-28T23:20:41,552 adding 'evalscope/backend/rag_eval/utils/llm.py' 2024-12-28T23:20:41,553 adding 'evalscope/backend/rag_eval/utils/tools.py' 2024-12-28T23:20:41,555 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2024-12-28T23:20:41,556 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2024-12-28T23:20:41,557 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2024-12-28T23:20:41,559 adding 'evalscope/benchmarks/__init__.py' 2024-12-28T23:20:41,561 adding 'evalscope/benchmarks/benchmark.py' 2024-12-28T23:20:41,563 adding 'evalscope/benchmarks/data_adapter.py' 2024-12-28T23:20:41,565 adding 'evalscope/benchmarks/arc/__init__.py' 2024-12-28T23:20:41,566 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2024-12-28T23:20:41,568 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2024-12-28T23:20:41,570 adding 'evalscope/benchmarks/bbh/__init__.py' 2024-12-28T23:20:41,572 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2024-12-28T23:20:41,574 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2024-12-28T23:20:41,575 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2024-12-28T23:20:41,577 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2024-12-28T23:20:41,578 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2024-12-28T23:20:41,579 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2024-12-28T23:20:41,582 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2024-12-28T23:20:41,583 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2024-12-28T23:20:41,585 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2024-12-28T23:20:41,586 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2024-12-28T23:20:41,587 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2024-12-28T23:20:41,589 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2024-12-28T23:20:41,590 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2024-12-28T23:20:41,591 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2024-12-28T23:20:41,592 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2024-12-28T23:20:41,594 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2024-12-28T23:20:41,595 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2024-12-28T23:20:41,596 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2024-12-28T23:20:41,598 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2024-12-28T23:20:41,599 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2024-12-28T23:20:41,600 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2024-12-28T23:20:41,602 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2024-12-28T23:20:41,603 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2024-12-28T23:20:41,604 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2024-12-28T23:20:41,605 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2024-12-28T23:20:41,607 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2024-12-28T23:20:41,608 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2024-12-28T23:20:41,609 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2024-12-28T23:20:41,611 adding 'evalscope/benchmarks/ceval/__init__.py' 2024-12-28T23:20:41,614 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2024-12-28T23:20:41,615 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2024-12-28T23:20:41,617 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2024-12-28T23:20:41,619 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2024-12-28T23:20:41,620 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2024-12-28T23:20:41,622 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2024-12-28T23:20:41,623 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2024-12-28T23:20:41,626 adding 'evalscope/benchmarks/competition_math/__init__.py' 2024-12-28T23:20:41,627 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2024-12-28T23:20:41,629 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2024-12-28T23:20:41,631 adding 'evalscope/benchmarks/general_qa/__init__.py' 2024-12-28T23:20:41,633 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2024-12-28T23:20:41,635 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2024-12-28T23:20:41,636 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2024-12-28T23:20:41,638 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2024-12-28T23:20:41,640 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2024-12-28T23:20:41,641 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2024-12-28T23:20:41,643 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2024-12-28T23:20:41,645 adding 'evalscope/benchmarks/humaneval/__init__.py' 2024-12-28T23:20:41,647 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2024-12-28T23:20:41,648 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2024-12-28T23:20:41,650 adding 'evalscope/benchmarks/mmlu/__init__.py' 2024-12-28T23:20:41,652 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2024-12-28T23:20:41,654 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2024-12-28T23:20:41,655 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2024-12-28T23:20:41,658 adding 'evalscope/benchmarks/race/__init__.py' 2024-12-28T23:20:41,659 adding 'evalscope/benchmarks/race/race.py' 2024-12-28T23:20:41,661 adding 'evalscope/benchmarks/race/race_adapter.py' 2024-12-28T23:20:41,663 adding 'evalscope/benchmarks/race/samples.jsonl' 2024-12-28T23:20:41,664 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2024-12-28T23:20:41,666 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2024-12-28T23:20:41,667 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2024-12-28T23:20:41,669 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2024-12-28T23:20:41,670 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2024-12-28T23:20:41,672 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2024-12-28T23:20:41,674 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2024-12-28T23:20:41,676 adding 'evalscope/cli/__init__.py' 2024-12-28T23:20:41,677 adding 'evalscope/cli/base.py' 2024-12-28T23:20:41,678 adding 'evalscope/cli/cli.py' 2024-12-28T23:20:41,680 adding 'evalscope/cli/start_eval.py' 2024-12-28T23:20:41,681 adding 'evalscope/cli/start_perf.py' 2024-12-28T23:20:41,682 adding 'evalscope/cli/start_server.py' 2024-12-28T23:20:41,684 adding 'evalscope/evaluator/__init__.py' 2024-12-28T23:20:41,686 adding 'evalscope/evaluator/evaluator.py' 2024-12-28T23:20:41,688 adding 'evalscope/evaluator/rating_eval.py' 2024-12-28T23:20:41,689 adding 'evalscope/evaluator/reviewer/__init__.py' 2024-12-28T23:20:41,692 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2024-12-28T23:20:41,693 adding 'evalscope/metrics/__init__.py' 2024-12-28T23:20:41,695 adding 'evalscope/metrics/code_metric.py' 2024-12-28T23:20:41,696 adding 'evalscope/metrics/math_accuracy.py' 2024-12-28T23:20:41,698 adding 'evalscope/metrics/metrics.py' 2024-12-28T23:20:41,700 adding 'evalscope/metrics/rouge_metric.py' 2024-12-28T23:20:41,701 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2024-12-28T23:20:41,703 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2024-12-28T23:20:41,862 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2024-12-28T23:20:42,108 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2024-12-28T23:20:42,118 adding 'evalscope/models/__init__.py' 2024-12-28T23:20:42,120 adding 'evalscope/models/dummy_chat_model.py' 2024-12-28T23:20:42,121 adding 'evalscope/models/model.py' 2024-12-28T23:20:42,124 adding 'evalscope/models/model_adapter.py' 2024-12-28T23:20:42,125 adding 'evalscope/models/openai_model.py' 2024-12-28T23:20:42,127 adding 'evalscope/models/api/__init__.py' 2024-12-28T23:20:42,129 adding 'evalscope/models/api/openai_api.py' 2024-12-28T23:20:42,130 adding 'evalscope/models/custom/__init__.py' 2024-12-28T23:20:42,131 adding 'evalscope/models/custom/custom_model.py' 2024-12-28T23:20:42,134 adding 'evalscope/perf/__init__.py' 2024-12-28T23:20:42,135 adding 'evalscope/perf/arguments.py' 2024-12-28T23:20:42,137 adding 'evalscope/perf/benchmark.py' 2024-12-28T23:20:42,139 adding 'evalscope/perf/http_client.py' 2024-12-28T23:20:42,140 adding 'evalscope/perf/main.py' 2024-12-28T23:20:42,142 adding 'evalscope/perf/plugin/__init__.py' 2024-12-28T23:20:42,143 adding 'evalscope/perf/plugin/registry.py' 2024-12-28T23:20:42,145 adding 'evalscope/perf/plugin/api/__init__.py' 2024-12-28T23:20:42,147 adding 'evalscope/perf/plugin/api/base.py' 2024-12-28T23:20:42,148 adding 'evalscope/perf/plugin/api/custom_api.py' 2024-12-28T23:20:42,149 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2024-12-28T23:20:42,151 adding 'evalscope/perf/plugin/api/openai_api.py' 2024-12-28T23:20:42,153 adding 'evalscope/perf/plugin/datasets/__init__.py' 2024-12-28T23:20:42,154 adding 'evalscope/perf/plugin/datasets/base.py' 2024-12-28T23:20:42,156 adding 'evalscope/perf/plugin/datasets/custom.py' 2024-12-28T23:20:42,157 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2024-12-28T23:20:42,158 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2024-12-28T23:20:42,160 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2024-12-28T23:20:42,161 adding 'evalscope/perf/plugin/datasets/openqa.py' 2024-12-28T23:20:42,162 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2024-12-28T23:20:42,164 adding 'evalscope/perf/utils/__init__.py' 2024-12-28T23:20:42,166 adding 'evalscope/perf/utils/analysis_result.py' 2024-12-28T23:20:42,167 adding 'evalscope/perf/utils/benchmark_util.py' 2024-12-28T23:20:42,169 adding 'evalscope/perf/utils/db_util.py' 2024-12-28T23:20:42,170 adding 'evalscope/perf/utils/handler.py' 2024-12-28T23:20:42,171 adding 'evalscope/perf/utils/local_server.py' 2024-12-28T23:20:42,173 adding 'evalscope/registry/__init__.py' 2024-12-28T23:20:42,175 adding 'evalscope/registry/config/cfg_arena.yaml' 2024-12-28T23:20:42,176 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2024-12-28T23:20:42,178 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2024-12-28T23:20:42,179 adding 'evalscope/registry/config/cfg_single.yaml' 2024-12-28T23:20:42,182 adding 'evalscope/registry/data/question.jsonl' 2024-12-28T23:20:42,184 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2024-12-28T23:20:42,186 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2024-12-28T23:20:42,350 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2024-12-28T23:20:42,359 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2024-12-28T23:20:42,361 adding 'evalscope/registry/tasks/arc.yaml' 2024-12-28T23:20:42,362 adding 'evalscope/registry/tasks/bbh.yaml' 2024-12-28T23:20:42,363 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2024-12-28T23:20:42,365 adding 'evalscope/registry/tasks/ceval.yaml' 2024-12-28T23:20:42,366 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2024-12-28T23:20:42,367 adding 'evalscope/registry/tasks/cmmlu.yaml' 2024-12-28T23:20:42,368 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2024-12-28T23:20:42,369 adding 'evalscope/registry/tasks/general_qa.yaml' 2024-12-28T23:20:42,371 adding 'evalscope/registry/tasks/gsm8k.yaml' 2024-12-28T23:20:42,372 adding 'evalscope/registry/tasks/mmlu.yaml' 2024-12-28T23:20:42,373 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2024-12-28T23:20:42,375 adding 'evalscope/third_party/__init__.py' 2024-12-28T23:20:42,377 adding 'evalscope/third_party/longbench_write/README.md' 2024-12-28T23:20:42,378 adding 'evalscope/third_party/longbench_write/__init__.py' 2024-12-28T23:20:42,380 adding 'evalscope/third_party/longbench_write/default_task.json' 2024-12-28T23:20:42,381 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2024-12-28T23:20:42,383 adding 'evalscope/third_party/longbench_write/eval.py' 2024-12-28T23:20:42,384 adding 'evalscope/third_party/longbench_write/infer.py' 2024-12-28T23:20:42,386 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2024-12-28T23:20:42,387 adding 'evalscope/third_party/longbench_write/utils.py' 2024-12-28T23:20:42,389 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2024-12-28T23:20:42,390 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2024-12-28T23:20:42,398 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2024-12-28T23:20:42,402 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2024-12-28T23:20:42,403 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2024-12-28T23:20:42,405 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2024-12-28T23:20:42,407 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2024-12-28T23:20:42,409 adding 'evalscope/third_party/toolbench_static/README.md' 2024-12-28T23:20:42,410 adding 'evalscope/third_party/toolbench_static/__init__.py' 2024-12-28T23:20:42,412 adding 'evalscope/third_party/toolbench_static/config_default.json' 2024-12-28T23:20:42,413 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2024-12-28T23:20:42,414 adding 'evalscope/third_party/toolbench_static/eval.py' 2024-12-28T23:20:42,416 adding 'evalscope/third_party/toolbench_static/infer.py' 2024-12-28T23:20:42,418 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2024-12-28T23:20:42,419 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2024-12-28T23:20:42,421 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2024-12-28T23:20:42,422 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2024-12-28T23:20:42,424 adding 'evalscope/tools/__init__.py' 2024-12-28T23:20:42,425 adding 'evalscope/tools/combine_reports.py' 2024-12-28T23:20:42,427 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2024-12-28T23:20:42,428 adding 'evalscope/tools/rewrite_eval_results.py' 2024-12-28T23:20:42,429 adding 'evalscope/utils/__init__.py' 2024-12-28T23:20:42,431 adding 'evalscope/utils/arena_utils.py' 2024-12-28T23:20:42,433 adding 'evalscope/utils/chat_service.py' 2024-12-28T23:20:42,434 adding 'evalscope/utils/completion_parsers.py' 2024-12-28T23:20:42,435 adding 'evalscope/utils/io_utils.py' 2024-12-28T23:20:42,437 adding 'evalscope/utils/logger.py' 2024-12-28T23:20:42,438 adding 'evalscope/utils/model_utils.py' 2024-12-28T23:20:42,440 adding 'evalscope/utils/utils.py' 2024-12-28T23:20:42,443 adding 'tests/__init__.py' 2024-12-28T23:20:42,444 adding 'tests/test_run_all.py' 2024-12-28T23:20:42,445 adding 'tests/cli/__init__.py' 2024-12-28T23:20:42,447 adding 'tests/cli/test_run.py' 2024-12-28T23:20:42,449 adding 'tests/perf/__init__.py' 2024-12-28T23:20:42,450 adding 'tests/perf/test_perf.py' 2024-12-28T23:20:42,451 adding 'tests/rag/__init__.py' 2024-12-28T23:20:42,453 adding 'tests/rag/test_clip_benchmark.py' 2024-12-28T23:20:42,454 adding 'tests/rag/test_mteb.py' 2024-12-28T23:20:42,456 adding 'tests/rag/test_ragas.py' 2024-12-28T23:20:42,458 adding 'tests/swift/__init__.py' 2024-12-28T23:20:42,459 adding 'tests/swift/test_run_swift_eval.py' 2024-12-28T23:20:42,461 adding 'tests/swift/test_run_swift_vlm_eval.py' 2024-12-28T23:20:42,462 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2024-12-28T23:20:42,465 adding 'tests/vlm/__init__.py' 2024-12-28T23:20:42,466 adding 'tests/vlm/test_vlmeval.py' 2024-12-28T23:20:42,468 adding 'evalscope-0.8.2.dist-info/LICENSE' 2024-12-28T23:20:42,471 adding 'evalscope-0.8.2.dist-info/METADATA' 2024-12-28T23:20:42,472 adding 'evalscope-0.8.2.dist-info/WHEEL' 2024-12-28T23:20:42,473 adding 'evalscope-0.8.2.dist-info/entry_points.txt' 2024-12-28T23:20:42,474 adding 'evalscope-0.8.2.dist-info/top_level.txt' 2024-12-28T23:20:42,478 adding 'evalscope-0.8.2.dist-info/RECORD' 2024-12-28T23:20:42,497 removing build/bdist.linux-armv7l/wheel 2024-12-28T23:20:42,695 Building wheel for evalscope (setup.py): finished with status 'done' 2024-12-28T23:20:42,712 Created wheel for evalscope: filename=evalscope-0.8.2-py3-none-any.whl size=1389293 sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 2024-12-28T23:20:42,713 Stored in directory: /tmp/pip-ephem-wheel-cache-vw7o4iyt/wheels/63/06/9d/c51bb55361e09eed7d1bda742639af7a7833fe4a3c484dfbcf 2024-12-28T23:20:42,739 Successfully built evalscope 2024-12-28T23:20:42,775 Removed build tracker: '/tmp/pip-build-tracker-649t13sy'