2025-01-20T12:12:33,751 Created temporary directory: /tmp/pip-build-tracker-t8tjn79l 2025-01-20T12:12:33,752 Initialized build tracking at /tmp/pip-build-tracker-t8tjn79l 2025-01-20T12:12:33,753 Created build tracker: /tmp/pip-build-tracker-t8tjn79l 2025-01-20T12:12:33,753 Entered build tracker: /tmp/pip-build-tracker-t8tjn79l 2025-01-20T12:12:33,754 Created temporary directory: /tmp/pip-wheel-i_4i9ia3 2025-01-20T12:12:33,758 Created temporary directory: /tmp/pip-ephem-wheel-cache-tleyhwgl 2025-01-20T12:12:33,802 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-01-20T12:12:33,805 2 location(s) to search for versions of evalscope: 2025-01-20T12:12:33,805 * https://pypi.org/simple/evalscope/ 2025-01-20T12:12:33,805 * https://www.piwheels.org/simple/evalscope/ 2025-01-20T12:12:33,805 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-01-20T12:12:33,806 Getting page https://pypi.org/simple/evalscope/ 2025-01-20T12:12:33,808 Found index url https://pypi.org/simple/ 2025-01-20T12:12:34,028 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-01-20T12:12:34,036 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,037 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-01-20T12:12:34,038 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,039 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-01-20T12:12:34,040 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,041 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-01-20T12:12:34,041 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,042 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-01-20T12:12:34,043 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,044 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-01-20T12:12:34,045 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,046 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,047 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-01-20T12:12:34,047 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,048 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-01-20T12:12:34,049 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,050 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-01-20T12:12:34,050 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,051 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-01-20T12:12:34,052 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,053 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-01-20T12:12:34,053 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,054 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-01-20T12:12:34,055 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,056 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-01-20T12:12:34,057 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,058 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-01-20T12:12:34,059 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,060 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-01-20T12:12:34,060 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,061 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-01-20T12:12:34,062 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,062 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-01-20T12:12:34,063 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,064 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-01-20T12:12:34,065 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,065 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-01-20T12:12:34,066 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-01-20T12:12:34,067 Getting page https://www.piwheels.org/simple/evalscope/ 2025-01-20T12:12:34,068 Found index url https://www.piwheels.org/simple/ 2025-01-20T12:12:34,240 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-01-20T12:12:34,243 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,243 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,244 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,245 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,246 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,246 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,246 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-20T12:12:34,247 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-01-20T12:12:34,247 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-01-20T12:12:34,268 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-01-20T12:12:34,270 Collecting evalscope==0.10.0 2025-01-20T12:12:34,272 Created temporary directory: /tmp/pip-unpack-jlrz4xyl 2025-01-20T12:12:34,493 Downloading evalscope-0.10.0.tar.gz (1.3 MB) 2025-01-20T12:12:35,566 Added evalscope==0.10.0 from https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz to build tracker '/tmp/pip-build-tracker-t8tjn79l' 2025-01-20T12:12:35,568 Running setup.py (path:/tmp/pip-wheel-i_4i9ia3/evalscope_921b1d5703c746fa9d35cd0a89bedb18/setup.py) egg_info for package evalscope 2025-01-20T12:12:35,569 Created temporary directory: /tmp/pip-pip-egg-info-9f95kdm0 2025-01-20T12:12:35,569 Preparing metadata (setup.py): started 2025-01-20T12:12:35,571 Running command python setup.py egg_info 2025-01-20T12:12:36,160 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-20T12:12:36,161 !! 2025-01-20T12:12:36,162 ******************************************************************************** 2025-01-20T12:12:36,163 Usage of dash-separated 'index-url' will not be supported in future 2025-01-20T12:12:36,163 versions. Please use the underscore name 'index_url' instead. 2025-01-20T12:12:36,164 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-20T12:12:36,165 or your builds will no longer be supported. 2025-01-20T12:12:36,166 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-20T12:12:36,167 ******************************************************************************** 2025-01-20T12:12:36,168 !! 2025-01-20T12:12:36,168 opt = self.warn_dash_deprecation(opt, section) 2025-01-20T12:12:36,742 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-20T12:12:36,743 !! 2025-01-20T12:12:36,744 ******************************************************************************** 2025-01-20T12:12:36,744 Usage of dash-separated 'index-url' will not be supported in future 2025-01-20T12:12:36,745 versions. Please use the underscore name 'index_url' instead. 2025-01-20T12:12:36,746 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-20T12:12:36,747 or your builds will no longer be supported. 2025-01-20T12:12:36,748 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-20T12:12:36,749 ******************************************************************************** 2025-01-20T12:12:36,750 !! 2025-01-20T12:12:36,751 opt = self.warn_dash_deprecation(opt, section) 2025-01-20T12:12:36,780 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-20T12:12:36,781 running egg_info 2025-01-20T12:12:36,808 creating /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info 2025-01-20T12:12:36,809 writing /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/PKG-INFO 2025-01-20T12:12:36,838 writing dependency_links to /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/dependency_links.txt 2025-01-20T12:12:36,839 writing entry points to /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/entry_points.txt 2025-01-20T12:12:36,854 writing requirements to /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/requires.txt 2025-01-20T12:12:36,855 writing top-level names to /tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/top_level.txt 2025-01-20T12:12:36,856 writing manifest file '/tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/SOURCES.txt' 2025-01-20T12:12:37,008 reading manifest file '/tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/SOURCES.txt' 2025-01-20T12:12:37,010 reading manifest template 'MANIFEST.in' 2025-01-20T12:12:37,129 adding license file 'LICENSE' 2025-01-20T12:12:37,143 writing manifest file '/tmp/pip-pip-egg-info-9f95kdm0/evalscope.egg-info/SOURCES.txt' 2025-01-20T12:12:37,252 Preparing metadata (setup.py): finished with status 'done' 2025-01-20T12:12:37,259 Source in /tmp/pip-wheel-i_4i9ia3/evalscope_921b1d5703c746fa9d35cd0a89bedb18 has version 0.10.0, which satisfies requirement evalscope==0.10.0 from https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz 2025-01-20T12:12:37,260 Removed evalscope==0.10.0 from https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz from build tracker '/tmp/pip-build-tracker-t8tjn79l' 2025-01-20T12:12:37,318 Created temporary directory: /tmp/pip-unpack-xyyhvzkj 2025-01-20T12:12:37,319 Created temporary directory: /tmp/pip-unpack-io5zc9m8 2025-01-20T12:12:37,320 Building wheels for collected packages: evalscope 2025-01-20T12:12:37,324 Created temporary directory: /tmp/pip-wheel-yy5_m60u 2025-01-20T12:12:37,324 Building wheel for evalscope (setup.py): started 2025-01-20T12:12:37,325 Destination directory: /tmp/pip-wheel-yy5_m60u 2025-01-20T12:12:37,326 Running command python setup.py bdist_wheel 2025-01-20T12:12:37,809 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-20T12:12:37,912 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-20T12:12:37,912 !! 2025-01-20T12:12:37,913 ******************************************************************************** 2025-01-20T12:12:37,914 Usage of dash-separated 'index-url' will not be supported in future 2025-01-20T12:12:37,914 versions. Please use the underscore name 'index_url' instead. 2025-01-20T12:12:37,915 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-20T12:12:37,916 or your builds will no longer be supported. 2025-01-20T12:12:37,917 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-20T12:12:37,918 ******************************************************************************** 2025-01-20T12:12:37,919 !! 2025-01-20T12:12:37,919 opt = self.warn_dash_deprecation(opt, section) 2025-01-20T12:12:38,492 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-20T12:12:38,493 !! 2025-01-20T12:12:38,494 ******************************************************************************** 2025-01-20T12:12:38,495 Usage of dash-separated 'index-url' will not be supported in future 2025-01-20T12:12:38,496 versions. Please use the underscore name 'index_url' instead. 2025-01-20T12:12:38,497 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-20T12:12:38,497 or your builds will no longer be supported. 2025-01-20T12:12:38,498 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-20T12:12:38,498 ******************************************************************************** 2025-01-20T12:12:38,499 !! 2025-01-20T12:12:38,500 opt = self.warn_dash_deprecation(opt, section) 2025-01-20T12:12:38,502 running bdist_wheel 2025-01-20T12:12:38,637 running build 2025-01-20T12:12:38,638 running build_py 2025-01-20T12:12:38,668 creating build/lib/evalscope 2025-01-20T12:12:38,670 copying evalscope/summarizer.py -> build/lib/evalscope 2025-01-20T12:12:38,672 copying evalscope/constants.py -> build/lib/evalscope 2025-01-20T12:12:38,674 copying evalscope/version.py -> build/lib/evalscope 2025-01-20T12:12:38,676 copying evalscope/run.py -> build/lib/evalscope 2025-01-20T12:12:38,678 copying evalscope/config.py -> build/lib/evalscope 2025-01-20T12:12:38,681 copying evalscope/__init__.py -> build/lib/evalscope 2025-01-20T12:12:38,683 copying evalscope/arguments.py -> build/lib/evalscope 2025-01-20T12:12:38,685 copying evalscope/run_arena.py -> build/lib/evalscope 2025-01-20T12:12:38,688 creating build/lib/tests 2025-01-20T12:12:38,689 copying tests/__init__.py -> build/lib/tests 2025-01-20T12:12:38,691 copying tests/test_run_all.py -> build/lib/tests 2025-01-20T12:12:38,693 creating build/lib/evalscope/models 2025-01-20T12:12:38,694 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-01-20T12:12:38,696 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-01-20T12:12:38,698 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-01-20T12:12:38,700 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-01-20T12:12:38,702 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-01-20T12:12:38,704 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-01-20T12:12:38,706 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-01-20T12:12:38,708 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-01-20T12:12:38,711 creating build/lib/evalscope/registry 2025-01-20T12:12:38,712 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-01-20T12:12:38,715 creating build/lib/evalscope/metrics 2025-01-20T12:12:38,716 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,718 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,720 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,722 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,724 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,726 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2025-01-20T12:12:38,729 creating build/lib/evalscope/utils 2025-01-20T12:12:38,730 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,732 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,734 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,737 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,738 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,740 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,742 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,744 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-01-20T12:12:38,747 creating build/lib/evalscope/perf 2025-01-20T12:12:38,748 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-01-20T12:12:38,750 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-01-20T12:12:38,752 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-01-20T12:12:38,754 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-01-20T12:12:38,757 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-01-20T12:12:38,759 creating build/lib/evalscope/cli 2025-01-20T12:12:38,760 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,762 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,764 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,766 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,768 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,769 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,771 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-01-20T12:12:38,773 creating build/lib/evalscope/report 2025-01-20T12:12:38,775 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-01-20T12:12:38,777 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-01-20T12:12:38,779 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-01-20T12:12:38,781 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-01-20T12:12:38,783 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-01-20T12:12:38,786 creating build/lib/evalscope/benchmarks 2025-01-20T12:12:38,787 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-01-20T12:12:38,790 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-01-20T12:12:38,792 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-01-20T12:12:38,794 creating build/lib/evalscope/evaluator 2025-01-20T12:12:38,795 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-01-20T12:12:38,798 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-01-20T12:12:38,800 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-01-20T12:12:38,803 creating build/lib/evalscope/collections 2025-01-20T12:12:38,804 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-01-20T12:12:38,807 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-01-20T12:12:38,809 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-01-20T12:12:38,811 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-01-20T12:12:38,814 creating build/lib/evalscope/third_party 2025-01-20T12:12:38,815 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-01-20T12:12:38,823 creating build/lib/evalscope/backend 2025-01-20T12:12:38,824 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-01-20T12:12:38,826 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-01-20T12:12:38,828 creating build/lib/evalscope/models/custom 2025-01-20T12:12:38,829 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-01-20T12:12:38,831 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-01-20T12:12:38,833 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-01-20T12:12:38,835 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:38,836 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:38,839 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:38,841 creating build/lib/evalscope/perf/utils 2025-01-20T12:12:38,842 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,844 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,847 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,848 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,850 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,852 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-01-20T12:12:38,854 creating build/lib/evalscope/perf/plugin 2025-01-20T12:12:38,855 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-01-20T12:12:38,857 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-01-20T12:12:38,859 creating build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,860 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,862 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,864 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,866 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,868 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-20T12:12:38,870 creating build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,871 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,873 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,875 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,877 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,879 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,881 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,883 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,884 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-20T12:12:38,887 creating build/lib/evalscope/benchmarks/general_qa 2025-01-20T12:12:38,888 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-20T12:12:38,890 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-20T12:12:38,892 creating build/lib/evalscope/benchmarks/arc 2025-01-20T12:12:38,893 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-01-20T12:12:38,895 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-01-20T12:12:38,897 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-01-20T12:12:38,900 creating build/lib/evalscope/benchmarks/ceval 2025-01-20T12:12:38,901 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-01-20T12:12:38,903 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-01-20T12:12:38,905 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-01-20T12:12:38,908 creating build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,909 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,912 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,913 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,917 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,919 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,922 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-20T12:12:38,924 creating build/lib/evalscope/benchmarks/truthful_qa 2025-01-20T12:12:38,925 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-20T12:12:38,928 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-20T12:12:38,930 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-20T12:12:38,932 creating build/lib/evalscope/benchmarks/competition_math 2025-01-20T12:12:38,933 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-20T12:12:38,935 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-20T12:12:38,937 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-20T12:12:38,939 creating build/lib/evalscope/benchmarks/gsm8k 2025-01-20T12:12:38,940 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-20T12:12:38,943 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-20T12:12:38,944 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-20T12:12:38,947 creating build/lib/evalscope/benchmarks/humaneval 2025-01-20T12:12:38,948 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-20T12:12:38,951 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-20T12:12:38,952 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-20T12:12:38,955 creating build/lib/evalscope/benchmarks/mmlu 2025-01-20T12:12:38,956 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-20T12:12:38,958 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-20T12:12:38,960 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-20T12:12:38,962 creating build/lib/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:38,963 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:38,966 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:38,968 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:38,970 creating build/lib/evalscope/benchmarks/iquiz 2025-01-20T12:12:38,971 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-01-20T12:12:38,973 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-01-20T12:12:38,975 creating build/lib/evalscope/benchmarks/race 2025-01-20T12:12:38,976 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-01-20T12:12:38,979 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-01-20T12:12:38,981 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-01-20T12:12:38,983 creating build/lib/evalscope/benchmarks/hellaswag 2025-01-20T12:12:38,984 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-20T12:12:38,987 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-20T12:12:38,989 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-20T12:12:38,991 creating build/lib/evalscope/benchmarks/cmmlu 2025-01-20T12:12:38,992 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-20T12:12:38,994 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-20T12:12:38,996 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-20T12:12:38,999 creating build/lib/evalscope/benchmarks/bbh 2025-01-20T12:12:39,000 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-01-20T12:12:39,004 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-01-20T12:12:39,006 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:39,007 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:39,009 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:39,011 creating build/lib/evalscope/evaluator/reviewer 2025-01-20T12:12:39,012 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-01-20T12:12:39,014 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-01-20T12:12:39,017 creating build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,019 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,021 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,023 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,025 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,027 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,030 creating build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,031 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,033 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,035 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,037 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,040 creating build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,041 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,043 creating build/lib/evalscope/third_party/longbench_write/tools 2025-01-20T12:12:39,045 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-20T12:12:39,047 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-20T12:12:39,049 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-20T12:12:39,051 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:39,052 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:39,054 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:39,057 creating build/lib/evalscope/backend/rag_eval 2025-01-20T12:12:39,058 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-01-20T12:12:39,059 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-01-20T12:12:39,062 creating build/lib/evalscope/backend/opencompass 2025-01-20T12:12:39,063 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-01-20T12:12:39,065 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-01-20T12:12:39,067 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-01-20T12:12:39,069 creating build/lib/evalscope/backend/vlm_eval_kit 2025-01-20T12:12:39,070 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-20T12:12:39,072 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-20T12:12:39,073 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-20T12:12:39,076 creating build/lib/evalscope/backend/rag_eval/ragas 2025-01-20T12:12:39,077 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-20T12:12:39,079 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-20T12:12:39,081 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-20T12:12:39,083 creating build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,084 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,086 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,088 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,090 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,092 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-20T12:12:39,095 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:39,096 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:39,098 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:39,100 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:39,102 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:39,105 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:39,106 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:39,108 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:39,110 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:39,112 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:39,114 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,115 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,117 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,119 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,121 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,123 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:39,126 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:39,127 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:39,129 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:39,131 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:39,133 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:39,136 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,137 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,139 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,141 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,143 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,145 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,147 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,150 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,152 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:39,155 creating build/lib/evalscope/backend/opencompass/tasks 2025-01-20T12:12:39,156 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-20T12:12:39,158 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-20T12:12:39,160 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-20T12:12:39,163 creating build/lib/tests/perf 2025-01-20T12:12:39,164 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-01-20T12:12:39,166 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-01-20T12:12:39,168 creating build/lib/tests/cli 2025-01-20T12:12:39,169 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-01-20T12:12:39,172 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-01-20T12:12:39,174 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-01-20T12:12:39,176 creating build/lib/tests/swift 2025-01-20T12:12:39,178 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-01-20T12:12:39,180 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-01-20T12:12:39,182 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-01-20T12:12:39,184 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-01-20T12:12:39,187 creating build/lib/tests/rag 2025-01-20T12:12:39,188 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-01-20T12:12:39,191 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-01-20T12:12:39,192 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-01-20T12:12:39,195 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-01-20T12:12:39,198 creating build/lib/tests/vlm 2025-01-20T12:12:39,199 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-01-20T12:12:39,200 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-01-20T12:12:39,202 running egg_info 2025-01-20T12:12:39,230 writing evalscope.egg-info/PKG-INFO 2025-01-20T12:12:39,259 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-01-20T12:12:39,260 writing entry points to evalscope.egg-info/entry_points.txt 2025-01-20T12:12:39,275 writing requirements to evalscope.egg-info/requires.txt 2025-01-20T12:12:39,276 writing top-level names to evalscope.egg-info/top_level.txt 2025-01-20T12:12:39,355 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-20T12:12:39,374 reading manifest template 'MANIFEST.in' 2025-01-20T12:12:39,483 adding license file 'LICENSE' 2025-01-20T12:12:39,501 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-20T12:12:39,505 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-01-20T12:12:39,505 !! 2025-01-20T12:12:39,506 ******************************************************************************** 2025-01-20T12:12:39,506 ############################ 2025-01-20T12:12:39,507 # Package would be ignored # 2025-01-20T12:12:39,507 ############################ 2025-01-20T12:12:39,508 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-01-20T12:12:39,508 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,509 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,510 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-01-20T12:12:39,510 to the `packages` configuration field. 2025-01-20T12:12:39,511 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,512 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,512 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,513 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,514 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,515 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-01-20T12:12:39,516 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-01-20T12:12:39,517 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,517 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,518 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,519 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,520 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,521 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,522 even if it does not contain any `.py` files. 2025-01-20T12:12:39,523 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,523 directory, all directories are treated like packages. 2025-01-20T12:12:39,524 ******************************************************************************** 2025-01-20T12:12:39,525 !! 2025-01-20T12:12:39,526 check.warn(importable) 2025-01-20T12:12:39,526 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-01-20T12:12:39,527 !! 2025-01-20T12:12:39,528 ******************************************************************************** 2025-01-20T12:12:39,528 ############################ 2025-01-20T12:12:39,529 # Package would be ignored # 2025-01-20T12:12:39,529 ############################ 2025-01-20T12:12:39,530 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-01-20T12:12:39,530 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,531 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,531 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-01-20T12:12:39,532 to the `packages` configuration field. 2025-01-20T12:12:39,533 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,533 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,534 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,535 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,536 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,536 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-01-20T12:12:39,537 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-01-20T12:12:39,537 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,538 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,538 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,539 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,540 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,542 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,543 even if it does not contain any `.py` files. 2025-01-20T12:12:39,543 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,544 directory, all directories are treated like packages. 2025-01-20T12:12:39,544 ******************************************************************************** 2025-01-20T12:12:39,545 !! 2025-01-20T12:12:39,546 check.warn(importable) 2025-01-20T12:12:39,546 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-01-20T12:12:39,547 !! 2025-01-20T12:12:39,548 ******************************************************************************** 2025-01-20T12:12:39,548 ############################ 2025-01-20T12:12:39,549 # Package would be ignored # 2025-01-20T12:12:39,549 ############################ 2025-01-20T12:12:39,550 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-01-20T12:12:39,550 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,552 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,552 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-01-20T12:12:39,553 to the `packages` configuration field. 2025-01-20T12:12:39,554 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,555 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,555 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,556 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,557 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,558 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-01-20T12:12:39,558 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-01-20T12:12:39,559 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,559 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,560 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,561 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,561 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,563 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,563 even if it does not contain any `.py` files. 2025-01-20T12:12:39,564 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,564 directory, all directories are treated like packages. 2025-01-20T12:12:39,564 ******************************************************************************** 2025-01-20T12:12:39,565 !! 2025-01-20T12:12:39,566 check.warn(importable) 2025-01-20T12:12:39,566 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-01-20T12:12:39,567 !! 2025-01-20T12:12:39,568 ******************************************************************************** 2025-01-20T12:12:39,568 ############################ 2025-01-20T12:12:39,569 # Package would be ignored # 2025-01-20T12:12:39,569 ############################ 2025-01-20T12:12:39,570 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-01-20T12:12:39,570 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,571 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,571 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-01-20T12:12:39,572 to the `packages` configuration field. 2025-01-20T12:12:39,573 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,574 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,574 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,575 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,576 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,577 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-01-20T12:12:39,578 already explicitly excluding 'evalscope.metrics.resources' via 2025-01-20T12:12:39,578 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,579 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,579 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,580 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,581 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,583 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,583 even if it does not contain any `.py` files. 2025-01-20T12:12:39,584 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,585 directory, all directories are treated like packages. 2025-01-20T12:12:39,585 ******************************************************************************** 2025-01-20T12:12:39,586 !! 2025-01-20T12:12:39,586 check.warn(importable) 2025-01-20T12:12:39,587 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-01-20T12:12:39,587 !! 2025-01-20T12:12:39,588 ******************************************************************************** 2025-01-20T12:12:39,588 ############################ 2025-01-20T12:12:39,589 # Package would be ignored # 2025-01-20T12:12:39,589 ############################ 2025-01-20T12:12:39,590 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-01-20T12:12:39,590 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,591 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,591 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-01-20T12:12:39,592 to the `packages` configuration field. 2025-01-20T12:12:39,593 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,593 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,594 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,595 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,595 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,597 If you don't want 'evalscope.registry.config' to be distributed and are 2025-01-20T12:12:39,597 already explicitly excluding 'evalscope.registry.config' via 2025-01-20T12:12:39,598 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,598 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,598 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,600 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,601 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,602 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,603 even if it does not contain any `.py` files. 2025-01-20T12:12:39,603 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,604 directory, all directories are treated like packages. 2025-01-20T12:12:39,604 ******************************************************************************** 2025-01-20T12:12:39,605 !! 2025-01-20T12:12:39,606 check.warn(importable) 2025-01-20T12:12:39,606 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-01-20T12:12:39,607 !! 2025-01-20T12:12:39,608 ******************************************************************************** 2025-01-20T12:12:39,608 ############################ 2025-01-20T12:12:39,609 # Package would be ignored # 2025-01-20T12:12:39,609 ############################ 2025-01-20T12:12:39,610 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-01-20T12:12:39,610 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,612 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,612 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-01-20T12:12:39,613 to the `packages` configuration field. 2025-01-20T12:12:39,614 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,614 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,615 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,616 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,616 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,617 If you don't want 'evalscope.registry.data' to be distributed and are 2025-01-20T12:12:39,618 already explicitly excluding 'evalscope.registry.data' via 2025-01-20T12:12:39,618 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,619 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,619 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,620 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,621 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,622 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,622 even if it does not contain any `.py` files. 2025-01-20T12:12:39,623 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,623 directory, all directories are treated like packages. 2025-01-20T12:12:39,624 ******************************************************************************** 2025-01-20T12:12:39,625 !! 2025-01-20T12:12:39,625 check.warn(importable) 2025-01-20T12:12:39,626 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-01-20T12:12:39,626 !! 2025-01-20T12:12:39,627 ******************************************************************************** 2025-01-20T12:12:39,628 ############################ 2025-01-20T12:12:39,628 # Package would be ignored # 2025-01-20T12:12:39,629 ############################ 2025-01-20T12:12:39,629 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-01-20T12:12:39,630 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,631 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,631 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-01-20T12:12:39,632 to the `packages` configuration field. 2025-01-20T12:12:39,633 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,634 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,634 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,635 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,636 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,637 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-01-20T12:12:39,638 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-01-20T12:12:39,638 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,639 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,639 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,641 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,642 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,643 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,643 even if it does not contain any `.py` files. 2025-01-20T12:12:39,644 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,644 directory, all directories are treated like packages. 2025-01-20T12:12:39,645 ******************************************************************************** 2025-01-20T12:12:39,646 !! 2025-01-20T12:12:39,646 check.warn(importable) 2025-01-20T12:12:39,647 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-01-20T12:12:39,647 !! 2025-01-20T12:12:39,648 ******************************************************************************** 2025-01-20T12:12:39,649 ############################ 2025-01-20T12:12:39,649 # Package would be ignored # 2025-01-20T12:12:39,650 ############################ 2025-01-20T12:12:39,650 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-01-20T12:12:39,650 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,651 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,652 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-01-20T12:12:39,652 to the `packages` configuration field. 2025-01-20T12:12:39,653 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,654 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,654 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,655 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,656 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,657 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-01-20T12:12:39,658 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-01-20T12:12:39,658 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,659 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,659 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,660 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,661 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,663 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,663 even if it does not contain any `.py` files. 2025-01-20T12:12:39,664 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,664 directory, all directories are treated like packages. 2025-01-20T12:12:39,665 ******************************************************************************** 2025-01-20T12:12:39,666 !! 2025-01-20T12:12:39,666 check.warn(importable) 2025-01-20T12:12:39,667 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-01-20T12:12:39,668 !! 2025-01-20T12:12:39,669 ******************************************************************************** 2025-01-20T12:12:39,670 ############################ 2025-01-20T12:12:39,670 # Package would be ignored # 2025-01-20T12:12:39,671 ############################ 2025-01-20T12:12:39,671 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-01-20T12:12:39,671 but it is absent from setuptools' `packages` configuration. 2025-01-20T12:12:39,672 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-20T12:12:39,673 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-01-20T12:12:39,673 to the `packages` configuration field. 2025-01-20T12:12:39,674 Alternatively, you can also rely on setuptools' discovery methods 2025-01-20T12:12:39,674 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-20T12:12:39,675 instead of `find_packages(...)`/`find:`). 2025-01-20T12:12:39,676 You can read more about "package discovery" on setuptools documentation page: 2025-01-20T12:12:39,677 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-20T12:12:39,678 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-01-20T12:12:39,678 already explicitly excluding 'evalscope.registry.tasks' via 2025-01-20T12:12:39,679 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-20T12:12:39,679 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-20T12:12:39,680 combination with a more fine grained `package-data` configuration. 2025-01-20T12:12:39,681 You can read more about "package data files" on setuptools documentation page: 2025-01-20T12:12:39,682 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-20T12:12:39,683 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-20T12:12:39,684 even if it does not contain any `.py` files. 2025-01-20T12:12:39,684 On the other hand, currently there is no concept of package data 2025-01-20T12:12:39,685 directory, all directories are treated like packages. 2025-01-20T12:12:39,685 ******************************************************************************** 2025-01-20T12:12:39,686 !! 2025-01-20T12:12:39,687 check.warn(importable) 2025-01-20T12:12:39,687 creating build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,688 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,688 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,689 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,689 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,690 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,690 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,691 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,691 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,692 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,693 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,693 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-20T12:12:39,694 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,694 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,695 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,695 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,696 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,696 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,697 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,697 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,698 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,698 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,699 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,699 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,700 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,700 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,701 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,701 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,702 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,703 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,703 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,704 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,705 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,706 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,707 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,708 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,710 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,711 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,711 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,712 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:39,713 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,713 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,714 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,715 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:39,715 creating build/lib/evalscope/registry/config 2025-01-20T12:12:39,716 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-01-20T12:12:39,716 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-01-20T12:12:39,717 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-01-20T12:12:39,718 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-01-20T12:12:39,718 creating build/lib/evalscope/registry/data 2025-01-20T12:12:39,719 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-01-20T12:12:39,719 creating build/lib/evalscope/registry/data/prompt_template 2025-01-20T12:12:39,720 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-20T12:12:39,720 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-20T12:12:39,721 creating build/lib/evalscope/registry/data/qa_browser 2025-01-20T12:12:39,721 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-01-20T12:12:39,727 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-01-20T12:12:39,734 creating build/lib/evalscope/metrics/resources 2025-01-20T12:12:39,735 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-01-20T12:12:39,747 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-01-20T12:12:39,771 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2025-01-20T12:12:39,774 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-01-20T12:12:39,776 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:39,779 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-01-20T12:12:39,781 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-01-20T12:12:39,794 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,797 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,799 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-01-20T12:12:39,802 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,804 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,806 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,809 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-01-20T12:12:39,813 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-20T12:12:39,815 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-20T12:12:39,817 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:39,818 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:39,821 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:39,875 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-01-20T12:12:39,876 !! 2025-01-20T12:12:39,877 ******************************************************************************** 2025-01-20T12:12:39,877 Please avoid running ``setup.py`` directly. 2025-01-20T12:12:39,878 Instead, use pypa/build, pypa/installer or other 2025-01-20T12:12:39,878 standards-based tools. 2025-01-20T12:12:39,879 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-01-20T12:12:39,879 ******************************************************************************** 2025-01-20T12:12:39,880 !! 2025-01-20T12:12:39,881 self.initialize_options() 2025-01-20T12:12:39,906 installing to build/bdist.linux-armv7l/wheel 2025-01-20T12:12:39,906 running install 2025-01-20T12:12:39,932 running install_lib 2025-01-20T12:12:39,959 creating build/bdist.linux-armv7l/wheel 2025-01-20T12:12:39,961 creating build/bdist.linux-armv7l/wheel/evalscope 2025-01-20T12:12:39,963 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-01-20T12:12:39,965 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,968 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-01-20T12:12:39,970 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-20T12:12:39,972 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-20T12:12:39,974 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-20T12:12:39,976 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,978 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,981 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,983 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,985 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,987 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,990 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-20T12:12:39,993 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-01-20T12:12:39,995 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-01-20T12:12:39,997 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-01-20T12:12:39,998 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-20T12:12:40,001 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-20T12:12:40,004 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-01-20T12:12:40,006 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-20T12:12:40,025 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-20T12:12:40,027 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-01-20T12:12:40,030 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-01-20T12:12:40,031 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,033 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,035 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,037 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,038 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,040 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,042 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,043 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,045 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,047 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,048 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-20T12:12:40,051 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-01-20T12:12:40,052 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-20T12:12:40,054 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-20T12:12:40,056 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-20T12:12:40,058 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-20T12:12:40,060 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-01-20T12:12:40,061 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,063 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,066 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-01-20T12:12:40,067 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,069 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,072 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-01-20T12:12:40,073 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-20T12:12:40,093 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-20T12:12:40,104 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,107 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,110 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:40,111 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:40,114 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-20T12:12:40,117 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,119 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-20T12:12:40,123 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-01-20T12:12:40,124 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,127 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,129 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,132 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,134 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,137 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,139 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,141 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-20T12:12:40,144 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-01-20T12:12:40,145 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-20T12:12:40,147 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-01-20T12:12:40,149 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,151 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,153 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,155 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,157 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,159 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-20T12:12:40,161 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-01-20T12:12:40,163 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-20T12:12:40,165 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-01-20T12:12:40,166 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-20T12:12:40,168 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-20T12:12:40,170 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-20T12:12:40,172 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-20T12:12:40,174 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-20T12:12:40,176 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-20T12:12:40,179 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-01-20T12:12:40,180 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,182 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,184 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,186 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,187 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,189 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,191 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,192 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-20T12:12:40,194 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-20T12:12:40,196 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-20T12:12:40,198 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-20T12:12:40,200 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-20T12:12:40,202 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,204 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-01-20T12:12:40,206 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,207 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,209 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,211 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,213 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,215 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,217 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-20T12:12:40,219 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,221 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-01-20T12:12:40,222 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-20T12:12:40,225 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-20T12:12:40,227 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-20T12:12:40,229 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-20T12:12:40,231 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-20T12:12:40,234 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-01-20T12:12:40,235 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-01-20T12:12:40,237 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-20T12:12:40,239 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-20T12:12:40,241 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-01-20T12:12:40,242 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-20T12:12:40,245 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-20T12:12:40,246 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-20T12:12:40,249 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-01-20T12:12:40,250 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-20T12:12:40,252 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-20T12:12:40,254 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-20T12:12:40,256 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-20T12:12:40,258 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-20T12:12:40,261 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-01-20T12:12:40,262 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,264 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,265 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,269 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,270 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,273 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-20T12:12:40,276 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-01-20T12:12:40,277 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-20T12:12:40,279 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-20T12:12:40,281 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-20T12:12:40,284 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-01-20T12:12:40,286 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-20T12:12:40,287 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-20T12:12:40,290 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-20T12:12:40,292 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-20T12:12:40,294 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-01-20T12:12:40,295 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-20T12:12:40,297 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-20T12:12:40,299 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-20T12:12:40,302 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-01-20T12:12:40,303 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-20T12:12:40,306 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-20T12:12:40,307 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-20T12:12:40,310 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-01-20T12:12:40,311 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-20T12:12:40,313 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-20T12:12:40,315 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-20T12:12:40,317 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-20T12:12:40,319 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-01-20T12:12:40,320 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-20T12:12:40,322 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-20T12:12:40,324 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-20T12:12:40,326 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-20T12:12:40,328 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-01-20T12:12:40,329 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-01-20T12:12:40,331 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-01-20T12:12:40,334 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-01-20T12:12:40,335 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-20T12:12:40,337 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-20T12:12:40,339 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-20T12:12:40,341 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-20T12:12:40,343 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-01-20T12:12:40,344 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-20T12:12:40,347 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-20T12:12:40,348 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-20T12:12:40,350 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-20T12:12:40,353 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-01-20T12:12:40,354 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-20T12:12:40,356 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-20T12:12:40,358 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-20T12:12:40,360 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-20T12:12:40,363 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-01-20T12:12:40,364 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-20T12:12:40,367 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,368 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,371 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,372 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,374 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,376 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,378 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,380 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,382 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,384 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,386 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,387 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,389 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,391 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,393 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,396 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,397 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,399 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,401 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,403 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,405 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,407 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,409 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,411 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,412 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,414 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,416 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,418 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-20T12:12:40,420 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-20T12:12:40,422 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:40,423 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:40,425 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-20T12:12:40,427 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,429 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,431 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-01-20T12:12:40,433 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-20T12:12:40,436 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-01-20T12:12:40,438 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-20T12:12:40,439 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-20T12:12:40,442 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-20T12:12:40,444 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-20T12:12:40,447 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-01-20T12:12:40,448 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-20T12:12:40,450 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-20T12:12:40,453 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-20T12:12:40,456 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-20T12:12:40,458 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,460 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-20T12:12:40,463 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-01-20T12:12:40,465 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-01-20T12:12:40,468 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-01-20T12:12:40,469 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,472 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,474 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,477 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,478 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,481 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,484 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,488 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,490 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-20T12:12:40,492 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,495 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-01-20T12:12:40,497 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-20T12:12:40,499 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-20T12:12:40,502 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-20T12:12:40,504 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,506 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,509 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,511 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-20T12:12:40,514 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-01-20T12:12:40,516 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,518 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,520 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,523 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,526 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:40,527 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:40,530 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-20T12:12:40,532 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,534 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,536 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,538 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-20T12:12:40,541 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-01-20T12:12:40,543 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-20T12:12:40,546 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-01-20T12:12:40,548 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-01-20T12:12:40,550 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,551 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,553 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,556 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,558 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,561 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-20T12:12:40,563 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-20T12:12:40,566 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-01-20T12:12:40,567 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-01-20T12:12:40,569 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-20T12:12:40,571 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-20T12:12:40,574 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,576 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,578 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,581 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,583 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,585 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-20T12:12:40,588 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:40,590 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:40,592 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:40,594 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-20T12:12:40,597 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:40,599 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:40,601 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:40,603 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:40,605 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-20T12:12:40,608 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:40,610 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:40,612 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:40,614 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-20T12:12:40,617 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-20T12:12:40,619 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:40,622 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,623 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,626 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,628 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,631 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,633 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,636 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,638 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,641 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-20T12:12:40,644 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:40,647 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:40,649 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:40,652 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-20T12:12:40,654 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-20T12:12:40,656 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-20T12:12:40,659 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-01-20T12:12:40,661 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-01-20T12:12:40,662 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-20T12:12:40,665 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-20T12:12:40,667 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-20T12:12:40,669 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-20T12:12:40,671 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-20T12:12:40,674 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-20T12:12:40,677 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-01-20T12:12:40,679 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-20T12:12:40,681 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-20T12:12:40,683 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-20T12:12:40,686 creating build/bdist.linux-armv7l/wheel/tests 2025-01-20T12:12:40,688 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-01-20T12:12:40,689 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-20T12:12:40,691 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-20T12:12:40,694 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-01-20T12:12:40,695 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-20T12:12:40,697 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-20T12:12:40,699 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-20T12:12:40,701 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-20T12:12:40,702 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-20T12:12:40,705 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-01-20T12:12:40,706 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-20T12:12:40,708 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-20T12:12:40,710 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-20T12:12:40,713 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-20T12:12:40,715 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-01-20T12:12:40,716 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-20T12:12:40,718 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-20T12:12:40,720 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-20T12:12:40,722 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-20T12:12:40,724 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-01-20T12:12:40,725 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-20T12:12:40,727 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-20T12:12:40,729 running install_egg_info 2025-01-20T12:12:40,762 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.10.0-py3.11.egg-info 2025-01-20T12:12:40,777 running install_scripts 2025-01-20T12:12:40,827 creating build/bdist.linux-armv7l/wheel/evalscope-0.10.0.dist-info/WHEEL 2025-01-20T12:12:40,830 creating '/tmp/pip-wheel-yy5_m60u/evalscope-0.10.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-01-20T12:12:40,832 adding 'evalscope/__init__.py' 2025-01-20T12:12:40,834 adding 'evalscope/arguments.py' 2025-01-20T12:12:40,835 adding 'evalscope/config.py' 2025-01-20T12:12:40,837 adding 'evalscope/constants.py' 2025-01-20T12:12:40,838 adding 'evalscope/run.py' 2025-01-20T12:12:40,840 adding 'evalscope/run_arena.py' 2025-01-20T12:12:40,842 adding 'evalscope/summarizer.py' 2025-01-20T12:12:40,843 adding 'evalscope/version.py' 2025-01-20T12:12:40,845 adding 'evalscope/backend/__init__.py' 2025-01-20T12:12:40,846 adding 'evalscope/backend/base.py' 2025-01-20T12:12:40,848 adding 'evalscope/backend/opencompass/__init__.py' 2025-01-20T12:12:40,849 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-01-20T12:12:40,851 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-01-20T12:12:40,852 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-01-20T12:12:40,853 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-01-20T12:12:40,855 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-01-20T12:12:40,857 adding 'evalscope/backend/rag_eval/__init__.py' 2025-01-20T12:12:40,858 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-01-20T12:12:40,860 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-01-20T12:12:40,861 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-01-20T12:12:40,863 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-01-20T12:12:40,865 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-01-20T12:12:40,866 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-01-20T12:12:40,867 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-01-20T12:12:40,869 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-01-20T12:12:40,871 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-01-20T12:12:40,873 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-01-20T12:12:40,874 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-01-20T12:12:40,876 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-01-20T12:12:40,877 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-01-20T12:12:40,879 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-01-20T12:12:40,880 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-01-20T12:12:40,882 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-01-20T12:12:40,884 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-01-20T12:12:40,885 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-01-20T12:12:40,887 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-01-20T12:12:40,888 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-01-20T12:12:40,890 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-01-20T12:12:40,891 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-01-20T12:12:40,893 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-01-20T12:12:40,894 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-01-20T12:12:40,895 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-01-20T12:12:40,896 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-01-20T12:12:40,898 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-01-20T12:12:40,900 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-01-20T12:12:40,901 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-01-20T12:12:40,903 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-01-20T12:12:40,904 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-01-20T12:12:40,906 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-01-20T12:12:40,907 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-01-20T12:12:40,909 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-01-20T12:12:40,910 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-01-20T12:12:40,911 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-01-20T12:12:40,912 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-01-20T12:12:40,914 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-01-20T12:12:40,915 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-01-20T12:12:40,917 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-01-20T12:12:40,919 adding 'evalscope/benchmarks/__init__.py' 2025-01-20T12:12:40,920 adding 'evalscope/benchmarks/benchmark.py' 2025-01-20T12:12:40,922 adding 'evalscope/benchmarks/data_adapter.py' 2025-01-20T12:12:40,924 adding 'evalscope/benchmarks/arc/__init__.py' 2025-01-20T12:12:40,925 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-01-20T12:12:40,927 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-01-20T12:12:40,928 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-01-20T12:12:40,930 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-01-20T12:12:40,932 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-01-20T12:12:40,934 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-01-20T12:12:40,935 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-01-20T12:12:40,936 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-01-20T12:12:40,938 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-01-20T12:12:40,939 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-01-20T12:12:40,940 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-01-20T12:12:40,942 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-01-20T12:12:40,943 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-01-20T12:12:40,944 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-01-20T12:12:40,945 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-01-20T12:12:40,947 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-01-20T12:12:40,948 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-01-20T12:12:40,950 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-01-20T12:12:40,951 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-01-20T12:12:40,952 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-01-20T12:12:40,953 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-01-20T12:12:40,955 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-01-20T12:12:40,956 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-01-20T12:12:40,958 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-01-20T12:12:40,959 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-01-20T12:12:40,960 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-01-20T12:12:40,961 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-01-20T12:12:40,962 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-01-20T12:12:40,964 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-01-20T12:12:40,965 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-01-20T12:12:40,966 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-01-20T12:12:40,968 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-01-20T12:12:40,969 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-01-20T12:12:40,971 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-01-20T12:12:40,972 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2025-01-20T12:12:40,974 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-01-20T12:12:40,975 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-01-20T12:12:40,977 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-01-20T12:12:40,978 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-01-20T12:12:40,980 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-01-20T12:12:40,981 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-01-20T12:12:40,983 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-01-20T12:12:40,985 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-01-20T12:12:40,986 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-01-20T12:12:40,988 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-01-20T12:12:40,989 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-01-20T12:12:40,991 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-01-20T12:12:40,993 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-01-20T12:12:40,994 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-01-20T12:12:40,996 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-01-20T12:12:40,998 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-01-20T12:12:40,999 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-01-20T12:12:41,001 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-01-20T12:12:41,002 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-01-20T12:12:41,003 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-01-20T12:12:41,009 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-01-20T12:12:41,010 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-01-20T12:12:41,014 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-01-20T12:12:41,015 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-01-20T12:12:41,017 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-01-20T12:12:41,018 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-01-20T12:12:41,020 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-01-20T12:12:41,022 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-01-20T12:12:41,024 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-01-20T12:12:41,025 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-01-20T12:12:41,027 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-01-20T12:12:41,028 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-01-20T12:12:41,030 adding 'evalscope/benchmarks/race/__init__.py' 2025-01-20T12:12:41,032 adding 'evalscope/benchmarks/race/race.py' 2025-01-20T12:12:41,033 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-01-20T12:12:41,034 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-01-20T12:12:41,036 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-01-20T12:12:41,038 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-01-20T12:12:41,039 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-01-20T12:12:41,040 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-01-20T12:12:41,042 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-01-20T12:12:41,043 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-01-20T12:12:41,045 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-01-20T12:12:41,047 adding 'evalscope/cli/__init__.py' 2025-01-20T12:12:41,048 adding 'evalscope/cli/base.py' 2025-01-20T12:12:41,049 adding 'evalscope/cli/cli.py' 2025-01-20T12:12:41,050 adding 'evalscope/cli/start_app.py' 2025-01-20T12:12:41,051 adding 'evalscope/cli/start_eval.py' 2025-01-20T12:12:41,053 adding 'evalscope/cli/start_perf.py' 2025-01-20T12:12:41,054 adding 'evalscope/cli/start_server.py' 2025-01-20T12:12:41,056 adding 'evalscope/collections/__init__.py' 2025-01-20T12:12:41,057 adding 'evalscope/collections/evaluator.py' 2025-01-20T12:12:41,059 adding 'evalscope/collections/sampler.py' 2025-01-20T12:12:41,060 adding 'evalscope/collections/schema.py' 2025-01-20T12:12:41,062 adding 'evalscope/evaluator/__init__.py' 2025-01-20T12:12:41,064 adding 'evalscope/evaluator/evaluator.py' 2025-01-20T12:12:41,066 adding 'evalscope/evaluator/rating_eval.py' 2025-01-20T12:12:41,067 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-01-20T12:12:41,069 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-01-20T12:12:41,071 adding 'evalscope/metrics/__init__.py' 2025-01-20T12:12:41,072 adding 'evalscope/metrics/code_metric.py' 2025-01-20T12:12:41,074 adding 'evalscope/metrics/math_accuracy.py' 2025-01-20T12:12:41,076 adding 'evalscope/metrics/metrics.py' 2025-01-20T12:12:41,077 adding 'evalscope/metrics/named_metrics.py' 2025-01-20T12:12:41,079 adding 'evalscope/metrics/rouge_metric.py' 2025-01-20T12:12:41,080 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-01-20T12:12:41,082 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-01-20T12:12:41,242 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-01-20T12:12:41,488 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-01-20T12:12:41,498 adding 'evalscope/models/__init__.py' 2025-01-20T12:12:41,499 adding 'evalscope/models/base_adapter.py' 2025-01-20T12:12:41,501 adding 'evalscope/models/chat_adapter.py' 2025-01-20T12:12:41,502 adding 'evalscope/models/choice_adapter.py' 2025-01-20T12:12:41,504 adding 'evalscope/models/custom_adapter.py' 2025-01-20T12:12:41,505 adding 'evalscope/models/local_model.py' 2025-01-20T12:12:41,507 adding 'evalscope/models/model.py' 2025-01-20T12:12:41,508 adding 'evalscope/models/server_adapter.py' 2025-01-20T12:12:41,510 adding 'evalscope/models/custom/__init__.py' 2025-01-20T12:12:41,511 adding 'evalscope/models/custom/custom_model.py' 2025-01-20T12:12:41,513 adding 'evalscope/models/custom/dummy_model.py' 2025-01-20T12:12:41,514 adding 'evalscope/perf/__init__.py' 2025-01-20T12:12:41,516 adding 'evalscope/perf/arguments.py' 2025-01-20T12:12:41,518 adding 'evalscope/perf/benchmark.py' 2025-01-20T12:12:41,519 adding 'evalscope/perf/http_client.py' 2025-01-20T12:12:41,521 adding 'evalscope/perf/main.py' 2025-01-20T12:12:41,522 adding 'evalscope/perf/plugin/__init__.py' 2025-01-20T12:12:41,524 adding 'evalscope/perf/plugin/registry.py' 2025-01-20T12:12:41,525 adding 'evalscope/perf/plugin/api/__init__.py' 2025-01-20T12:12:41,526 adding 'evalscope/perf/plugin/api/base.py' 2025-01-20T12:12:41,528 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-01-20T12:12:41,529 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-01-20T12:12:41,531 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-01-20T12:12:41,533 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-01-20T12:12:41,534 adding 'evalscope/perf/plugin/datasets/base.py' 2025-01-20T12:12:41,535 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-01-20T12:12:41,536 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-01-20T12:12:41,537 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-01-20T12:12:41,538 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-01-20T12:12:41,539 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-01-20T12:12:41,541 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-01-20T12:12:41,542 adding 'evalscope/perf/utils/__init__.py' 2025-01-20T12:12:41,543 adding 'evalscope/perf/utils/analysis_result.py' 2025-01-20T12:12:41,545 adding 'evalscope/perf/utils/benchmark_util.py' 2025-01-20T12:12:41,546 adding 'evalscope/perf/utils/db_util.py' 2025-01-20T12:12:41,547 adding 'evalscope/perf/utils/handler.py' 2025-01-20T12:12:41,549 adding 'evalscope/perf/utils/local_server.py' 2025-01-20T12:12:41,550 adding 'evalscope/registry/__init__.py' 2025-01-20T12:12:41,552 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-01-20T12:12:41,553 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-01-20T12:12:41,555 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-01-20T12:12:41,556 adding 'evalscope/registry/config/cfg_single.yaml' 2025-01-20T12:12:41,559 adding 'evalscope/registry/data/question.jsonl' 2025-01-20T12:12:41,561 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-01-20T12:12:41,562 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-01-20T12:12:41,728 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-01-20T12:12:41,736 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-01-20T12:12:41,738 adding 'evalscope/registry/tasks/arc.yaml' 2025-01-20T12:12:41,739 adding 'evalscope/registry/tasks/bbh.yaml' 2025-01-20T12:12:41,741 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-01-20T12:12:41,742 adding 'evalscope/registry/tasks/ceval.yaml' 2025-01-20T12:12:41,743 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-01-20T12:12:41,744 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-01-20T12:12:41,745 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-01-20T12:12:41,747 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-01-20T12:12:41,748 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-01-20T12:12:41,749 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-01-20T12:12:41,750 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-01-20T12:12:41,752 adding 'evalscope/report/__init__.py' 2025-01-20T12:12:41,755 adding 'evalscope/report/app.py' 2025-01-20T12:12:41,756 adding 'evalscope/report/combinator.py' 2025-01-20T12:12:41,758 adding 'evalscope/report/generator.py' 2025-01-20T12:12:41,759 adding 'evalscope/report/utils.py' 2025-01-20T12:12:41,761 adding 'evalscope/third_party/__init__.py' 2025-01-20T12:12:41,763 adding 'evalscope/third_party/longbench_write/README.md' 2025-01-20T12:12:41,764 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-01-20T12:12:41,766 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-01-20T12:12:41,767 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-01-20T12:12:41,769 adding 'evalscope/third_party/longbench_write/eval.py' 2025-01-20T12:12:41,770 adding 'evalscope/third_party/longbench_write/infer.py' 2025-01-20T12:12:41,772 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-01-20T12:12:41,773 adding 'evalscope/third_party/longbench_write/utils.py' 2025-01-20T12:12:41,774 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-01-20T12:12:41,776 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-01-20T12:12:41,783 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-01-20T12:12:41,787 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-01-20T12:12:41,789 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-01-20T12:12:41,790 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-01-20T12:12:41,792 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-01-20T12:12:41,793 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-01-20T12:12:41,795 adding 'evalscope/third_party/toolbench_static/README.md' 2025-01-20T12:12:41,796 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-01-20T12:12:41,797 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-01-20T12:12:41,798 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-01-20T12:12:41,800 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-01-20T12:12:41,802 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-01-20T12:12:41,803 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-01-20T12:12:41,804 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-01-20T12:12:41,806 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-01-20T12:12:41,807 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-01-20T12:12:41,808 adding 'evalscope/utils/__init__.py' 2025-01-20T12:12:41,810 adding 'evalscope/utils/arena_utils.py' 2025-01-20T12:12:41,811 adding 'evalscope/utils/chat_service.py' 2025-01-20T12:12:41,813 adding 'evalscope/utils/completion_parsers.py' 2025-01-20T12:12:41,814 adding 'evalscope/utils/io_utils.py' 2025-01-20T12:12:41,815 adding 'evalscope/utils/logger.py' 2025-01-20T12:12:41,817 adding 'evalscope/utils/model_utils.py' 2025-01-20T12:12:41,818 adding 'evalscope/utils/utils.py' 2025-01-20T12:12:41,821 adding 'tests/__init__.py' 2025-01-20T12:12:41,822 adding 'tests/test_run_all.py' 2025-01-20T12:12:41,823 adding 'tests/cli/__init__.py' 2025-01-20T12:12:41,825 adding 'tests/cli/test_collection.py' 2025-01-20T12:12:41,826 adding 'tests/cli/test_run.py' 2025-01-20T12:12:41,828 adding 'tests/perf/__init__.py' 2025-01-20T12:12:41,830 adding 'tests/perf/test_perf.py' 2025-01-20T12:12:41,831 adding 'tests/rag/__init__.py' 2025-01-20T12:12:41,832 adding 'tests/rag/test_clip_benchmark.py' 2025-01-20T12:12:41,834 adding 'tests/rag/test_mteb.py' 2025-01-20T12:12:41,835 adding 'tests/rag/test_ragas.py' 2025-01-20T12:12:41,837 adding 'tests/swift/__init__.py' 2025-01-20T12:12:41,838 adding 'tests/swift/test_run_swift_eval.py' 2025-01-20T12:12:41,840 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-01-20T12:12:41,841 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-01-20T12:12:41,843 adding 'tests/vlm/__init__.py' 2025-01-20T12:12:41,844 adding 'tests/vlm/test_vlmeval.py' 2025-01-20T12:12:41,846 adding 'evalscope-0.10.0.dist-info/LICENSE' 2025-01-20T12:12:41,850 adding 'evalscope-0.10.0.dist-info/METADATA' 2025-01-20T12:12:41,851 adding 'evalscope-0.10.0.dist-info/WHEEL' 2025-01-20T12:12:41,852 adding 'evalscope-0.10.0.dist-info/entry_points.txt' 2025-01-20T12:12:41,853 adding 'evalscope-0.10.0.dist-info/top_level.txt' 2025-01-20T12:12:41,857 adding 'evalscope-0.10.0.dist-info/RECORD' 2025-01-20T12:12:41,876 removing build/bdist.linux-armv7l/wheel 2025-01-20T12:12:42,072 Building wheel for evalscope (setup.py): finished with status 'done' 2025-01-20T12:12:42,089 Created wheel for evalscope: filename=evalscope-0.10.0-py3-none-any.whl size=1422316 sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 2025-01-20T12:12:42,090 Stored in directory: /tmp/pip-ephem-wheel-cache-tleyhwgl/wheels/6d/61/c7/ac3514a972dc8c7ffa18a039212d676a06e291af423fd6d004 2025-01-20T12:12:42,117 Successfully built evalscope 2025-01-20T12:12:42,152 Removed build tracker: '/tmp/pip-build-tracker-t8tjn79l'