2025-01-23T06:12:54,769 Created temporary directory: /tmp/pip-build-tracker-9d06mtm2 2025-01-23T06:12:54,770 Initialized build tracking at /tmp/pip-build-tracker-9d06mtm2 2025-01-23T06:12:54,771 Created build tracker: /tmp/pip-build-tracker-9d06mtm2 2025-01-23T06:12:54,771 Entered build tracker: /tmp/pip-build-tracker-9d06mtm2 2025-01-23T06:12:54,772 Created temporary directory: /tmp/pip-wheel-cv81q1p8 2025-01-23T06:12:54,776 Created temporary directory: /tmp/pip-ephem-wheel-cache-f8gnevrq 2025-01-23T06:12:54,829 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-01-23T06:12:54,831 2 location(s) to search for versions of evalscope: 2025-01-23T06:12:54,831 * https://pypi.org/simple/evalscope/ 2025-01-23T06:12:54,831 * https://www.piwheels.org/simple/evalscope/ 2025-01-23T06:12:54,832 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-01-23T06:12:54,833 Getting page https://pypi.org/simple/evalscope/ 2025-01-23T06:12:54,835 Found index url https://pypi.org/simple/ 2025-01-23T06:12:55,062 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-01-23T06:12:55,071 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,072 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-01-23T06:12:55,072 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,073 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-01-23T06:12:55,074 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,075 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-01-23T06:12:55,076 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,077 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-01-23T06:12:55,078 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,079 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-01-23T06:12:55,079 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,080 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,081 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-01-23T06:12:55,082 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,083 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-01-23T06:12:55,083 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,084 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-01-23T06:12:55,085 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,086 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-01-23T06:12:55,086 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,087 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-01-23T06:12:55,088 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,089 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-01-23T06:12:55,090 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,091 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-01-23T06:12:55,091 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,092 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-01-23T06:12:55,093 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,094 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-01-23T06:12:55,095 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,096 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-01-23T06:12:55,096 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,097 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-01-23T06:12:55,098 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,099 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-01-23T06:12:55,099 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,100 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-01-23T06:12:55,101 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,102 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-01-23T06:12:55,103 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-01-23T06:12:55,104 Getting page https://www.piwheels.org/simple/evalscope/ 2025-01-23T06:12:55,105 Found index url https://www.piwheels.org/simple/ 2025-01-23T06:12:55,275 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-01-23T06:12:55,278 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,279 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,280 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,280 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,281 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,281 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,282 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,282 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-23T06:12:55,283 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-01-23T06:12:55,284 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-01-23T06:12:55,305 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-01-23T06:12:55,307 Collecting evalscope==0.10.1 2025-01-23T06:12:55,309 Created temporary directory: /tmp/pip-unpack-jq9i7l16 2025-01-23T06:12:55,605 Downloading evalscope-0.10.1.tar.gz (1.3 MB) 2025-01-23T06:12:56,546 Added evalscope==0.10.1 from https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz to build tracker '/tmp/pip-build-tracker-9d06mtm2' 2025-01-23T06:12:56,550 Running setup.py (path:/tmp/pip-wheel-cv81q1p8/evalscope_605f2dcefe0548baba73b33b0fccee60/setup.py) egg_info for package evalscope 2025-01-23T06:12:56,550 Created temporary directory: /tmp/pip-pip-egg-info-wspk60jq 2025-01-23T06:12:56,551 Preparing metadata (setup.py): started 2025-01-23T06:12:56,552 Running command python setup.py egg_info 2025-01-23T06:12:57,213 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-23T06:12:57,214 !! 2025-01-23T06:12:57,215 ******************************************************************************** 2025-01-23T06:12:57,215 Usage of dash-separated 'index-url' will not be supported in future 2025-01-23T06:12:57,216 versions. Please use the underscore name 'index_url' instead. 2025-01-23T06:12:57,217 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-23T06:12:57,218 or your builds will no longer be supported. 2025-01-23T06:12:57,219 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-23T06:12:57,219 ******************************************************************************** 2025-01-23T06:12:57,221 !! 2025-01-23T06:12:57,221 opt = self.warn_dash_deprecation(opt, section) 2025-01-23T06:12:57,822 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-23T06:12:57,823 !! 2025-01-23T06:12:57,823 ******************************************************************************** 2025-01-23T06:12:57,824 Usage of dash-separated 'index-url' will not be supported in future 2025-01-23T06:12:57,824 versions. Please use the underscore name 'index_url' instead. 2025-01-23T06:12:57,825 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-23T06:12:57,826 or your builds will no longer be supported. 2025-01-23T06:12:57,827 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-23T06:12:57,827 ******************************************************************************** 2025-01-23T06:12:57,828 !! 2025-01-23T06:12:57,828 opt = self.warn_dash_deprecation(opt, section) 2025-01-23T06:12:57,860 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-23T06:12:57,860 running egg_info 2025-01-23T06:12:57,886 creating /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info 2025-01-23T06:12:57,887 writing /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/PKG-INFO 2025-01-23T06:12:57,916 writing dependency_links to /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/dependency_links.txt 2025-01-23T06:12:57,918 writing entry points to /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/entry_points.txt 2025-01-23T06:12:57,932 writing requirements to /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/requires.txt 2025-01-23T06:12:57,934 writing top-level names to /tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/top_level.txt 2025-01-23T06:12:57,935 writing manifest file '/tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/SOURCES.txt' 2025-01-23T06:12:58,083 reading manifest file '/tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/SOURCES.txt' 2025-01-23T06:12:58,085 reading manifest template 'MANIFEST.in' 2025-01-23T06:12:58,200 adding license file 'LICENSE' 2025-01-23T06:12:58,215 writing manifest file '/tmp/pip-pip-egg-info-wspk60jq/evalscope.egg-info/SOURCES.txt' 2025-01-23T06:12:58,326 Preparing metadata (setup.py): finished with status 'done' 2025-01-23T06:12:58,332 Source in /tmp/pip-wheel-cv81q1p8/evalscope_605f2dcefe0548baba73b33b0fccee60 has version 0.10.1, which satisfies requirement evalscope==0.10.1 from https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz 2025-01-23T06:12:58,333 Removed evalscope==0.10.1 from https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz from build tracker '/tmp/pip-build-tracker-9d06mtm2' 2025-01-23T06:12:58,392 Created temporary directory: /tmp/pip-unpack-npe43lwc 2025-01-23T06:12:58,394 Created temporary directory: /tmp/pip-unpack-ihes61ga 2025-01-23T06:12:58,394 Building wheels for collected packages: evalscope 2025-01-23T06:12:58,398 Created temporary directory: /tmp/pip-wheel-hnn8y7uu 2025-01-23T06:12:58,399 Building wheel for evalscope (setup.py): started 2025-01-23T06:12:58,400 Destination directory: /tmp/pip-wheel-hnn8y7uu 2025-01-23T06:12:58,401 Running command python setup.py bdist_wheel 2025-01-23T06:12:58,851 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-23T06:12:58,952 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-23T06:12:58,953 !! 2025-01-23T06:12:58,954 ******************************************************************************** 2025-01-23T06:12:58,955 Usage of dash-separated 'index-url' will not be supported in future 2025-01-23T06:12:58,956 versions. Please use the underscore name 'index_url' instead. 2025-01-23T06:12:58,957 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-23T06:12:58,958 or your builds will no longer be supported. 2025-01-23T06:12:58,959 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-23T06:12:58,959 ******************************************************************************** 2025-01-23T06:12:58,960 !! 2025-01-23T06:12:58,961 opt = self.warn_dash_deprecation(opt, section) 2025-01-23T06:12:59,521 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-23T06:12:59,521 !! 2025-01-23T06:12:59,522 ******************************************************************************** 2025-01-23T06:12:59,523 Usage of dash-separated 'index-url' will not be supported in future 2025-01-23T06:12:59,523 versions. Please use the underscore name 'index_url' instead. 2025-01-23T06:12:59,524 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-23T06:12:59,525 or your builds will no longer be supported. 2025-01-23T06:12:59,525 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-23T06:12:59,526 ******************************************************************************** 2025-01-23T06:12:59,527 !! 2025-01-23T06:12:59,527 opt = self.warn_dash_deprecation(opt, section) 2025-01-23T06:12:59,530 running bdist_wheel 2025-01-23T06:12:59,664 running build 2025-01-23T06:12:59,665 running build_py 2025-01-23T06:12:59,695 creating build/lib/tests 2025-01-23T06:12:59,699 copying tests/__init__.py -> build/lib/tests 2025-01-23T06:12:59,701 copying tests/test_run_all.py -> build/lib/tests 2025-01-23T06:12:59,703 creating build/lib/evalscope 2025-01-23T06:12:59,704 copying evalscope/run_arena.py -> build/lib/evalscope 2025-01-23T06:12:59,707 copying evalscope/__init__.py -> build/lib/evalscope 2025-01-23T06:12:59,709 copying evalscope/config.py -> build/lib/evalscope 2025-01-23T06:12:59,711 copying evalscope/version.py -> build/lib/evalscope 2025-01-23T06:12:59,713 copying evalscope/arguments.py -> build/lib/evalscope 2025-01-23T06:12:59,715 copying evalscope/summarizer.py -> build/lib/evalscope 2025-01-23T06:12:59,717 copying evalscope/run.py -> build/lib/evalscope 2025-01-23T06:12:59,719 copying evalscope/constants.py -> build/lib/evalscope 2025-01-23T06:12:59,722 creating build/lib/tests/rag 2025-01-23T06:12:59,723 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-01-23T06:12:59,725 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-01-23T06:12:59,727 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-01-23T06:12:59,729 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-01-23T06:12:59,731 creating build/lib/tests/cli 2025-01-23T06:12:59,732 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-01-23T06:12:59,734 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-01-23T06:12:59,736 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-01-23T06:12:59,739 creating build/lib/tests/vlm 2025-01-23T06:12:59,740 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-01-23T06:12:59,742 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-01-23T06:12:59,744 creating build/lib/tests/perf 2025-01-23T06:12:59,746 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-01-23T06:12:59,748 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-01-23T06:12:59,751 creating build/lib/tests/swift 2025-01-23T06:12:59,752 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-01-23T06:12:59,754 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-01-23T06:12:59,756 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-01-23T06:12:59,758 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-01-23T06:12:59,761 creating build/lib/evalscope/metrics 2025-01-23T06:12:59,762 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,764 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,766 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,768 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,771 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,773 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-01-23T06:12:59,775 creating build/lib/evalscope/utils 2025-01-23T06:12:59,776 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,778 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,781 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,783 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,785 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,787 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,789 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,791 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-01-23T06:12:59,793 creating build/lib/evalscope/evaluator 2025-01-23T06:12:59,794 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-01-23T06:12:59,796 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-01-23T06:12:59,799 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-01-23T06:12:59,801 creating build/lib/evalscope/models 2025-01-23T06:12:59,802 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-01-23T06:12:59,804 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-01-23T06:12:59,807 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-01-23T06:12:59,808 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-01-23T06:12:59,811 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-01-23T06:12:59,813 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-01-23T06:12:59,815 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-01-23T06:12:59,818 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-01-23T06:12:59,820 creating build/lib/evalscope/registry 2025-01-23T06:12:59,821 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-01-23T06:12:59,823 creating build/lib/evalscope/benchmarks 2025-01-23T06:12:59,824 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-01-23T06:12:59,827 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-01-23T06:12:59,828 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-01-23T06:12:59,831 creating build/lib/evalscope/backend 2025-01-23T06:12:59,832 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-01-23T06:12:59,834 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-01-23T06:12:59,836 creating build/lib/evalscope/cli 2025-01-23T06:12:59,838 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,840 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,842 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,843 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,845 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,847 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,849 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-01-23T06:12:59,851 creating build/lib/evalscope/report 2025-01-23T06:12:59,852 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-01-23T06:12:59,855 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-01-23T06:12:59,857 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-01-23T06:12:59,859 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-01-23T06:12:59,861 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-01-23T06:12:59,863 creating build/lib/evalscope/collections 2025-01-23T06:12:59,864 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-01-23T06:12:59,866 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-01-23T06:12:59,868 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-01-23T06:12:59,871 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-01-23T06:12:59,873 creating build/lib/evalscope/third_party 2025-01-23T06:12:59,874 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-01-23T06:12:59,876 creating build/lib/evalscope/perf 2025-01-23T06:12:59,877 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-01-23T06:12:59,880 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-01-23T06:12:59,882 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-01-23T06:12:59,884 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-01-23T06:12:59,886 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-01-23T06:12:59,888 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-01-23T06:12:59,889 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-23T06:12:59,891 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-23T06:12:59,894 creating build/lib/evalscope/evaluator/reviewer 2025-01-23T06:12:59,895 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-01-23T06:12:59,897 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-01-23T06:12:59,900 creating build/lib/evalscope/models/custom 2025-01-23T06:12:59,901 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-01-23T06:12:59,903 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-01-23T06:12:59,905 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-01-23T06:12:59,907 creating build/lib/evalscope/benchmarks/general_qa 2025-01-23T06:12:59,908 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-23T06:12:59,910 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-23T06:12:59,913 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-01-23T06:12:59,914 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-23T06:12:59,915 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-23T06:12:59,918 creating build/lib/evalscope/benchmarks/trivia_qa 2025-01-23T06:12:59,919 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-23T06:12:59,922 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-23T06:12:59,924 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-23T06:12:59,926 creating build/lib/evalscope/benchmarks/bbh 2025-01-23T06:12:59,928 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-01-23T06:12:59,930 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-01-23T06:12:59,932 creating build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,934 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,937 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,939 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,941 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,942 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,944 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-01-23T06:12:59,947 creating build/lib/evalscope/benchmarks/competition_math 2025-01-23T06:12:59,948 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-23T06:12:59,950 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-23T06:12:59,953 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-23T06:12:59,955 creating build/lib/evalscope/benchmarks/mmlu 2025-01-23T06:12:59,956 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-23T06:12:59,959 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-23T06:12:59,960 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-23T06:12:59,963 creating build/lib/evalscope/benchmarks/humaneval 2025-01-23T06:12:59,964 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-23T06:12:59,966 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-23T06:12:59,969 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-23T06:12:59,971 creating build/lib/evalscope/benchmarks/truthful_qa 2025-01-23T06:12:59,972 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-23T06:12:59,975 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-23T06:12:59,977 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-23T06:12:59,979 creating build/lib/evalscope/benchmarks/arc 2025-01-23T06:12:59,981 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-01-23T06:12:59,983 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-01-23T06:12:59,985 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-01-23T06:12:59,987 creating build/lib/evalscope/benchmarks/gsm8k 2025-01-23T06:12:59,988 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-23T06:12:59,991 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-23T06:12:59,993 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-23T06:12:59,995 creating build/lib/evalscope/benchmarks/ceval 2025-01-23T06:12:59,996 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-01-23T06:12:59,998 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-01-23T06:13:00,001 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-01-23T06:13:00,004 creating build/lib/evalscope/benchmarks/race 2025-01-23T06:13:00,005 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-01-23T06:13:00,007 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-01-23T06:13:00,009 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-01-23T06:13:00,012 creating build/lib/evalscope/benchmarks/cmmlu 2025-01-23T06:13:00,013 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-23T06:13:00,015 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-23T06:13:00,017 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-23T06:13:00,020 creating build/lib/evalscope/benchmarks/hellaswag 2025-01-23T06:13:00,021 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-23T06:13:00,023 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-23T06:13:00,025 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-23T06:13:00,027 creating build/lib/evalscope/benchmarks/gpqa 2025-01-23T06:13:00,029 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-01-23T06:13:00,030 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-01-23T06:13:00,033 creating build/lib/evalscope/benchmarks/iquiz 2025-01-23T06:13:00,034 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-01-23T06:13:00,035 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-01-23T06:13:00,038 creating build/lib/evalscope/backend/opencompass 2025-01-23T06:13:00,039 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-01-23T06:13:00,041 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-01-23T06:13:00,043 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-01-23T06:13:00,046 creating build/lib/evalscope/backend/vlm_eval_kit 2025-01-23T06:13:00,047 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-23T06:13:00,049 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-23T06:13:00,050 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-23T06:13:00,053 creating build/lib/evalscope/backend/rag_eval 2025-01-23T06:13:00,054 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-01-23T06:13:00,056 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-01-23T06:13:00,058 creating build/lib/evalscope/backend/opencompass/tasks 2025-01-23T06:13:00,060 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-23T06:13:00,062 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-23T06:13:00,063 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-23T06:13:00,066 creating build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,067 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,069 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,071 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,073 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,075 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-23T06:13:00,078 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:00,079 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:00,081 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:00,082 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:00,085 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:00,087 creating build/lib/evalscope/backend/rag_eval/ragas 2025-01-23T06:13:00,088 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-23T06:13:00,090 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-23T06:13:00,092 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-23T06:13:00,094 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:00,095 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:00,097 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:00,099 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:00,101 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:00,103 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:00,104 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:00,106 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:00,108 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:00,110 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:00,113 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,114 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,116 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,118 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,120 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,122 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:00,125 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,126 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,128 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,130 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,132 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,135 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,137 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,140 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,142 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:00,144 creating build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,146 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,147 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,149 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,151 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,154 creating build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,155 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,156 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,158 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,160 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,162 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,165 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:00,166 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:00,168 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:00,171 creating build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,172 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,175 creating build/lib/evalscope/third_party/longbench_write/tools 2025-01-23T06:13:00,176 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-23T06:13:00,179 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-23T06:13:00,181 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-23T06:13:00,184 creating build/lib/evalscope/perf/utils 2025-01-23T06:13:00,185 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,189 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,191 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,194 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,195 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,197 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-01-23T06:13:00,199 creating build/lib/evalscope/perf/plugin 2025-01-23T06:13:00,200 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-01-23T06:13:00,203 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-01-23T06:13:00,206 creating build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,207 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,210 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,212 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,214 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,216 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,218 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,220 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,222 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-23T06:13:00,224 creating build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,226 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,228 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,230 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,232 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,234 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-23T06:13:00,236 running egg_info 2025-01-23T06:13:00,264 writing evalscope.egg-info/PKG-INFO 2025-01-23T06:13:00,294 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-01-23T06:13:00,295 writing entry points to evalscope.egg-info/entry_points.txt 2025-01-23T06:13:00,309 writing requirements to evalscope.egg-info/requires.txt 2025-01-23T06:13:00,311 writing top-level names to evalscope.egg-info/top_level.txt 2025-01-23T06:13:00,391 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-23T06:13:00,410 reading manifest template 'MANIFEST.in' 2025-01-23T06:13:00,522 adding license file 'LICENSE' 2025-01-23T06:13:00,541 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-23T06:13:00,544 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-01-23T06:13:00,545 !! 2025-01-23T06:13:00,546 ******************************************************************************** 2025-01-23T06:13:00,547 ############################ 2025-01-23T06:13:00,548 # Package would be ignored # 2025-01-23T06:13:00,548 ############################ 2025-01-23T06:13:00,549 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-01-23T06:13:00,550 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,551 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,551 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-01-23T06:13:00,552 to the `packages` configuration field. 2025-01-23T06:13:00,553 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,554 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,554 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,555 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,556 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,558 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-01-23T06:13:00,558 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-01-23T06:13:00,559 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,559 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,560 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,561 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,562 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,563 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,564 even if it does not contain any `.py` files. 2025-01-23T06:13:00,564 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,565 directory, all directories are treated like packages. 2025-01-23T06:13:00,565 ******************************************************************************** 2025-01-23T06:13:00,566 !! 2025-01-23T06:13:00,566 check.warn(importable) 2025-01-23T06:13:00,567 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-01-23T06:13:00,567 !! 2025-01-23T06:13:00,568 ******************************************************************************** 2025-01-23T06:13:00,568 ############################ 2025-01-23T06:13:00,569 # Package would be ignored # 2025-01-23T06:13:00,569 ############################ 2025-01-23T06:13:00,570 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-01-23T06:13:00,570 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,571 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,572 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-01-23T06:13:00,572 to the `packages` configuration field. 2025-01-23T06:13:00,573 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,574 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,574 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,575 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,577 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,578 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-01-23T06:13:00,578 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-01-23T06:13:00,579 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,579 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,580 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,581 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,582 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,584 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,584 even if it does not contain any `.py` files. 2025-01-23T06:13:00,585 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,585 directory, all directories are treated like packages. 2025-01-23T06:13:00,586 ******************************************************************************** 2025-01-23T06:13:00,587 !! 2025-01-23T06:13:00,588 check.warn(importable) 2025-01-23T06:13:00,588 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-01-23T06:13:00,589 !! 2025-01-23T06:13:00,590 ******************************************************************************** 2025-01-23T06:13:00,591 ############################ 2025-01-23T06:13:00,591 # Package would be ignored # 2025-01-23T06:13:00,591 ############################ 2025-01-23T06:13:00,592 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-01-23T06:13:00,592 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,593 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,593 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-01-23T06:13:00,594 to the `packages` configuration field. 2025-01-23T06:13:00,595 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,595 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,596 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,596 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,597 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,598 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-01-23T06:13:00,599 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-01-23T06:13:00,599 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,600 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,600 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,601 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,602 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,604 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,604 even if it does not contain any `.py` files. 2025-01-23T06:13:00,605 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,605 directory, all directories are treated like packages. 2025-01-23T06:13:00,606 ******************************************************************************** 2025-01-23T06:13:00,606 !! 2025-01-23T06:13:00,607 check.warn(importable) 2025-01-23T06:13:00,607 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-01-23T06:13:00,608 !! 2025-01-23T06:13:00,609 ******************************************************************************** 2025-01-23T06:13:00,610 ############################ 2025-01-23T06:13:00,610 # Package would be ignored # 2025-01-23T06:13:00,611 ############################ 2025-01-23T06:13:00,611 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-01-23T06:13:00,612 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,613 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,613 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-01-23T06:13:00,614 to the `packages` configuration field. 2025-01-23T06:13:00,615 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,615 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,616 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,617 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,618 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,619 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-01-23T06:13:00,619 already explicitly excluding 'evalscope.metrics.resources' via 2025-01-23T06:13:00,620 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,620 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,620 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,621 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,622 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,623 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,624 even if it does not contain any `.py` files. 2025-01-23T06:13:00,624 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,625 directory, all directories are treated like packages. 2025-01-23T06:13:00,625 ******************************************************************************** 2025-01-23T06:13:00,626 !! 2025-01-23T06:13:00,626 check.warn(importable) 2025-01-23T06:13:00,627 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-01-23T06:13:00,627 !! 2025-01-23T06:13:00,628 ******************************************************************************** 2025-01-23T06:13:00,628 ############################ 2025-01-23T06:13:00,629 # Package would be ignored # 2025-01-23T06:13:00,629 ############################ 2025-01-23T06:13:00,630 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-01-23T06:13:00,630 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,631 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,632 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-01-23T06:13:00,632 to the `packages` configuration field. 2025-01-23T06:13:00,633 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,634 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,634 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,635 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,636 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,637 If you don't want 'evalscope.registry.config' to be distributed and are 2025-01-23T06:13:00,638 already explicitly excluding 'evalscope.registry.config' via 2025-01-23T06:13:00,638 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,639 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,639 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,640 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,641 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,643 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,644 even if it does not contain any `.py` files. 2025-01-23T06:13:00,644 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,645 directory, all directories are treated like packages. 2025-01-23T06:13:00,646 ******************************************************************************** 2025-01-23T06:13:00,646 !! 2025-01-23T06:13:00,647 check.warn(importable) 2025-01-23T06:13:00,647 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-01-23T06:13:00,648 !! 2025-01-23T06:13:00,648 ******************************************************************************** 2025-01-23T06:13:00,649 ############################ 2025-01-23T06:13:00,649 # Package would be ignored # 2025-01-23T06:13:00,650 ############################ 2025-01-23T06:13:00,650 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-01-23T06:13:00,651 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,651 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,652 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-01-23T06:13:00,652 to the `packages` configuration field. 2025-01-23T06:13:00,653 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,654 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,654 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,655 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,656 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,657 If you don't want 'evalscope.registry.data' to be distributed and are 2025-01-23T06:13:00,657 already explicitly excluding 'evalscope.registry.data' via 2025-01-23T06:13:00,658 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,658 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,659 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,660 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,661 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,662 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,663 even if it does not contain any `.py` files. 2025-01-23T06:13:00,664 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,664 directory, all directories are treated like packages. 2025-01-23T06:13:00,665 ******************************************************************************** 2025-01-23T06:13:00,666 !! 2025-01-23T06:13:00,666 check.warn(importable) 2025-01-23T06:13:00,667 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-01-23T06:13:00,667 !! 2025-01-23T06:13:00,668 ******************************************************************************** 2025-01-23T06:13:00,669 ############################ 2025-01-23T06:13:00,670 # Package would be ignored # 2025-01-23T06:13:00,670 ############################ 2025-01-23T06:13:00,671 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-01-23T06:13:00,671 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,672 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,672 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-01-23T06:13:00,673 to the `packages` configuration field. 2025-01-23T06:13:00,674 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,675 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,675 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,676 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,677 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,678 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-01-23T06:13:00,678 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-01-23T06:13:00,678 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,679 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,679 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,680 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,681 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,683 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,683 even if it does not contain any `.py` files. 2025-01-23T06:13:00,683 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,684 directory, all directories are treated like packages. 2025-01-23T06:13:00,684 ******************************************************************************** 2025-01-23T06:13:00,685 !! 2025-01-23T06:13:00,686 check.warn(importable) 2025-01-23T06:13:00,686 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-01-23T06:13:00,687 !! 2025-01-23T06:13:00,688 ******************************************************************************** 2025-01-23T06:13:00,688 ############################ 2025-01-23T06:13:00,689 # Package would be ignored # 2025-01-23T06:13:00,689 ############################ 2025-01-23T06:13:00,690 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-01-23T06:13:00,690 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,691 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,691 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-01-23T06:13:00,692 to the `packages` configuration field. 2025-01-23T06:13:00,693 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,694 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,694 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,695 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,696 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,697 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-01-23T06:13:00,697 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-01-23T06:13:00,698 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,699 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,699 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,700 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,701 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,702 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,703 even if it does not contain any `.py` files. 2025-01-23T06:13:00,703 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,703 directory, all directories are treated like packages. 2025-01-23T06:13:00,704 ******************************************************************************** 2025-01-23T06:13:00,705 !! 2025-01-23T06:13:00,705 check.warn(importable) 2025-01-23T06:13:00,706 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-01-23T06:13:00,706 !! 2025-01-23T06:13:00,707 ******************************************************************************** 2025-01-23T06:13:00,707 ############################ 2025-01-23T06:13:00,708 # Package would be ignored # 2025-01-23T06:13:00,708 ############################ 2025-01-23T06:13:00,709 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-01-23T06:13:00,709 but it is absent from setuptools' `packages` configuration. 2025-01-23T06:13:00,710 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-23T06:13:00,711 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-01-23T06:13:00,711 to the `packages` configuration field. 2025-01-23T06:13:00,712 Alternatively, you can also rely on setuptools' discovery methods 2025-01-23T06:13:00,713 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-23T06:13:00,713 instead of `find_packages(...)`/`find:`). 2025-01-23T06:13:00,714 You can read more about "package discovery" on setuptools documentation page: 2025-01-23T06:13:00,715 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-23T06:13:00,716 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-01-23T06:13:00,717 already explicitly excluding 'evalscope.registry.tasks' via 2025-01-23T06:13:00,717 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-23T06:13:00,717 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-23T06:13:00,718 combination with a more fine grained `package-data` configuration. 2025-01-23T06:13:00,719 You can read more about "package data files" on setuptools documentation page: 2025-01-23T06:13:00,720 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-23T06:13:00,722 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-23T06:13:00,722 even if it does not contain any `.py` files. 2025-01-23T06:13:00,723 On the other hand, currently there is no concept of package data 2025-01-23T06:13:00,723 directory, all directories are treated like packages. 2025-01-23T06:13:00,724 ******************************************************************************** 2025-01-23T06:13:00,730 !! 2025-01-23T06:13:00,730 check.warn(importable) 2025-01-23T06:13:00,731 creating build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,731 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,732 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,732 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,733 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,734 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,734 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,735 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,735 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,736 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,736 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,737 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-01-23T06:13:00,737 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,738 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,738 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,739 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,739 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,745 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,748 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,751 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,752 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,752 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,753 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,754 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,755 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,755 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,755 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,756 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,756 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,757 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,758 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,758 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,759 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,759 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,760 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,760 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,761 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,762 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,762 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,763 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:00,763 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,764 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,764 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,764 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:00,765 creating build/lib/evalscope/metrics/resources 2025-01-23T06:13:00,766 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-01-23T06:13:00,766 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-01-23T06:13:00,766 creating build/lib/evalscope/registry/config 2025-01-23T06:13:00,767 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-01-23T06:13:00,768 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-01-23T06:13:00,768 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-01-23T06:13:00,768 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-01-23T06:13:00,769 creating build/lib/evalscope/registry/data 2025-01-23T06:13:00,770 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-01-23T06:13:00,771 creating build/lib/evalscope/registry/data/prompt_template 2025-01-23T06:13:00,772 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-23T06:13:00,775 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-23T06:13:00,778 creating build/lib/evalscope/registry/data/qa_browser 2025-01-23T06:13:00,779 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-01-23T06:13:00,808 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-01-23T06:13:00,815 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-23T06:13:00,829 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-01-23T06:13:00,831 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2025-01-23T06:13:00,833 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-01-23T06:13:00,835 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-01-23T06:13:00,837 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-01-23T06:13:00,840 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:00,841 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:00,844 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:00,846 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-23T06:13:00,847 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-23T06:13:00,849 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,851 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,853 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,855 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-01-23T06:13:00,857 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,859 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,862 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-01-23T06:13:00,915 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-01-23T06:13:00,915 !! 2025-01-23T06:13:00,916 ******************************************************************************** 2025-01-23T06:13:00,917 Please avoid running ``setup.py`` directly. 2025-01-23T06:13:00,918 Instead, use pypa/build, pypa/installer or other 2025-01-23T06:13:00,918 standards-based tools. 2025-01-23T06:13:00,919 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-01-23T06:13:00,920 ******************************************************************************** 2025-01-23T06:13:00,921 !! 2025-01-23T06:13:00,921 self.initialize_options() 2025-01-23T06:13:00,942 installing to build/bdist.linux-armv7l/wheel 2025-01-23T06:13:00,943 running install 2025-01-23T06:13:00,967 running install_lib 2025-01-23T06:13:00,994 creating build/bdist.linux-armv7l/wheel 2025-01-23T06:13:00,996 creating build/bdist.linux-armv7l/wheel/tests 2025-01-23T06:13:00,997 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-23T06:13:01,000 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-01-23T06:13:01,001 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-23T06:13:01,002 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-23T06:13:01,004 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-23T06:13:01,006 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-23T06:13:01,009 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-01-23T06:13:01,010 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-23T06:13:01,012 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-23T06:13:01,014 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-23T06:13:01,016 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-23T06:13:01,018 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-01-23T06:13:01,019 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-23T06:13:01,022 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-23T06:13:01,024 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-01-23T06:13:01,025 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-23T06:13:01,027 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-23T06:13:01,029 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-01-23T06:13:01,030 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-23T06:13:01,032 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-23T06:13:01,034 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-23T06:13:01,036 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-23T06:13:01,039 creating build/bdist.linux-armv7l/wheel/evalscope 2025-01-23T06:13:01,040 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-01-23T06:13:01,042 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-01-23T06:13:01,044 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-23T06:13:01,068 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-23T06:13:01,079 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,080 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,083 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,085 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-01-23T06:13:01,086 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-23T06:13:01,088 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-23T06:13:01,090 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,093 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,095 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-23T06:13:01,097 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-01-23T06:13:01,098 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,100 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,103 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,104 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,107 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,109 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,111 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,113 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-23T06:13:01,115 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,118 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-01-23T06:13:01,119 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-01-23T06:13:01,121 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-23T06:13:01,123 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-23T06:13:01,125 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-23T06:13:01,127 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-23T06:13:01,130 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-23T06:13:01,132 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-01-23T06:13:01,133 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,135 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,138 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-01-23T06:13:01,139 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-23T06:13:01,141 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-23T06:13:01,142 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-23T06:13:01,144 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,146 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,148 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,151 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,153 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,155 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-23T06:13:01,157 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-01-23T06:13:01,158 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-01-23T06:13:01,161 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-01-23T06:13:01,162 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,164 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,166 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,167 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,169 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,171 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,173 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,174 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,176 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,178 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,180 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-23T06:13:01,182 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-01-23T06:13:01,184 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-01-23T06:13:01,185 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-23T06:13:01,187 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-23T06:13:01,206 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-01-23T06:13:01,209 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-01-23T06:13:01,210 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-23T06:13:01,212 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-23T06:13:01,215 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-01-23T06:13:01,216 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-23T06:13:01,218 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-23T06:13:01,220 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-23T06:13:01,222 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-23T06:13:01,225 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-01-23T06:13:01,226 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-23T06:13:01,228 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-01-23T06:13:01,230 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-23T06:13:01,232 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-23T06:13:01,234 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-01-23T06:13:01,235 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-23T06:13:01,237 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-23T06:13:01,240 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-01-23T06:13:01,241 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-23T06:13:01,243 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-23T06:13:01,245 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-23T06:13:01,247 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-23T06:13:01,249 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-01-23T06:13:01,250 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-23T06:13:01,253 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,254 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,256 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,258 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,260 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,262 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,264 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,266 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,267 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,269 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,271 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,273 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,275 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,277 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,279 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,281 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,284 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,286 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,288 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,291 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,293 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,296 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,298 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,301 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,303 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,306 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,308 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,311 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-23T06:13:01,314 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-23T06:13:01,317 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-01-23T06:13:01,319 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,323 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,326 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,329 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,331 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,334 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-01-23T06:13:01,338 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-01-23T06:13:01,339 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-23T06:13:01,342 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-23T06:13:01,346 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-23T06:13:01,348 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-23T06:13:01,350 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-23T06:13:01,354 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-01-23T06:13:01,356 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-23T06:13:01,359 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-23T06:13:01,362 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-23T06:13:01,364 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-23T06:13:01,368 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-01-23T06:13:01,369 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-23T06:13:01,372 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-23T06:13:01,375 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-23T06:13:01,378 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-01-23T06:13:01,379 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-23T06:13:01,381 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-23T06:13:01,383 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-23T06:13:01,386 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-01-23T06:13:01,387 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-23T06:13:01,389 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-23T06:13:01,391 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-23T06:13:01,394 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-01-23T06:13:01,396 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-23T06:13:01,398 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-23T06:13:01,400 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-23T06:13:01,403 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-01-23T06:13:01,404 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-23T06:13:01,406 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-23T06:13:01,408 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-23T06:13:01,410 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-23T06:13:01,413 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-01-23T06:13:01,414 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-23T06:13:01,416 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-23T06:13:01,418 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-23T06:13:01,420 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-23T06:13:01,423 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-01-23T06:13:01,424 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-23T06:13:01,426 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-23T06:13:01,428 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-23T06:13:01,430 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-23T06:13:01,433 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-01-23T06:13:01,435 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-23T06:13:01,437 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-23T06:13:01,439 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-23T06:13:01,443 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-01-23T06:13:01,444 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-01-23T06:13:01,446 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-01-23T06:13:01,448 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-01-23T06:13:01,451 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-01-23T06:13:01,453 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-01-23T06:13:01,455 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-01-23T06:13:01,457 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,460 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-01-23T06:13:01,462 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-01-23T06:13:01,463 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-23T06:13:01,465 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-23T06:13:01,467 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-23T06:13:01,470 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-01-23T06:13:01,472 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-23T06:13:01,474 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-23T06:13:01,476 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-23T06:13:01,479 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-23T06:13:01,481 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-23T06:13:01,484 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-01-23T06:13:01,485 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-23T06:13:01,487 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-23T06:13:01,490 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-23T06:13:01,493 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-01-23T06:13:01,495 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,496 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,498 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,501 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,503 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,506 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-23T06:13:01,508 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-23T06:13:01,511 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-23T06:13:01,514 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:01,515 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:01,517 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:01,520 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-23T06:13:01,522 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:01,524 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:01,527 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:01,529 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-23T06:13:01,532 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:01,533 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:01,535 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:01,538 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:01,540 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-23T06:13:01,543 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-01-23T06:13:01,545 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-01-23T06:13:01,547 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-01-23T06:13:01,549 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-23T06:13:01,551 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-23T06:13:01,554 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-23T06:13:01,556 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,558 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,560 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,563 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,565 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,568 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-23T06:13:01,571 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:01,572 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:01,574 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:01,576 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:01,579 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-23T06:13:01,582 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,583 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,586 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,588 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,590 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,593 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,596 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,598 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,601 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-23T06:13:01,604 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-01-23T06:13:01,606 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,608 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,610 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,612 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,614 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,616 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,619 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-23T06:13:01,621 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,624 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-01-23T06:13:01,625 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-23T06:13:01,628 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-23T06:13:01,631 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-23T06:13:01,633 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-23T06:13:01,635 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-01-23T06:13:01,638 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,640 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,643 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-01-23T06:13:01,644 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-23T06:13:01,647 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-23T06:13:01,649 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-23T06:13:01,651 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-23T06:13:01,654 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,656 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,659 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-23T06:13:01,662 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-01-23T06:13:01,663 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-01-23T06:13:01,666 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-01-23T06:13:01,667 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,670 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,672 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:01,674 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:01,676 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-23T06:13:01,678 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,681 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,683 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,685 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,688 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,691 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-23T06:13:01,693 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-01-23T06:13:01,695 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,697 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,700 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,702 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,706 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,708 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,711 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,714 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-23T06:13:01,716 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,719 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,721 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,724 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,727 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,729 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-23T06:13:01,732 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-01-23T06:13:01,734 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-23T06:13:01,737 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-23T06:13:01,739 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-23T06:13:01,742 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-01-23T06:13:01,744 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-01-23T06:13:01,746 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,749 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,751 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,754 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,756 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,758 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-23T06:13:01,761 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-23T06:13:01,764 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-01-23T06:13:01,766 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-23T06:13:01,769 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-01-23T06:13:01,770 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,773 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,775 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,777 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,779 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,782 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,784 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,786 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-23T06:13:01,788 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-23T06:13:01,790 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-01-23T06:13:01,792 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-23T06:13:01,794 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-23T06:13:01,796 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-23T06:13:01,799 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-23T06:13:01,801 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-23T06:13:01,804 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-23T06:13:01,806 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-23T06:13:01,809 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-23T06:13:01,812 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-23T06:13:01,814 running install_egg_info 2025-01-23T06:13:01,848 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.10.1-py3.11.egg-info 2025-01-23T06:13:01,864 running install_scripts 2025-01-23T06:13:01,916 creating build/bdist.linux-armv7l/wheel/evalscope-0.10.1.dist-info/WHEEL 2025-01-23T06:13:01,918 creating '/tmp/pip-wheel-hnn8y7uu/evalscope-0.10.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-01-23T06:13:01,921 adding 'evalscope/__init__.py' 2025-01-23T06:13:01,923 adding 'evalscope/arguments.py' 2025-01-23T06:13:01,925 adding 'evalscope/config.py' 2025-01-23T06:13:01,927 adding 'evalscope/constants.py' 2025-01-23T06:13:01,929 adding 'evalscope/run.py' 2025-01-23T06:13:01,931 adding 'evalscope/run_arena.py' 2025-01-23T06:13:01,933 adding 'evalscope/summarizer.py' 2025-01-23T06:13:01,934 adding 'evalscope/version.py' 2025-01-23T06:13:01,936 adding 'evalscope/backend/__init__.py' 2025-01-23T06:13:01,938 adding 'evalscope/backend/base.py' 2025-01-23T06:13:01,940 adding 'evalscope/backend/opencompass/__init__.py' 2025-01-23T06:13:01,942 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-01-23T06:13:01,944 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-01-23T06:13:01,946 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-01-23T06:13:01,948 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-01-23T06:13:01,950 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-01-23T06:13:01,952 adding 'evalscope/backend/rag_eval/__init__.py' 2025-01-23T06:13:01,954 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-01-23T06:13:01,955 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-01-23T06:13:01,957 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-01-23T06:13:01,959 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-01-23T06:13:01,961 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-01-23T06:13:01,962 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-01-23T06:13:01,964 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-01-23T06:13:01,966 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-01-23T06:13:01,968 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-01-23T06:13:01,970 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-01-23T06:13:01,972 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-01-23T06:13:01,974 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-01-23T06:13:01,975 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-01-23T06:13:01,977 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-01-23T06:13:01,979 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-01-23T06:13:01,981 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-01-23T06:13:01,983 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-01-23T06:13:01,985 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-01-23T06:13:01,986 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-01-23T06:13:01,988 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-01-23T06:13:01,990 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-01-23T06:13:01,992 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-01-23T06:13:01,994 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-01-23T06:13:01,996 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-01-23T06:13:01,997 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-01-23T06:13:01,999 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-01-23T06:13:02,001 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-01-23T06:13:02,002 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-01-23T06:13:02,004 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-01-23T06:13:02,006 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-01-23T06:13:02,008 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-01-23T06:13:02,009 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-01-23T06:13:02,011 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-01-23T06:13:02,013 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-01-23T06:13:02,014 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-01-23T06:13:02,016 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-01-23T06:13:02,018 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-01-23T06:13:02,019 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-01-23T06:13:02,021 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-01-23T06:13:02,023 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-01-23T06:13:02,025 adding 'evalscope/benchmarks/__init__.py' 2025-01-23T06:13:02,027 adding 'evalscope/benchmarks/benchmark.py' 2025-01-23T06:13:02,029 adding 'evalscope/benchmarks/data_adapter.py' 2025-01-23T06:13:02,031 adding 'evalscope/benchmarks/arc/__init__.py' 2025-01-23T06:13:02,032 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-01-23T06:13:02,034 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-01-23T06:13:02,036 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-01-23T06:13:02,038 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-01-23T06:13:02,040 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-01-23T06:13:02,042 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-01-23T06:13:02,044 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-01-23T06:13:02,045 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-01-23T06:13:02,047 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-01-23T06:13:02,048 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-01-23T06:13:02,050 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-01-23T06:13:02,052 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-01-23T06:13:02,053 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-01-23T06:13:02,055 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-01-23T06:13:02,056 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-01-23T06:13:02,058 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-01-23T06:13:02,059 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-01-23T06:13:02,061 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-01-23T06:13:02,062 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-01-23T06:13:02,064 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-01-23T06:13:02,065 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-01-23T06:13:02,067 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-01-23T06:13:02,069 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-01-23T06:13:02,070 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-01-23T06:13:02,072 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-01-23T06:13:02,074 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-01-23T06:13:02,075 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-01-23T06:13:02,077 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-01-23T06:13:02,078 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-01-23T06:13:02,080 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-01-23T06:13:02,082 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-01-23T06:13:02,083 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-01-23T06:13:02,086 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-01-23T06:13:02,087 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-01-23T06:13:02,089 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2025-01-23T06:13:02,091 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-01-23T06:13:02,092 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-01-23T06:13:02,095 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-01-23T06:13:02,096 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-01-23T06:13:02,098 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-01-23T06:13:02,100 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-01-23T06:13:02,101 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-01-23T06:13:02,103 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-01-23T06:13:02,105 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-01-23T06:13:02,107 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-01-23T06:13:02,108 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-01-23T06:13:02,110 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-01-23T06:13:02,112 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-01-23T06:13:02,114 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-01-23T06:13:02,116 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-01-23T06:13:02,118 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-01-23T06:13:02,120 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-01-23T06:13:02,122 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-01-23T06:13:02,124 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-01-23T06:13:02,126 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-01-23T06:13:02,127 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-01-23T06:13:02,129 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-01-23T06:13:02,131 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-01-23T06:13:02,136 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-01-23T06:13:02,138 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-01-23T06:13:02,142 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-01-23T06:13:02,144 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-01-23T06:13:02,146 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-01-23T06:13:02,147 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-01-23T06:13:02,149 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-01-23T06:13:02,151 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-01-23T06:13:02,153 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-01-23T06:13:02,155 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-01-23T06:13:02,157 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-01-23T06:13:02,158 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-01-23T06:13:02,160 adding 'evalscope/benchmarks/race/__init__.py' 2025-01-23T06:13:02,162 adding 'evalscope/benchmarks/race/race.py' 2025-01-23T06:13:02,164 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-01-23T06:13:02,165 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-01-23T06:13:02,167 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-01-23T06:13:02,169 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-01-23T06:13:02,170 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-01-23T06:13:02,172 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-01-23T06:13:02,174 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-01-23T06:13:02,176 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-01-23T06:13:02,178 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-01-23T06:13:02,180 adding 'evalscope/cli/__init__.py' 2025-01-23T06:13:02,181 adding 'evalscope/cli/base.py' 2025-01-23T06:13:02,183 adding 'evalscope/cli/cli.py' 2025-01-23T06:13:02,184 adding 'evalscope/cli/start_app.py' 2025-01-23T06:13:02,186 adding 'evalscope/cli/start_eval.py' 2025-01-23T06:13:02,187 adding 'evalscope/cli/start_perf.py' 2025-01-23T06:13:02,188 adding 'evalscope/cli/start_server.py' 2025-01-23T06:13:02,190 adding 'evalscope/collections/__init__.py' 2025-01-23T06:13:02,192 adding 'evalscope/collections/evaluator.py' 2025-01-23T06:13:02,194 adding 'evalscope/collections/sampler.py' 2025-01-23T06:13:02,196 adding 'evalscope/collections/schema.py' 2025-01-23T06:13:02,197 adding 'evalscope/evaluator/__init__.py' 2025-01-23T06:13:02,200 adding 'evalscope/evaluator/evaluator.py' 2025-01-23T06:13:02,202 adding 'evalscope/evaluator/rating_eval.py' 2025-01-23T06:13:02,204 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-01-23T06:13:02,206 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-01-23T06:13:02,208 adding 'evalscope/metrics/__init__.py' 2025-01-23T06:13:02,210 adding 'evalscope/metrics/code_metric.py' 2025-01-23T06:13:02,211 adding 'evalscope/metrics/math_accuracy.py' 2025-01-23T06:13:02,214 adding 'evalscope/metrics/metrics.py' 2025-01-23T06:13:02,215 adding 'evalscope/metrics/named_metrics.py' 2025-01-23T06:13:02,217 adding 'evalscope/metrics/rouge_metric.py' 2025-01-23T06:13:02,219 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-01-23T06:13:02,221 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-01-23T06:13:02,379 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-01-23T06:13:02,625 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-01-23T06:13:02,635 adding 'evalscope/models/__init__.py' 2025-01-23T06:13:02,636 adding 'evalscope/models/base_adapter.py' 2025-01-23T06:13:02,638 adding 'evalscope/models/chat_adapter.py' 2025-01-23T06:13:02,640 adding 'evalscope/models/choice_adapter.py' 2025-01-23T06:13:02,642 adding 'evalscope/models/custom_adapter.py' 2025-01-23T06:13:02,643 adding 'evalscope/models/local_model.py' 2025-01-23T06:13:02,645 adding 'evalscope/models/model.py' 2025-01-23T06:13:02,647 adding 'evalscope/models/server_adapter.py' 2025-01-23T06:13:02,648 adding 'evalscope/models/custom/__init__.py' 2025-01-23T06:13:02,650 adding 'evalscope/models/custom/custom_model.py' 2025-01-23T06:13:02,651 adding 'evalscope/models/custom/dummy_model.py' 2025-01-23T06:13:02,653 adding 'evalscope/perf/__init__.py' 2025-01-23T06:13:02,655 adding 'evalscope/perf/arguments.py' 2025-01-23T06:13:02,657 adding 'evalscope/perf/benchmark.py' 2025-01-23T06:13:02,659 adding 'evalscope/perf/http_client.py' 2025-01-23T06:13:02,661 adding 'evalscope/perf/main.py' 2025-01-23T06:13:02,663 adding 'evalscope/perf/plugin/__init__.py' 2025-01-23T06:13:02,664 adding 'evalscope/perf/plugin/registry.py' 2025-01-23T06:13:02,666 adding 'evalscope/perf/plugin/api/__init__.py' 2025-01-23T06:13:02,667 adding 'evalscope/perf/plugin/api/base.py' 2025-01-23T06:13:02,669 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-01-23T06:13:02,671 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-01-23T06:13:02,672 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-01-23T06:13:02,674 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-01-23T06:13:02,676 adding 'evalscope/perf/plugin/datasets/base.py' 2025-01-23T06:13:02,677 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-01-23T06:13:02,679 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-01-23T06:13:02,680 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-01-23T06:13:02,682 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-01-23T06:13:02,683 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-01-23T06:13:02,685 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-01-23T06:13:02,687 adding 'evalscope/perf/utils/__init__.py' 2025-01-23T06:13:02,688 adding 'evalscope/perf/utils/analysis_result.py' 2025-01-23T06:13:02,690 adding 'evalscope/perf/utils/benchmark_util.py' 2025-01-23T06:13:02,692 adding 'evalscope/perf/utils/db_util.py' 2025-01-23T06:13:02,693 adding 'evalscope/perf/utils/handler.py' 2025-01-23T06:13:02,695 adding 'evalscope/perf/utils/local_server.py' 2025-01-23T06:13:02,697 adding 'evalscope/registry/__init__.py' 2025-01-23T06:13:02,699 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-01-23T06:13:02,700 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-01-23T06:13:02,702 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-01-23T06:13:02,704 adding 'evalscope/registry/config/cfg_single.yaml' 2025-01-23T06:13:02,707 adding 'evalscope/registry/data/question.jsonl' 2025-01-23T06:13:02,709 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-01-23T06:13:02,711 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-01-23T06:13:02,876 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-01-23T06:13:02,885 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-01-23T06:13:02,887 adding 'evalscope/registry/tasks/arc.yaml' 2025-01-23T06:13:02,889 adding 'evalscope/registry/tasks/bbh.yaml' 2025-01-23T06:13:02,890 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-01-23T06:13:02,892 adding 'evalscope/registry/tasks/ceval.yaml' 2025-01-23T06:13:02,893 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-01-23T06:13:02,895 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-01-23T06:13:02,896 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-01-23T06:13:02,898 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-01-23T06:13:02,899 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-01-23T06:13:02,900 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-01-23T06:13:02,902 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-01-23T06:13:02,904 adding 'evalscope/report/__init__.py' 2025-01-23T06:13:02,907 adding 'evalscope/report/app.py' 2025-01-23T06:13:02,909 adding 'evalscope/report/combinator.py' 2025-01-23T06:13:02,910 adding 'evalscope/report/generator.py' 2025-01-23T06:13:02,912 adding 'evalscope/report/utils.py' 2025-01-23T06:13:02,914 adding 'evalscope/third_party/__init__.py' 2025-01-23T06:13:02,917 adding 'evalscope/third_party/longbench_write/README.md' 2025-01-23T06:13:02,918 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-01-23T06:13:02,920 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-01-23T06:13:02,922 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-01-23T06:13:02,924 adding 'evalscope/third_party/longbench_write/eval.py' 2025-01-23T06:13:02,926 adding 'evalscope/third_party/longbench_write/infer.py' 2025-01-23T06:13:02,928 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-01-23T06:13:02,929 adding 'evalscope/third_party/longbench_write/utils.py' 2025-01-23T06:13:02,931 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-01-23T06:13:02,933 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-01-23T06:13:02,940 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-01-23T06:13:02,945 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-01-23T06:13:02,946 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-01-23T06:13:02,948 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-01-23T06:13:02,950 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-01-23T06:13:02,952 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-01-23T06:13:02,954 adding 'evalscope/third_party/toolbench_static/README.md' 2025-01-23T06:13:02,956 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-01-23T06:13:02,958 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-01-23T06:13:02,959 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-01-23T06:13:02,961 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-01-23T06:13:02,964 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-01-23T06:13:02,966 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-01-23T06:13:02,967 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-01-23T06:13:02,969 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-01-23T06:13:02,971 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-01-23T06:13:02,973 adding 'evalscope/utils/__init__.py' 2025-01-23T06:13:02,975 adding 'evalscope/utils/arena_utils.py' 2025-01-23T06:13:02,976 adding 'evalscope/utils/chat_service.py' 2025-01-23T06:13:02,978 adding 'evalscope/utils/completion_parsers.py' 2025-01-23T06:13:02,980 adding 'evalscope/utils/io_utils.py' 2025-01-23T06:13:02,981 adding 'evalscope/utils/logger.py' 2025-01-23T06:13:02,983 adding 'evalscope/utils/model_utils.py' 2025-01-23T06:13:02,985 adding 'evalscope/utils/utils.py' 2025-01-23T06:13:02,987 adding 'tests/__init__.py' 2025-01-23T06:13:02,989 adding 'tests/test_run_all.py' 2025-01-23T06:13:02,991 adding 'tests/cli/__init__.py' 2025-01-23T06:13:02,992 adding 'tests/cli/test_collection.py' 2025-01-23T06:13:02,994 adding 'tests/cli/test_run.py' 2025-01-23T06:13:02,996 adding 'tests/perf/__init__.py' 2025-01-23T06:13:02,998 adding 'tests/perf/test_perf.py' 2025-01-23T06:13:03,000 adding 'tests/rag/__init__.py' 2025-01-23T06:13:03,002 adding 'tests/rag/test_clip_benchmark.py' 2025-01-23T06:13:03,004 adding 'tests/rag/test_mteb.py' 2025-01-23T06:13:03,006 adding 'tests/rag/test_ragas.py' 2025-01-23T06:13:03,008 adding 'tests/swift/__init__.py' 2025-01-23T06:13:03,010 adding 'tests/swift/test_run_swift_eval.py' 2025-01-23T06:13:03,012 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-01-23T06:13:03,014 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-01-23T06:13:03,016 adding 'tests/vlm/__init__.py' 2025-01-23T06:13:03,017 adding 'tests/vlm/test_vlmeval.py' 2025-01-23T06:13:03,019 adding 'evalscope-0.10.1.dist-info/LICENSE' 2025-01-23T06:13:03,023 adding 'evalscope-0.10.1.dist-info/METADATA' 2025-01-23T06:13:03,025 adding 'evalscope-0.10.1.dist-info/WHEEL' 2025-01-23T06:13:03,026 adding 'evalscope-0.10.1.dist-info/entry_points.txt' 2025-01-23T06:13:03,027 adding 'evalscope-0.10.1.dist-info/top_level.txt' 2025-01-23T06:13:03,032 adding 'evalscope-0.10.1.dist-info/RECORD' 2025-01-23T06:13:03,052 removing build/bdist.linux-armv7l/wheel 2025-01-23T06:13:03,245 Building wheel for evalscope (setup.py): finished with status 'done' 2025-01-23T06:13:03,262 Created wheel for evalscope: filename=evalscope-0.10.1-py3-none-any.whl size=1428385 sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 2025-01-23T06:13:03,263 Stored in directory: /tmp/pip-ephem-wheel-cache-f8gnevrq/wheels/aa/1b/34/04984a31c27e6d3ebc39683c22a52053973a0df79eb8bb8d18 2025-01-23T06:13:03,291 Successfully built evalscope 2025-01-23T06:13:03,336 Removed build tracker: '/tmp/pip-build-tracker-9d06mtm2'