2025-01-03T09:34:08,224 Created temporary directory: /tmp/pip-build-tracker-dr0bjoez 2025-01-03T09:34:08,225 Initialized build tracking at /tmp/pip-build-tracker-dr0bjoez 2025-01-03T09:34:08,226 Created build tracker: /tmp/pip-build-tracker-dr0bjoez 2025-01-03T09:34:08,226 Entered build tracker: /tmp/pip-build-tracker-dr0bjoez 2025-01-03T09:34:08,227 Created temporary directory: /tmp/pip-wheel-pa621wrj 2025-01-03T09:34:08,231 Created temporary directory: /tmp/pip-ephem-wheel-cache-t0ayms4f 2025-01-03T09:34:08,275 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-01-03T09:34:08,278 2 location(s) to search for versions of evalscope: 2025-01-03T09:34:08,278 * https://pypi.org/simple/evalscope/ 2025-01-03T09:34:08,278 * https://www.piwheels.org/simple/evalscope/ 2025-01-03T09:34:08,279 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-01-03T09:34:08,279 Getting page https://pypi.org/simple/evalscope/ 2025-01-03T09:34:08,281 Found index url https://pypi.org/simple/ 2025-01-03T09:34:08,503 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-01-03T09:34:08,511 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,512 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-01-03T09:34:08,513 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,513 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-01-03T09:34:08,514 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,515 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-01-03T09:34:08,516 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,517 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-01-03T09:34:08,517 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,518 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-01-03T09:34:08,519 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,520 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,521 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-01-03T09:34:08,521 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,522 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-01-03T09:34:08,523 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,524 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-01-03T09:34:08,524 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,525 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-01-03T09:34:08,525 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,526 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-01-03T09:34:08,527 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,528 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-01-03T09:34:08,529 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,530 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-01-03T09:34:08,530 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,531 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-01-03T09:34:08,532 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,533 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-01-03T09:34:08,534 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,534 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-01-03T09:34:08,535 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,536 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-01-03T09:34:08,536 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,537 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-01-03T09:34:08,538 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-01-03T09:34:08,539 Getting page https://www.piwheels.org/simple/evalscope/ 2025-01-03T09:34:08,540 Found index url https://www.piwheels.org/simple/ 2025-01-03T09:34:08,715 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-01-03T09:34:08,718 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,718 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,719 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,720 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,720 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,721 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-01-03T09:34:08,722 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-01-03T09:34:08,722 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-01-03T09:34:08,743 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-01-03T09:34:08,745 Collecting evalscope==0.9.0 2025-01-03T09:34:08,747 Created temporary directory: /tmp/pip-unpack-kvphe0wl 2025-01-03T09:34:08,976 Downloading evalscope-0.9.0.tar.gz (1.3 MB) 2025-01-03T09:34:09,924 Added evalscope==0.9.0 from https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz to build tracker '/tmp/pip-build-tracker-dr0bjoez' 2025-01-03T09:34:09,926 Running setup.py (path:/tmp/pip-wheel-pa621wrj/evalscope_b9e2946809fd45d0bf48e7fe85b52e1c/setup.py) egg_info for package evalscope 2025-01-03T09:34:09,927 Created temporary directory: /tmp/pip-pip-egg-info-6_86y1b8 2025-01-03T09:34:09,927 Preparing metadata (setup.py): started 2025-01-03T09:34:09,929 Running command python setup.py egg_info 2025-01-03T09:34:10,535 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-03T09:34:10,535 !! 2025-01-03T09:34:10,536 ******************************************************************************** 2025-01-03T09:34:10,537 Usage of dash-separated 'index-url' will not be supported in future 2025-01-03T09:34:10,537 versions. Please use the underscore name 'index_url' instead. 2025-01-03T09:34:10,538 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-03T09:34:10,539 or your builds will no longer be supported. 2025-01-03T09:34:10,540 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-03T09:34:10,541 ******************************************************************************** 2025-01-03T09:34:10,542 !! 2025-01-03T09:34:10,542 opt = self.warn_dash_deprecation(opt, section) 2025-01-03T09:34:11,115 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-03T09:34:11,115 !! 2025-01-03T09:34:11,117 ******************************************************************************** 2025-01-03T09:34:11,117 Usage of dash-separated 'index-url' will not be supported in future 2025-01-03T09:34:11,118 versions. Please use the underscore name 'index_url' instead. 2025-01-03T09:34:11,119 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-03T09:34:11,119 or your builds will no longer be supported. 2025-01-03T09:34:11,121 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-03T09:34:11,121 ******************************************************************************** 2025-01-03T09:34:11,122 !! 2025-01-03T09:34:11,123 opt = self.warn_dash_deprecation(opt, section) 2025-01-03T09:34:11,154 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-03T09:34:11,155 running egg_info 2025-01-03T09:34:11,182 creating /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info 2025-01-03T09:34:11,183 writing /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/PKG-INFO 2025-01-03T09:34:11,211 writing dependency_links to /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/dependency_links.txt 2025-01-03T09:34:11,213 writing entry points to /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/entry_points.txt 2025-01-03T09:34:11,226 writing requirements to /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/requires.txt 2025-01-03T09:34:11,228 writing top-level names to /tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/top_level.txt 2025-01-03T09:34:11,229 writing manifest file '/tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/SOURCES.txt' 2025-01-03T09:34:11,381 reading manifest file '/tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/SOURCES.txt' 2025-01-03T09:34:11,383 reading manifest template 'MANIFEST.in' 2025-01-03T09:34:11,493 adding license file 'LICENSE' 2025-01-03T09:34:11,508 writing manifest file '/tmp/pip-pip-egg-info-6_86y1b8/evalscope.egg-info/SOURCES.txt' 2025-01-03T09:34:11,617 Preparing metadata (setup.py): finished with status 'done' 2025-01-03T09:34:11,623 Source in /tmp/pip-wheel-pa621wrj/evalscope_b9e2946809fd45d0bf48e7fe85b52e1c has version 0.9.0, which satisfies requirement evalscope==0.9.0 from https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz 2025-01-03T09:34:11,624 Removed evalscope==0.9.0 from https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz from build tracker '/tmp/pip-build-tracker-dr0bjoez' 2025-01-03T09:34:11,677 Created temporary directory: /tmp/pip-unpack-swpj_8tt 2025-01-03T09:34:11,678 Created temporary directory: /tmp/pip-unpack-8l23f_dy 2025-01-03T09:34:11,678 Building wheels for collected packages: evalscope 2025-01-03T09:34:11,682 Created temporary directory: /tmp/pip-wheel-8b6tlokl 2025-01-03T09:34:11,683 Building wheel for evalscope (setup.py): started 2025-01-03T09:34:11,684 Destination directory: /tmp/pip-wheel-8b6tlokl 2025-01-03T09:34:11,685 Running command python setup.py bdist_wheel 2025-01-03T09:34:12,146 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-01-03T09:34:12,249 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-03T09:34:12,250 !! 2025-01-03T09:34:12,251 ******************************************************************************** 2025-01-03T09:34:12,252 Usage of dash-separated 'index-url' will not be supported in future 2025-01-03T09:34:12,252 versions. Please use the underscore name 'index_url' instead. 2025-01-03T09:34:12,254 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-03T09:34:12,254 or your builds will no longer be supported. 2025-01-03T09:34:12,256 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-03T09:34:12,256 ******************************************************************************** 2025-01-03T09:34:12,258 !! 2025-01-03T09:34:12,258 opt = self.warn_dash_deprecation(opt, section) 2025-01-03T09:34:12,830 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-01-03T09:34:12,831 !! 2025-01-03T09:34:12,832 ******************************************************************************** 2025-01-03T09:34:12,832 Usage of dash-separated 'index-url' will not be supported in future 2025-01-03T09:34:12,833 versions. Please use the underscore name 'index_url' instead. 2025-01-03T09:34:12,834 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-01-03T09:34:12,835 or your builds will no longer be supported. 2025-01-03T09:34:12,836 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-01-03T09:34:12,837 ******************************************************************************** 2025-01-03T09:34:12,838 !! 2025-01-03T09:34:12,838 opt = self.warn_dash_deprecation(opt, section) 2025-01-03T09:34:12,840 running bdist_wheel 2025-01-03T09:34:12,977 running build 2025-01-03T09:34:12,978 running build_py 2025-01-03T09:34:13,008 creating build/lib/evalscope 2025-01-03T09:34:13,011 copying evalscope/run_arena.py -> build/lib/evalscope 2025-01-03T09:34:13,013 copying evalscope/run.py -> build/lib/evalscope 2025-01-03T09:34:13,016 copying evalscope/version.py -> build/lib/evalscope 2025-01-03T09:34:13,017 copying evalscope/__init__.py -> build/lib/evalscope 2025-01-03T09:34:13,019 copying evalscope/constants.py -> build/lib/evalscope 2025-01-03T09:34:13,021 copying evalscope/arguments.py -> build/lib/evalscope 2025-01-03T09:34:13,023 copying evalscope/config.py -> build/lib/evalscope 2025-01-03T09:34:13,026 copying evalscope/summarizer.py -> build/lib/evalscope 2025-01-03T09:34:13,029 creating build/lib/tests 2025-01-03T09:34:13,030 copying tests/test_run_all.py -> build/lib/tests 2025-01-03T09:34:13,032 copying tests/__init__.py -> build/lib/tests 2025-01-03T09:34:13,035 creating build/lib/evalscope/tools 2025-01-03T09:34:13,036 copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools 2025-01-03T09:34:13,038 copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools 2025-01-03T09:34:13,040 copying evalscope/tools/__init__.py -> build/lib/evalscope/tools 2025-01-03T09:34:13,041 copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools 2025-01-03T09:34:13,044 creating build/lib/evalscope/registry 2025-01-03T09:34:13,045 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-01-03T09:34:13,047 creating build/lib/evalscope/backend 2025-01-03T09:34:13,048 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-01-03T09:34:13,050 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-01-03T09:34:13,053 creating build/lib/evalscope/metrics 2025-01-03T09:34:13,054 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-01-03T09:34:13,056 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-01-03T09:34:13,057 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-01-03T09:34:13,060 copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics 2025-01-03T09:34:13,062 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-01-03T09:34:13,065 creating build/lib/evalscope/cli 2025-01-03T09:34:13,066 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,068 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,070 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,072 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,074 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,075 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-01-03T09:34:13,078 creating build/lib/evalscope/benchmarks 2025-01-03T09:34:13,079 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-01-03T09:34:13,081 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-01-03T09:34:13,084 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-01-03T09:34:13,086 creating build/lib/evalscope/utils 2025-01-03T09:34:13,087 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,090 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,092 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,094 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,096 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,098 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,101 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,103 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-01-03T09:34:13,105 creating build/lib/evalscope/perf 2025-01-03T09:34:13,107 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-01-03T09:34:13,109 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-01-03T09:34:13,111 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-01-03T09:34:13,113 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-01-03T09:34:13,115 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-01-03T09:34:13,118 creating build/lib/evalscope/third_party 2025-01-03T09:34:13,119 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-01-03T09:34:13,122 creating build/lib/evalscope/evaluator 2025-01-03T09:34:13,123 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-01-03T09:34:13,125 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-01-03T09:34:13,127 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-01-03T09:34:13,130 creating build/lib/evalscope/models 2025-01-03T09:34:13,131 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-01-03T09:34:13,133 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-01-03T09:34:13,135 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-01-03T09:34:13,137 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-01-03T09:34:13,139 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-01-03T09:34:13,141 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-01-03T09:34:13,143 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-01-03T09:34:13,145 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-01-03T09:34:13,147 creating build/lib/evalscope/collections 2025-01-03T09:34:13,149 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-01-03T09:34:13,151 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-01-03T09:34:13,153 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-01-03T09:34:13,155 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-01-03T09:34:13,158 creating build/lib/evalscope/backend/rag_eval 2025-01-03T09:34:13,159 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-01-03T09:34:13,161 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-01-03T09:34:13,164 creating build/lib/evalscope/backend/opencompass 2025-01-03T09:34:13,166 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-01-03T09:34:13,168 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-01-03T09:34:13,170 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-01-03T09:34:13,173 creating build/lib/evalscope/backend/vlm_eval_kit 2025-01-03T09:34:13,174 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-03T09:34:13,176 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-03T09:34:13,178 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-01-03T09:34:13,180 creating build/lib/evalscope/backend/rag_eval/ragas 2025-01-03T09:34:13,182 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-03T09:34:13,184 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-03T09:34:13,186 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-01-03T09:34:13,188 creating build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,189 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,191 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,194 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,196 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,198 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-01-03T09:34:13,200 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:13,201 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:13,204 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:13,206 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:13,208 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:13,210 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:13,212 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:13,214 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:13,215 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:13,217 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:13,220 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,221 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,223 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,226 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,228 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,230 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:13,232 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:13,233 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:13,236 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:13,238 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:13,240 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:13,242 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,244 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,246 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,248 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,250 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,253 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,255 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,257 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,259 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:13,263 creating build/lib/evalscope/backend/opencompass/tasks 2025-01-03T09:34:13,264 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-03T09:34:13,266 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-03T09:34:13,268 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-01-03T09:34:13,271 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:13,272 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:13,274 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:13,276 creating build/lib/evalscope/benchmarks/cmmlu 2025-01-03T09:34:13,278 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-03T09:34:13,280 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-03T09:34:13,283 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-01-03T09:34:13,285 creating build/lib/evalscope/benchmarks/race 2025-01-03T09:34:13,286 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-01-03T09:34:13,288 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-01-03T09:34:13,290 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-01-03T09:34:13,293 creating build/lib/evalscope/benchmarks/hellaswag 2025-01-03T09:34:13,294 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-03T09:34:13,296 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-03T09:34:13,298 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-01-03T09:34:13,301 creating build/lib/evalscope/benchmarks/gsm8k 2025-01-03T09:34:13,302 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-03T09:34:13,305 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-03T09:34:13,307 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-01-03T09:34:13,309 creating build/lib/evalscope/benchmarks/arc 2025-01-03T09:34:13,310 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-01-03T09:34:13,313 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-01-03T09:34:13,314 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-01-03T09:34:13,317 creating build/lib/evalscope/benchmarks/competition_math 2025-01-03T09:34:13,318 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-03T09:34:13,321 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-03T09:34:13,323 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-01-03T09:34:13,326 creating build/lib/evalscope/benchmarks/bbh 2025-01-03T09:34:13,327 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-01-03T09:34:13,330 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-01-03T09:34:13,332 creating build/lib/evalscope/benchmarks/mmlu 2025-01-03T09:34:13,333 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-03T09:34:13,336 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-03T09:34:13,338 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-01-03T09:34:13,341 creating build/lib/evalscope/benchmarks/general_qa 2025-01-03T09:34:13,342 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-03T09:34:13,344 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-01-03T09:34:13,347 creating build/lib/evalscope/benchmarks/humaneval 2025-01-03T09:34:13,348 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-03T09:34:13,350 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-03T09:34:13,352 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-01-03T09:34:13,355 creating build/lib/evalscope/benchmarks/truthful_qa 2025-01-03T09:34:13,356 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-03T09:34:13,359 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-03T09:34:13,360 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-01-03T09:34:13,363 creating build/lib/evalscope/benchmarks/ceval 2025-01-03T09:34:13,364 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-01-03T09:34:13,366 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-01-03T09:34:13,369 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-01-03T09:34:13,371 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:13,373 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:13,375 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:13,377 creating build/lib/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:13,378 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:13,381 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:13,383 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:13,385 creating build/lib/evalscope/perf/plugin 2025-01-03T09:34:13,386 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-01-03T09:34:13,388 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-01-03T09:34:13,391 creating build/lib/evalscope/perf/utils 2025-01-03T09:34:13,392 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,394 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,395 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,398 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,399 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,402 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-01-03T09:34:13,405 creating build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,406 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,408 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,410 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,412 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,414 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,416 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,417 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,419 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-01-03T09:34:13,422 creating build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,423 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,425 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,427 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,429 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,431 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-01-03T09:34:13,434 creating build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,435 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,438 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,439 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,442 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,444 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:13,446 creating build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:13,447 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:13,450 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:13,452 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:13,454 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:13,457 creating build/lib/evalscope/third_party/longbench_write/tools 2025-01-03T09:34:13,458 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-03T09:34:13,460 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-03T09:34:13,463 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-01-03T09:34:13,465 creating build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:13,466 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:13,469 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:13,470 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:13,472 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:13,474 creating build/lib/evalscope/evaluator/reviewer 2025-01-03T09:34:13,475 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-01-03T09:34:13,478 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-01-03T09:34:13,480 creating build/lib/evalscope/models/custom 2025-01-03T09:34:13,481 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-01-03T09:34:13,483 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-01-03T09:34:13,486 creating build/lib/tests/swift 2025-01-03T09:34:13,487 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-01-03T09:34:13,489 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-01-03T09:34:13,491 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-01-03T09:34:13,494 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-01-03T09:34:13,496 creating build/lib/tests/vlm 2025-01-03T09:34:13,498 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-01-03T09:34:13,499 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-01-03T09:34:13,502 creating build/lib/tests/cli 2025-01-03T09:34:13,503 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-01-03T09:34:13,505 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-01-03T09:34:13,508 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-01-03T09:34:13,510 creating build/lib/tests/perf 2025-01-03T09:34:13,511 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-01-03T09:34:13,513 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-01-03T09:34:13,516 creating build/lib/tests/rag 2025-01-03T09:34:13,517 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-01-03T09:34:13,519 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-01-03T09:34:13,521 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-01-03T09:34:13,523 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-01-03T09:34:13,525 running egg_info 2025-01-03T09:34:13,554 writing evalscope.egg-info/PKG-INFO 2025-01-03T09:34:13,582 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-01-03T09:34:13,584 writing entry points to evalscope.egg-info/entry_points.txt 2025-01-03T09:34:13,597 writing requirements to evalscope.egg-info/requires.txt 2025-01-03T09:34:13,598 writing top-level names to evalscope.egg-info/top_level.txt 2025-01-03T09:34:13,678 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-03T09:34:13,696 reading manifest template 'MANIFEST.in' 2025-01-03T09:34:13,816 adding license file 'LICENSE' 2025-01-03T09:34:13,834 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-01-03T09:34:13,836 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-01-03T09:34:13,837 !! 2025-01-03T09:34:13,838 ******************************************************************************** 2025-01-03T09:34:13,839 ############################ 2025-01-03T09:34:13,839 # Package would be ignored # 2025-01-03T09:34:13,840 ############################ 2025-01-03T09:34:13,840 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-01-03T09:34:13,841 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,842 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,843 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-01-03T09:34:13,843 to the `packages` configuration field. 2025-01-03T09:34:13,845 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,845 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,846 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,847 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,848 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,849 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-01-03T09:34:13,849 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-01-03T09:34:13,850 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,850 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,850 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,851 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,852 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,853 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,854 even if it does not contain any `.py` files. 2025-01-03T09:34:13,854 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,855 directory, all directories are treated like packages. 2025-01-03T09:34:13,855 ******************************************************************************** 2025-01-03T09:34:13,856 !! 2025-01-03T09:34:13,856 check.warn(importable) 2025-01-03T09:34:13,857 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-01-03T09:34:13,857 !! 2025-01-03T09:34:13,858 ******************************************************************************** 2025-01-03T09:34:13,859 ############################ 2025-01-03T09:34:13,860 # Package would be ignored # 2025-01-03T09:34:13,860 ############################ 2025-01-03T09:34:13,860 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-01-03T09:34:13,861 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,862 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,863 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-01-03T09:34:13,863 to the `packages` configuration field. 2025-01-03T09:34:13,864 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,865 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,865 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,866 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,868 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,869 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-01-03T09:34:13,869 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-01-03T09:34:13,870 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,870 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,871 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,872 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,873 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,875 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,876 even if it does not contain any `.py` files. 2025-01-03T09:34:13,876 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,877 directory, all directories are treated like packages. 2025-01-03T09:34:13,877 ******************************************************************************** 2025-01-03T09:34:13,878 !! 2025-01-03T09:34:13,879 check.warn(importable) 2025-01-03T09:34:13,879 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-01-03T09:34:13,880 !! 2025-01-03T09:34:13,880 ******************************************************************************** 2025-01-03T09:34:13,881 ############################ 2025-01-03T09:34:13,881 # Package would be ignored # 2025-01-03T09:34:13,882 ############################ 2025-01-03T09:34:13,882 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-01-03T09:34:13,883 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,884 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,884 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-01-03T09:34:13,884 to the `packages` configuration field. 2025-01-03T09:34:13,885 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,886 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,887 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,888 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,889 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,889 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-01-03T09:34:13,890 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-01-03T09:34:13,890 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,891 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,892 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,893 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,894 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,895 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,896 even if it does not contain any `.py` files. 2025-01-03T09:34:13,896 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,897 directory, all directories are treated like packages. 2025-01-03T09:34:13,897 ******************************************************************************** 2025-01-03T09:34:13,898 !! 2025-01-03T09:34:13,899 check.warn(importable) 2025-01-03T09:34:13,899 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-01-03T09:34:13,900 !! 2025-01-03T09:34:13,901 ******************************************************************************** 2025-01-03T09:34:13,901 ############################ 2025-01-03T09:34:13,902 # Package would be ignored # 2025-01-03T09:34:13,903 ############################ 2025-01-03T09:34:13,903 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-01-03T09:34:13,904 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,905 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,906 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-01-03T09:34:13,906 to the `packages` configuration field. 2025-01-03T09:34:13,907 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,907 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,908 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,908 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,909 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,910 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-01-03T09:34:13,911 already explicitly excluding 'evalscope.metrics.resources' via 2025-01-03T09:34:13,911 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,912 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,912 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,913 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,914 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,915 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,916 even if it does not contain any `.py` files. 2025-01-03T09:34:13,916 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,917 directory, all directories are treated like packages. 2025-01-03T09:34:13,917 ******************************************************************************** 2025-01-03T09:34:13,918 !! 2025-01-03T09:34:13,919 check.warn(importable) 2025-01-03T09:34:13,919 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-01-03T09:34:13,920 !! 2025-01-03T09:34:13,921 ******************************************************************************** 2025-01-03T09:34:13,922 ############################ 2025-01-03T09:34:13,922 # Package would be ignored # 2025-01-03T09:34:13,923 ############################ 2025-01-03T09:34:13,923 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-01-03T09:34:13,924 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,925 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,925 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-01-03T09:34:13,926 to the `packages` configuration field. 2025-01-03T09:34:13,927 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,927 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,928 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,929 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,930 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,931 If you don't want 'evalscope.registry.config' to be distributed and are 2025-01-03T09:34:13,932 already explicitly excluding 'evalscope.registry.config' via 2025-01-03T09:34:13,932 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,933 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,933 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,934 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,935 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,936 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,937 even if it does not contain any `.py` files. 2025-01-03T09:34:13,938 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,938 directory, all directories are treated like packages. 2025-01-03T09:34:13,939 ******************************************************************************** 2025-01-03T09:34:13,939 !! 2025-01-03T09:34:13,940 check.warn(importable) 2025-01-03T09:34:13,940 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-01-03T09:34:13,941 !! 2025-01-03T09:34:13,942 ******************************************************************************** 2025-01-03T09:34:13,942 ############################ 2025-01-03T09:34:13,943 # Package would be ignored # 2025-01-03T09:34:13,943 ############################ 2025-01-03T09:34:13,944 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-01-03T09:34:13,944 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,945 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,946 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-01-03T09:34:13,946 to the `packages` configuration field. 2025-01-03T09:34:13,947 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,947 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,948 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,949 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,950 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,951 If you don't want 'evalscope.registry.data' to be distributed and are 2025-01-03T09:34:13,951 already explicitly excluding 'evalscope.registry.data' via 2025-01-03T09:34:13,952 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,952 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,953 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,954 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,955 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,956 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,957 even if it does not contain any `.py` files. 2025-01-03T09:34:13,957 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,958 directory, all directories are treated like packages. 2025-01-03T09:34:13,958 ******************************************************************************** 2025-01-03T09:34:13,959 !! 2025-01-03T09:34:13,960 check.warn(importable) 2025-01-03T09:34:13,960 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-01-03T09:34:13,961 !! 2025-01-03T09:34:13,962 ******************************************************************************** 2025-01-03T09:34:13,963 ############################ 2025-01-03T09:34:13,963 # Package would be ignored # 2025-01-03T09:34:13,963 ############################ 2025-01-03T09:34:13,964 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-01-03T09:34:13,964 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,965 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,965 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-01-03T09:34:13,966 to the `packages` configuration field. 2025-01-03T09:34:13,967 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,967 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,967 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,968 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,969 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,970 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-01-03T09:34:13,970 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-01-03T09:34:13,971 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,971 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,972 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,973 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,974 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,975 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,976 even if it does not contain any `.py` files. 2025-01-03T09:34:13,976 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,977 directory, all directories are treated like packages. 2025-01-03T09:34:13,977 ******************************************************************************** 2025-01-03T09:34:13,978 !! 2025-01-03T09:34:13,979 check.warn(importable) 2025-01-03T09:34:13,979 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-01-03T09:34:13,980 !! 2025-01-03T09:34:13,981 ******************************************************************************** 2025-01-03T09:34:13,981 ############################ 2025-01-03T09:34:13,982 # Package would be ignored # 2025-01-03T09:34:13,983 ############################ 2025-01-03T09:34:13,983 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-01-03T09:34:13,984 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:13,985 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:13,985 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-01-03T09:34:13,986 to the `packages` configuration field. 2025-01-03T09:34:13,987 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:13,987 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:13,988 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:13,989 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:13,990 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:13,991 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-01-03T09:34:13,992 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-01-03T09:34:13,992 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:13,992 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:13,993 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:13,994 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:13,995 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:13,996 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:13,997 even if it does not contain any `.py` files. 2025-01-03T09:34:13,997 On the other hand, currently there is no concept of package data 2025-01-03T09:34:13,997 directory, all directories are treated like packages. 2025-01-03T09:34:13,998 ******************************************************************************** 2025-01-03T09:34:13,999 !! 2025-01-03T09:34:13,999 check.warn(importable) 2025-01-03T09:34:14,000 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-01-03T09:34:14,000 !! 2025-01-03T09:34:14,002 ******************************************************************************** 2025-01-03T09:34:14,002 ############################ 2025-01-03T09:34:14,003 # Package would be ignored # 2025-01-03T09:34:14,003 ############################ 2025-01-03T09:34:14,004 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-01-03T09:34:14,004 but it is absent from setuptools' `packages` configuration. 2025-01-03T09:34:14,006 This leads to an ambiguous overall configuration. If you want to distribute this 2025-01-03T09:34:14,006 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-01-03T09:34:14,007 to the `packages` configuration field. 2025-01-03T09:34:14,008 Alternatively, you can also rely on setuptools' discovery methods 2025-01-03T09:34:14,008 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-01-03T09:34:14,008 instead of `find_packages(...)`/`find:`). 2025-01-03T09:34:14,009 You can read more about "package discovery" on setuptools documentation page: 2025-01-03T09:34:14,010 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-01-03T09:34:14,011 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-01-03T09:34:14,012 already explicitly excluding 'evalscope.registry.tasks' via 2025-01-03T09:34:14,013 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-01-03T09:34:14,013 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-01-03T09:34:14,014 combination with a more fine grained `package-data` configuration. 2025-01-03T09:34:14,015 You can read more about "package data files" on setuptools documentation page: 2025-01-03T09:34:14,016 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-01-03T09:34:14,018 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-01-03T09:34:14,018 even if it does not contain any `.py` files. 2025-01-03T09:34:14,019 On the other hand, currently there is no concept of package data 2025-01-03T09:34:14,019 directory, all directories are treated like packages. 2025-01-03T09:34:14,020 ******************************************************************************** 2025-01-03T09:34:14,021 !! 2025-01-03T09:34:14,021 check.warn(importable) 2025-01-03T09:34:14,022 creating build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,022 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,023 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,023 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,024 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,024 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,025 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,025 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,025 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,026 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,026 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,027 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-01-03T09:34:14,027 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,028 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,029 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,029 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,029 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,030 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,031 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,031 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,032 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,033 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,033 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,034 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,034 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,035 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,035 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,036 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,037 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,037 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,038 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,039 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,042 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,047 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,052 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,053 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,053 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,054 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,054 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,055 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,056 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,056 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,057 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,058 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,059 creating build/lib/evalscope/registry/config 2025-01-03T09:34:14,059 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-01-03T09:34:14,060 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-01-03T09:34:14,061 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-01-03T09:34:14,062 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-01-03T09:34:14,062 creating build/lib/evalscope/registry/data 2025-01-03T09:34:14,063 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-01-03T09:34:14,064 creating build/lib/evalscope/registry/data/prompt_template 2025-01-03T09:34:14,065 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-03T09:34:14,065 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-01-03T09:34:14,066 creating build/lib/evalscope/registry/data/qa_browser 2025-01-03T09:34:14,067 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-01-03T09:34:14,068 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-01-03T09:34:14,068 creating build/lib/evalscope/metrics/resources 2025-01-03T09:34:14,069 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-01-03T09:34:14,081 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-01-03T09:34:14,112 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-03T09:34:14,113 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-01-03T09:34:14,116 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,118 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,121 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,124 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,126 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-01-03T09:34:14,140 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-01-03T09:34:14,143 copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval 2025-01-03T09:34:14,145 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,148 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:14,151 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:14,153 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-01-03T09:34:14,156 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:14,159 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:14,161 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:14,164 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-01-03T09:34:14,217 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-01-03T09:34:14,218 !! 2025-01-03T09:34:14,219 ******************************************************************************** 2025-01-03T09:34:14,220 Please avoid running ``setup.py`` directly. 2025-01-03T09:34:14,220 Instead, use pypa/build, pypa/installer or other 2025-01-03T09:34:14,221 standards-based tools. 2025-01-03T09:34:14,222 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-01-03T09:34:14,223 ******************************************************************************** 2025-01-03T09:34:14,224 !! 2025-01-03T09:34:14,225 self.initialize_options() 2025-01-03T09:34:14,250 installing to build/bdist.linux-armv7l/wheel 2025-01-03T09:34:14,251 running install 2025-01-03T09:34:14,277 running install_lib 2025-01-03T09:34:14,306 creating build/bdist.linux-armv7l/wheel 2025-01-03T09:34:14,309 creating build/bdist.linux-armv7l/wheel/evalscope 2025-01-03T09:34:14,311 creating build/bdist.linux-armv7l/wheel/evalscope/tools 2025-01-03T09:34:14,313 copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2025-01-03T09:34:14,315 copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2025-01-03T09:34:14,318 copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2025-01-03T09:34:14,321 copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools 2025-01-03T09:34:14,325 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-01-03T09:34:14,327 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-01-03T09:34:14,329 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-01-03T09:34:14,332 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-01-03T09:34:14,334 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-03T09:34:14,354 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-01-03T09:34:14,357 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-01-03T09:34:14,358 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-03T09:34:14,361 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-01-03T09:34:14,363 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-01-03T09:34:14,365 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,367 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,369 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,371 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,373 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,375 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,377 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,379 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,381 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,384 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,386 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-01-03T09:34:14,388 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-01-03T09:34:14,390 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-01-03T09:34:14,392 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-03T09:34:14,394 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-03T09:34:14,397 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-03T09:34:14,399 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-01-03T09:34:14,402 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-01-03T09:34:14,404 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-01-03T09:34:14,406 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-01-03T09:34:14,409 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-01-03T09:34:14,410 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-01-03T09:34:14,414 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,415 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,418 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,420 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,422 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,425 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-01-03T09:34:14,427 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-03T09:34:14,429 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-03T09:34:14,431 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-01-03T09:34:14,433 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-03T09:34:14,435 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,437 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,439 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,442 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,444 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,446 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-01-03T09:34:14,449 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:14,451 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:14,453 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:14,455 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:14,458 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:14,460 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-01-03T09:34:14,462 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:14,465 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:14,467 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,469 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,472 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-01-03T09:34:14,474 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:14,476 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-01-03T09:34:14,478 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-01-03T09:34:14,480 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:14,482 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,483 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,486 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,488 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,490 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,493 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,495 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,497 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,499 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-01-03T09:34:14,502 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:14,505 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:14,507 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:14,509 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-01-03T09:34:14,513 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-01-03T09:34:14,514 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-03T09:34:14,517 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-01-03T09:34:14,519 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-03T09:34:14,521 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-03T09:34:14,524 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-01-03T09:34:14,526 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-03T09:34:14,529 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-01-03T09:34:14,532 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-03T09:34:14,534 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-01-03T09:34:14,537 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-01-03T09:34:14,538 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-03T09:34:14,541 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-03T09:34:14,543 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-01-03T09:34:14,546 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,550 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-01-03T09:34:14,551 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-03T09:34:14,555 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:14,556 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:14,560 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-01-03T09:34:14,563 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-01-03T09:34:14,565 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-03T09:34:14,579 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-01-03T09:34:14,609 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-03T09:34:14,611 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-03T09:34:14,613 copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-03T09:34:14,616 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-01-03T09:34:14,618 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,621 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-01-03T09:34:14,622 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,624 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,625 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,627 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,629 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,631 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-01-03T09:34:14,633 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,635 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-01-03T09:34:14,637 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,638 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,640 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,643 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,645 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-01-03T09:34:14,647 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-01-03T09:34:14,648 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-03T09:34:14,651 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-03T09:34:14,653 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-03T09:34:14,655 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-01-03T09:34:14,657 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-01-03T09:34:14,658 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-03T09:34:14,661 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-03T09:34:14,663 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-01-03T09:34:14,664 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-03T09:34:14,667 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-01-03T09:34:14,668 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-03T09:34:14,671 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-03T09:34:14,673 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-01-03T09:34:14,675 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-01-03T09:34:14,676 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-03T09:34:14,678 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-03T09:34:14,680 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-01-03T09:34:14,683 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-01-03T09:34:14,685 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-03T09:34:14,687 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-03T09:34:14,689 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-01-03T09:34:14,691 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-01-03T09:34:14,692 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-03T09:34:14,695 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-01-03T09:34:14,698 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,699 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,701 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,703 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,705 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,707 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,709 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,711 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,713 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,715 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,716 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,718 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,720 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,722 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,724 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,726 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,728 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,730 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,732 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,734 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,735 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,737 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,739 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,742 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,744 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,746 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,748 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,750 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-01-03T09:34:14,752 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-01-03T09:34:14,754 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-03T09:34:14,756 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-03T09:34:14,758 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-03T09:34:14,759 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-01-03T09:34:14,762 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-03T09:34:14,765 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-01-03T09:34:14,766 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-03T09:34:14,769 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-01-03T09:34:14,771 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-01-03T09:34:14,773 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-03T09:34:14,775 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-03T09:34:14,777 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-01-03T09:34:14,779 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-01-03T09:34:14,781 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-03T09:34:14,783 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-03T09:34:14,785 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-01-03T09:34:14,787 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-01-03T09:34:14,790 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-01-03T09:34:14,791 copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-03T09:34:14,793 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-03T09:34:14,795 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-03T09:34:14,797 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-01-03T09:34:14,800 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:14,801 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:14,803 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-01-03T09:34:14,805 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,807 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,809 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,811 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,813 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-01-03T09:34:14,815 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,817 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-01-03T09:34:14,818 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,820 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,822 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,824 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,826 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,829 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,831 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,832 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-01-03T09:34:14,834 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,836 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,838 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,841 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-01-03T09:34:14,842 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-03T09:34:14,844 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-03T09:34:14,848 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-01-03T09:34:14,850 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-01-03T09:34:14,851 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,854 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,856 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,858 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,860 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,862 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,864 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,866 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-01-03T09:34:14,869 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-01-03T09:34:14,871 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-03T09:34:14,874 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-03T09:34:14,876 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-03T09:34:14,878 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-03T09:34:14,880 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-01-03T09:34:14,886 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-03T09:34:14,887 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-01-03T09:34:14,890 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-03T09:34:14,892 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-01-03T09:34:14,893 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,896 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,898 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,900 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,902 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,904 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-01-03T09:34:14,907 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-03T09:34:14,909 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-01-03T09:34:14,912 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-01-03T09:34:14,915 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-01-03T09:34:14,917 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-01-03T09:34:14,918 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-03T09:34:14,921 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-03T09:34:14,923 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-01-03T09:34:14,926 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,928 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,931 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,933 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,935 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,937 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,940 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,943 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,945 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,948 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,950 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,952 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,956 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-01-03T09:34:14,958 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-01-03T09:34:14,961 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-01-03T09:34:14,962 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,965 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,967 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,969 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,972 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,974 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,976 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,978 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-01-03T09:34:14,981 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:14,983 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:14,985 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-01-03T09:34:14,988 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-01-03T09:34:14,990 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-01-03T09:34:14,993 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-01-03T09:34:14,994 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-03T09:34:14,998 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-01-03T09:34:15,000 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-03T09:34:15,003 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-01-03T09:34:15,005 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-03T09:34:15,007 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-01-03T09:34:15,010 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-01-03T09:34:15,012 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-01-03T09:34:15,014 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-03T09:34:15,016 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-01-03T09:34:15,018 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,020 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,022 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,025 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,027 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,029 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,031 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,033 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-01-03T09:34:15,036 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-01-03T09:34:15,037 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-03T09:34:15,039 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-03T09:34:15,041 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-03T09:34:15,043 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-01-03T09:34:15,046 creating build/bdist.linux-armv7l/wheel/tests 2025-01-03T09:34:15,047 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-03T09:34:15,050 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-01-03T09:34:15,051 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-03T09:34:15,053 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-03T09:34:15,055 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-03T09:34:15,058 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-01-03T09:34:15,061 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-01-03T09:34:15,062 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-03T09:34:15,064 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-01-03T09:34:15,066 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-01-03T09:34:15,067 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-03T09:34:15,069 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-03T09:34:15,071 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-01-03T09:34:15,074 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-01-03T09:34:15,076 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-01-03T09:34:15,077 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-03T09:34:15,079 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-01-03T09:34:15,082 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-01-03T09:34:15,083 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-03T09:34:15,084 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-03T09:34:15,086 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-03T09:34:15,088 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-01-03T09:34:15,090 running install_egg_info 2025-01-03T09:34:15,124 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.9.0-py3.11.egg-info 2025-01-03T09:34:15,138 running install_scripts 2025-01-03T09:34:15,187 creating build/bdist.linux-armv7l/wheel/evalscope-0.9.0.dist-info/WHEEL 2025-01-03T09:34:15,189 creating '/tmp/pip-wheel-8b6tlokl/evalscope-0.9.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-01-03T09:34:15,192 adding 'evalscope/__init__.py' 2025-01-03T09:34:15,193 adding 'evalscope/arguments.py' 2025-01-03T09:34:15,195 adding 'evalscope/config.py' 2025-01-03T09:34:15,196 adding 'evalscope/constants.py' 2025-01-03T09:34:15,198 adding 'evalscope/run.py' 2025-01-03T09:34:15,200 adding 'evalscope/run_arena.py' 2025-01-03T09:34:15,201 adding 'evalscope/summarizer.py' 2025-01-03T09:34:15,203 adding 'evalscope/version.py' 2025-01-03T09:34:15,204 adding 'evalscope/backend/__init__.py' 2025-01-03T09:34:15,205 adding 'evalscope/backend/base.py' 2025-01-03T09:34:15,207 adding 'evalscope/backend/opencompass/__init__.py' 2025-01-03T09:34:15,208 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-01-03T09:34:15,210 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-01-03T09:34:15,212 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-01-03T09:34:15,213 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-01-03T09:34:15,215 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-01-03T09:34:15,216 adding 'evalscope/backend/rag_eval/__init__.py' 2025-01-03T09:34:15,218 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-01-03T09:34:15,219 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-01-03T09:34:15,221 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-01-03T09:34:15,223 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-01-03T09:34:15,224 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-01-03T09:34:15,226 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-01-03T09:34:15,227 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-01-03T09:34:15,229 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-01-03T09:34:15,230 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-01-03T09:34:15,232 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-01-03T09:34:15,234 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-01-03T09:34:15,235 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-01-03T09:34:15,237 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-01-03T09:34:15,238 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-01-03T09:34:15,239 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-01-03T09:34:15,241 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-01-03T09:34:15,243 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-01-03T09:34:15,244 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-01-03T09:34:15,246 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-01-03T09:34:15,247 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-01-03T09:34:15,249 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-01-03T09:34:15,250 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-01-03T09:34:15,252 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-01-03T09:34:15,253 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-01-03T09:34:15,255 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-01-03T09:34:15,256 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-01-03T09:34:15,258 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-01-03T09:34:15,259 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-01-03T09:34:15,260 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-01-03T09:34:15,262 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-01-03T09:34:15,263 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-01-03T09:34:15,264 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-01-03T09:34:15,266 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-01-03T09:34:15,267 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-01-03T09:34:15,269 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-01-03T09:34:15,270 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-01-03T09:34:15,272 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-01-03T09:34:15,273 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-01-03T09:34:15,275 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-01-03T09:34:15,276 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-01-03T09:34:15,278 adding 'evalscope/benchmarks/__init__.py' 2025-01-03T09:34:15,279 adding 'evalscope/benchmarks/benchmark.py' 2025-01-03T09:34:15,281 adding 'evalscope/benchmarks/data_adapter.py' 2025-01-03T09:34:15,283 adding 'evalscope/benchmarks/arc/__init__.py' 2025-01-03T09:34:15,284 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-01-03T09:34:15,286 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-01-03T09:34:15,287 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-01-03T09:34:15,289 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-01-03T09:34:15,291 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-01-03T09:34:15,293 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-01-03T09:34:15,294 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-01-03T09:34:15,295 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-01-03T09:34:15,297 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-01-03T09:34:15,298 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-01-03T09:34:15,300 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-01-03T09:34:15,301 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-01-03T09:34:15,302 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-01-03T09:34:15,304 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-01-03T09:34:15,305 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-01-03T09:34:15,307 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-01-03T09:34:15,309 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-01-03T09:34:15,310 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-01-03T09:34:15,312 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-01-03T09:34:15,313 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-01-03T09:34:15,315 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-01-03T09:34:15,317 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-01-03T09:34:15,319 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-01-03T09:34:15,320 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-01-03T09:34:15,322 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-01-03T09:34:15,323 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-01-03T09:34:15,325 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-01-03T09:34:15,327 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-01-03T09:34:15,328 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-01-03T09:34:15,330 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-01-03T09:34:15,331 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-01-03T09:34:15,333 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-01-03T09:34:15,336 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-01-03T09:34:15,338 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-01-03T09:34:15,340 adding 'evalscope/benchmarks/ceval/samples.jsonl' 2025-01-03T09:34:15,342 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-01-03T09:34:15,344 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-01-03T09:34:15,347 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-01-03T09:34:15,348 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-01-03T09:34:15,350 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-01-03T09:34:15,352 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-01-03T09:34:15,354 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-01-03T09:34:15,356 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-01-03T09:34:15,358 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-01-03T09:34:15,360 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-01-03T09:34:15,362 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-01-03T09:34:15,364 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-01-03T09:34:15,367 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-01-03T09:34:15,368 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-01-03T09:34:15,370 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-01-03T09:34:15,373 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-01-03T09:34:15,375 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-01-03T09:34:15,377 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-01-03T09:34:15,379 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-01-03T09:34:15,381 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-01-03T09:34:15,384 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-01-03T09:34:15,386 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-01-03T09:34:15,387 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-01-03T09:34:15,390 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-01-03T09:34:15,392 adding 'evalscope/benchmarks/race/__init__.py' 2025-01-03T09:34:15,394 adding 'evalscope/benchmarks/race/race.py' 2025-01-03T09:34:15,396 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-01-03T09:34:15,398 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-01-03T09:34:15,400 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-01-03T09:34:15,402 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-01-03T09:34:15,404 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-01-03T09:34:15,406 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-01-03T09:34:15,407 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-01-03T09:34:15,409 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-01-03T09:34:15,411 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-01-03T09:34:15,413 adding 'evalscope/cli/__init__.py' 2025-01-03T09:34:15,414 adding 'evalscope/cli/base.py' 2025-01-03T09:34:15,415 adding 'evalscope/cli/cli.py' 2025-01-03T09:34:15,417 adding 'evalscope/cli/start_eval.py' 2025-01-03T09:34:15,418 adding 'evalscope/cli/start_perf.py' 2025-01-03T09:34:15,419 adding 'evalscope/cli/start_server.py' 2025-01-03T09:34:15,420 adding 'evalscope/collections/__init__.py' 2025-01-03T09:34:15,422 adding 'evalscope/collections/evaluator.py' 2025-01-03T09:34:15,423 adding 'evalscope/collections/sampler.py' 2025-01-03T09:34:15,425 adding 'evalscope/collections/schema.py' 2025-01-03T09:34:15,426 adding 'evalscope/evaluator/__init__.py' 2025-01-03T09:34:15,428 adding 'evalscope/evaluator/evaluator.py' 2025-01-03T09:34:15,430 adding 'evalscope/evaluator/rating_eval.py' 2025-01-03T09:34:15,432 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-01-03T09:34:15,434 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-01-03T09:34:15,436 adding 'evalscope/metrics/__init__.py' 2025-01-03T09:34:15,437 adding 'evalscope/metrics/code_metric.py' 2025-01-03T09:34:15,438 adding 'evalscope/metrics/math_accuracy.py' 2025-01-03T09:34:15,441 adding 'evalscope/metrics/metrics.py' 2025-01-03T09:34:15,442 adding 'evalscope/metrics/rouge_metric.py' 2025-01-03T09:34:15,444 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-01-03T09:34:15,446 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-01-03T09:34:15,605 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-01-03T09:34:15,849 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-01-03T09:34:15,859 adding 'evalscope/models/__init__.py' 2025-01-03T09:34:15,860 adding 'evalscope/models/base_adapter.py' 2025-01-03T09:34:15,861 adding 'evalscope/models/chat_adapter.py' 2025-01-03T09:34:15,863 adding 'evalscope/models/choice_adapter.py' 2025-01-03T09:34:15,864 adding 'evalscope/models/custom_adapter.py' 2025-01-03T09:34:15,866 adding 'evalscope/models/local_model.py' 2025-01-03T09:34:15,867 adding 'evalscope/models/model.py' 2025-01-03T09:34:15,869 adding 'evalscope/models/server_adapter.py' 2025-01-03T09:34:15,870 adding 'evalscope/models/custom/__init__.py' 2025-01-03T09:34:15,872 adding 'evalscope/models/custom/custom_model.py' 2025-01-03T09:34:15,873 adding 'evalscope/perf/__init__.py' 2025-01-03T09:34:15,875 adding 'evalscope/perf/arguments.py' 2025-01-03T09:34:15,877 adding 'evalscope/perf/benchmark.py' 2025-01-03T09:34:15,878 adding 'evalscope/perf/http_client.py' 2025-01-03T09:34:15,880 adding 'evalscope/perf/main.py' 2025-01-03T09:34:15,882 adding 'evalscope/perf/plugin/__init__.py' 2025-01-03T09:34:15,883 adding 'evalscope/perf/plugin/registry.py' 2025-01-03T09:34:15,884 adding 'evalscope/perf/plugin/api/__init__.py' 2025-01-03T09:34:15,886 adding 'evalscope/perf/plugin/api/base.py' 2025-01-03T09:34:15,887 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-01-03T09:34:15,888 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-01-03T09:34:15,890 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-01-03T09:34:15,892 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-01-03T09:34:15,893 adding 'evalscope/perf/plugin/datasets/base.py' 2025-01-03T09:34:15,894 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-01-03T09:34:15,896 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-01-03T09:34:15,897 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-01-03T09:34:15,898 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-01-03T09:34:15,900 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-01-03T09:34:15,901 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-01-03T09:34:15,903 adding 'evalscope/perf/utils/__init__.py' 2025-01-03T09:34:15,904 adding 'evalscope/perf/utils/analysis_result.py' 2025-01-03T09:34:15,905 adding 'evalscope/perf/utils/benchmark_util.py' 2025-01-03T09:34:15,907 adding 'evalscope/perf/utils/db_util.py' 2025-01-03T09:34:15,908 adding 'evalscope/perf/utils/handler.py' 2025-01-03T09:34:15,910 adding 'evalscope/perf/utils/local_server.py' 2025-01-03T09:34:15,911 adding 'evalscope/registry/__init__.py' 2025-01-03T09:34:15,913 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-01-03T09:34:15,914 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-01-03T09:34:15,916 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-01-03T09:34:15,917 adding 'evalscope/registry/config/cfg_single.yaml' 2025-01-03T09:34:15,919 adding 'evalscope/registry/data/question.jsonl' 2025-01-03T09:34:15,921 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-01-03T09:34:15,923 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-01-03T09:34:16,087 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-01-03T09:34:16,095 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-01-03T09:34:16,097 adding 'evalscope/registry/tasks/arc.yaml' 2025-01-03T09:34:16,098 adding 'evalscope/registry/tasks/bbh.yaml' 2025-01-03T09:34:16,099 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-01-03T09:34:16,101 adding 'evalscope/registry/tasks/ceval.yaml' 2025-01-03T09:34:16,102 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-01-03T09:34:16,103 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-01-03T09:34:16,104 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-01-03T09:34:16,105 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-01-03T09:34:16,106 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-01-03T09:34:16,107 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-01-03T09:34:16,109 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-01-03T09:34:16,110 adding 'evalscope/third_party/__init__.py' 2025-01-03T09:34:16,112 adding 'evalscope/third_party/longbench_write/README.md' 2025-01-03T09:34:16,114 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-01-03T09:34:16,115 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-01-03T09:34:16,116 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-01-03T09:34:16,118 adding 'evalscope/third_party/longbench_write/eval.py' 2025-01-03T09:34:16,119 adding 'evalscope/third_party/longbench_write/infer.py' 2025-01-03T09:34:16,121 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-01-03T09:34:16,122 adding 'evalscope/third_party/longbench_write/utils.py' 2025-01-03T09:34:16,124 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-01-03T09:34:16,125 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-01-03T09:34:16,132 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-01-03T09:34:16,136 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-01-03T09:34:16,138 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-01-03T09:34:16,139 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-01-03T09:34:16,141 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-01-03T09:34:16,143 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-01-03T09:34:16,145 adding 'evalscope/third_party/toolbench_static/README.md' 2025-01-03T09:34:16,146 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-01-03T09:34:16,147 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-01-03T09:34:16,148 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-01-03T09:34:16,150 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-01-03T09:34:16,152 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-01-03T09:34:16,153 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-01-03T09:34:16,154 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-01-03T09:34:16,156 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-01-03T09:34:16,157 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-01-03T09:34:16,159 adding 'evalscope/tools/__init__.py' 2025-01-03T09:34:16,160 adding 'evalscope/tools/combine_reports.py' 2025-01-03T09:34:16,162 adding 'evalscope/tools/gen_mmlu_subject_mapping.py' 2025-01-03T09:34:16,163 adding 'evalscope/tools/rewrite_eval_results.py' 2025-01-03T09:34:16,164 adding 'evalscope/utils/__init__.py' 2025-01-03T09:34:16,166 adding 'evalscope/utils/arena_utils.py' 2025-01-03T09:34:16,167 adding 'evalscope/utils/chat_service.py' 2025-01-03T09:34:16,169 adding 'evalscope/utils/completion_parsers.py' 2025-01-03T09:34:16,170 adding 'evalscope/utils/io_utils.py' 2025-01-03T09:34:16,171 adding 'evalscope/utils/logger.py' 2025-01-03T09:34:16,173 adding 'evalscope/utils/model_utils.py' 2025-01-03T09:34:16,174 adding 'evalscope/utils/utils.py' 2025-01-03T09:34:16,177 adding 'tests/__init__.py' 2025-01-03T09:34:16,178 adding 'tests/test_run_all.py' 2025-01-03T09:34:16,179 adding 'tests/cli/__init__.py' 2025-01-03T09:34:16,181 adding 'tests/cli/test_collection.py' 2025-01-03T09:34:16,182 adding 'tests/cli/test_run.py' 2025-01-03T09:34:16,184 adding 'tests/perf/__init__.py' 2025-01-03T09:34:16,185 adding 'tests/perf/test_perf.py' 2025-01-03T09:34:16,186 adding 'tests/rag/__init__.py' 2025-01-03T09:34:16,188 adding 'tests/rag/test_clip_benchmark.py' 2025-01-03T09:34:16,189 adding 'tests/rag/test_mteb.py' 2025-01-03T09:34:16,190 adding 'tests/rag/test_ragas.py' 2025-01-03T09:34:16,192 adding 'tests/swift/__init__.py' 2025-01-03T09:34:16,193 adding 'tests/swift/test_run_swift_eval.py' 2025-01-03T09:34:16,195 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-01-03T09:34:16,196 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-01-03T09:34:16,198 adding 'tests/vlm/__init__.py' 2025-01-03T09:34:16,199 adding 'tests/vlm/test_vlmeval.py' 2025-01-03T09:34:16,201 adding 'evalscope-0.9.0.dist-info/LICENSE' 2025-01-03T09:34:16,204 adding 'evalscope-0.9.0.dist-info/METADATA' 2025-01-03T09:34:16,205 adding 'evalscope-0.9.0.dist-info/WHEEL' 2025-01-03T09:34:16,206 adding 'evalscope-0.9.0.dist-info/entry_points.txt' 2025-01-03T09:34:16,207 adding 'evalscope-0.9.0.dist-info/top_level.txt' 2025-01-03T09:34:16,211 adding 'evalscope-0.9.0.dist-info/RECORD' 2025-01-03T09:34:16,228 removing build/bdist.linux-armv7l/wheel 2025-01-03T09:34:16,421 Building wheel for evalscope (setup.py): finished with status 'done' 2025-01-03T09:34:16,437 Created wheel for evalscope: filename=evalscope-0.9.0-py3-none-any.whl size=1393233 sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 2025-01-03T09:34:16,438 Stored in directory: /tmp/pip-ephem-wheel-cache-t0ayms4f/wheels/9b/53/72/48dc0f767170afe09ea024d6135aea4eaa7e888707dd5e1f6f 2025-01-03T09:34:16,464 Successfully built evalscope 2025-01-03T09:34:16,512 Removed build tracker: '/tmp/pip-build-tracker-dr0bjoez'