2025-02-13T06:11:12,644 Created temporary directory: /tmp/pip-build-tracker-gmjuwxp7 2025-02-13T06:11:12,646 Initialized build tracking at /tmp/pip-build-tracker-gmjuwxp7 2025-02-13T06:11:12,646 Created build tracker: /tmp/pip-build-tracker-gmjuwxp7 2025-02-13T06:11:12,647 Entered build tracker: /tmp/pip-build-tracker-gmjuwxp7 2025-02-13T06:11:12,647 Created temporary directory: /tmp/pip-wheel-ge555l2f 2025-02-13T06:11:12,651 Created temporary directory: /tmp/pip-ephem-wheel-cache-k6kh3au9 2025-02-13T06:11:12,698 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-02-13T06:11:12,701 2 location(s) to search for versions of evalscope: 2025-02-13T06:11:12,701 * https://pypi.org/simple/evalscope/ 2025-02-13T06:11:12,701 * https://www.piwheels.org/simple/evalscope/ 2025-02-13T06:11:12,702 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-02-13T06:11:12,703 Getting page https://pypi.org/simple/evalscope/ 2025-02-13T06:11:12,704 Found index url https://pypi.org/simple/ 2025-02-13T06:11:12,924 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-02-13T06:11:12,933 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,934 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-02-13T06:11:12,935 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,935 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-02-13T06:11:12,936 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,937 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-02-13T06:11:12,938 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,939 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-02-13T06:11:12,940 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,941 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-02-13T06:11:12,941 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,942 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,943 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-02-13T06:11:12,944 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,944 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-02-13T06:11:12,945 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,946 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-02-13T06:11:12,947 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,948 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-02-13T06:11:12,948 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,950 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-02-13T06:11:12,950 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,951 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-02-13T06:11:12,952 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,953 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-02-13T06:11:12,954 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,954 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-02-13T06:11:12,955 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,956 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-02-13T06:11:12,957 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,958 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-02-13T06:11:12,958 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,959 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-02-13T06:11:12,959 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,960 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-02-13T06:11:12,961 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,962 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-02-13T06:11:12,963 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,964 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-02-13T06:11:12,964 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d6/e5/852326943d86c85b5ca6b548a5f3753c217b771d93968c61ec2ca46ee0b1/evalscope-0.11.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:12,965 Found link https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.11.0 2025-02-13T06:11:12,966 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-02-13T06:11:12,967 Getting page https://www.piwheels.org/simple/evalscope/ 2025-02-13T06:11:12,968 Found index url https://www.piwheels.org/simple/ 2025-02-13T06:11:13,142 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-02-13T06:11:13,146 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.1-py3-none-any.whl#sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,147 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,147 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,148 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,148 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,148 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,149 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,150 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,151 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-13T06:11:13,151 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-02-13T06:11:13,152 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-02-13T06:11:13,173 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-02-13T06:11:13,175 Collecting evalscope==0.11.0 2025-02-13T06:11:13,178 Created temporary directory: /tmp/pip-unpack-get3vnnb 2025-02-13T06:11:13,397 Downloading evalscope-0.11.0.tar.gz (1.3 MB) 2025-02-13T06:11:14,375 Added evalscope==0.11.0 from https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz to build tracker '/tmp/pip-build-tracker-gmjuwxp7' 2025-02-13T06:11:14,377 Running setup.py (path:/tmp/pip-wheel-ge555l2f/evalscope_4ddf8d8567724b36a2ce3f3f80b99d6b/setup.py) egg_info for package evalscope 2025-02-13T06:11:14,378 Created temporary directory: /tmp/pip-pip-egg-info-tlba_hm6 2025-02-13T06:11:14,379 Preparing metadata (setup.py): started 2025-02-13T06:11:14,380 Running command python setup.py egg_info 2025-02-13T06:11:15,010 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-13T06:11:15,010 !! 2025-02-13T06:11:15,011 ******************************************************************************** 2025-02-13T06:11:15,012 Usage of dash-separated 'index-url' will not be supported in future 2025-02-13T06:11:15,012 versions. Please use the underscore name 'index_url' instead. 2025-02-13T06:11:15,013 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-13T06:11:15,014 or your builds will no longer be supported. 2025-02-13T06:11:15,014 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-13T06:11:15,015 ******************************************************************************** 2025-02-13T06:11:15,016 !! 2025-02-13T06:11:15,016 opt = self.warn_dash_deprecation(opt, section) 2025-02-13T06:11:15,595 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-13T06:11:15,596 !! 2025-02-13T06:11:15,596 ******************************************************************************** 2025-02-13T06:11:15,597 Usage of dash-separated 'index-url' will not be supported in future 2025-02-13T06:11:15,597 versions. Please use the underscore name 'index_url' instead. 2025-02-13T06:11:15,598 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-13T06:11:15,599 or your builds will no longer be supported. 2025-02-13T06:11:15,599 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-13T06:11:15,600 ******************************************************************************** 2025-02-13T06:11:15,601 !! 2025-02-13T06:11:15,602 opt = self.warn_dash_deprecation(opt, section) 2025-02-13T06:11:15,632 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-02-13T06:11:15,633 running egg_info 2025-02-13T06:11:15,661 creating /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info 2025-02-13T06:11:15,662 writing /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/PKG-INFO 2025-02-13T06:11:15,692 writing dependency_links to /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/dependency_links.txt 2025-02-13T06:11:15,694 writing entry points to /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/entry_points.txt 2025-02-13T06:11:15,709 writing requirements to /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/requires.txt 2025-02-13T06:11:15,710 writing top-level names to /tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/top_level.txt 2025-02-13T06:11:15,712 writing manifest file '/tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/SOURCES.txt' 2025-02-13T06:11:15,876 reading manifest file '/tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/SOURCES.txt' 2025-02-13T06:11:15,877 reading manifest template 'MANIFEST.in' 2025-02-13T06:11:16,007 adding license file 'LICENSE' 2025-02-13T06:11:16,022 writing manifest file '/tmp/pip-pip-egg-info-tlba_hm6/evalscope.egg-info/SOURCES.txt' 2025-02-13T06:11:16,138 Preparing metadata (setup.py): finished with status 'done' 2025-02-13T06:11:16,144 Source in /tmp/pip-wheel-ge555l2f/evalscope_4ddf8d8567724b36a2ce3f3f80b99d6b has version 0.11.0, which satisfies requirement evalscope==0.11.0 from https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz 2025-02-13T06:11:16,146 Removed evalscope==0.11.0 from https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz from build tracker '/tmp/pip-build-tracker-gmjuwxp7' 2025-02-13T06:11:16,207 Created temporary directory: /tmp/pip-unpack-l8zn8t18 2025-02-13T06:11:16,209 Created temporary directory: /tmp/pip-unpack-l_8vxuua 2025-02-13T06:11:16,209 Building wheels for collected packages: evalscope 2025-02-13T06:11:16,214 Created temporary directory: /tmp/pip-wheel-w7xbvc6h 2025-02-13T06:11:16,215 Building wheel for evalscope (setup.py): started 2025-02-13T06:11:16,217 Destination directory: /tmp/pip-wheel-w7xbvc6h 2025-02-13T06:11:16,217 Running command python setup.py bdist_wheel 2025-02-13T06:11:17,283 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-02-13T06:11:17,403 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-13T06:11:17,403 !! 2025-02-13T06:11:17,404 ******************************************************************************** 2025-02-13T06:11:17,405 Usage of dash-separated 'index-url' will not be supported in future 2025-02-13T06:11:17,405 versions. Please use the underscore name 'index_url' instead. 2025-02-13T06:11:17,406 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-13T06:11:17,407 or your builds will no longer be supported. 2025-02-13T06:11:17,408 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-13T06:11:17,408 ******************************************************************************** 2025-02-13T06:11:17,410 !! 2025-02-13T06:11:17,410 opt = self.warn_dash_deprecation(opt, section) 2025-02-13T06:11:18,008 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-13T06:11:18,009 !! 2025-02-13T06:11:18,010 ******************************************************************************** 2025-02-13T06:11:18,010 Usage of dash-separated 'index-url' will not be supported in future 2025-02-13T06:11:18,011 versions. Please use the underscore name 'index_url' instead. 2025-02-13T06:11:18,012 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-13T06:11:18,013 or your builds will no longer be supported. 2025-02-13T06:11:18,014 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-13T06:11:18,015 ******************************************************************************** 2025-02-13T06:11:18,017 !! 2025-02-13T06:11:18,017 opt = self.warn_dash_deprecation(opt, section) 2025-02-13T06:11:18,019 running bdist_wheel 2025-02-13T06:11:18,160 running build 2025-02-13T06:11:18,161 running build_py 2025-02-13T06:11:18,192 creating build/lib/evalscope 2025-02-13T06:11:18,198 copying evalscope/run_arena.py -> build/lib/evalscope 2025-02-13T06:11:18,201 copying evalscope/run.py -> build/lib/evalscope 2025-02-13T06:11:18,206 copying evalscope/version.py -> build/lib/evalscope 2025-02-13T06:11:18,209 copying evalscope/__init__.py -> build/lib/evalscope 2025-02-13T06:11:18,212 copying evalscope/constants.py -> build/lib/evalscope 2025-02-13T06:11:18,214 copying evalscope/arguments.py -> build/lib/evalscope 2025-02-13T06:11:18,217 copying evalscope/config.py -> build/lib/evalscope 2025-02-13T06:11:18,220 copying evalscope/summarizer.py -> build/lib/evalscope 2025-02-13T06:11:18,224 creating build/lib/tests 2025-02-13T06:11:18,226 copying tests/test_run_all.py -> build/lib/tests 2025-02-13T06:11:18,229 copying tests/__init__.py -> build/lib/tests 2025-02-13T06:11:18,232 creating build/lib/evalscope/registry 2025-02-13T06:11:18,233 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-02-13T06:11:18,237 creating build/lib/evalscope/backend 2025-02-13T06:11:18,238 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-02-13T06:11:18,240 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-02-13T06:11:18,243 creating build/lib/evalscope/metrics 2025-02-13T06:11:18,245 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,247 copying evalscope/metrics/math_parser.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,251 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,253 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,256 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,259 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-02-13T06:11:18,262 creating build/lib/evalscope/cli 2025-02-13T06:11:18,263 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,266 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,269 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,272 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,274 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,277 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,279 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-02-13T06:11:18,282 creating build/lib/evalscope/report 2025-02-13T06:11:18,284 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-02-13T06:11:18,287 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-02-13T06:11:18,289 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-02-13T06:11:18,292 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-02-13T06:11:18,295 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-02-13T06:11:18,298 creating build/lib/evalscope/benchmarks 2025-02-13T06:11:18,300 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-02-13T06:11:18,303 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-02-13T06:11:18,305 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-02-13T06:11:18,308 creating build/lib/evalscope/utils 2025-02-13T06:11:18,310 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,313 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,315 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,318 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,321 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,324 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,327 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,329 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-02-13T06:11:18,332 creating build/lib/evalscope/perf 2025-02-13T06:11:18,334 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-02-13T06:11:18,336 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-02-13T06:11:18,338 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-02-13T06:11:18,340 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-02-13T06:11:18,343 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-02-13T06:11:18,345 creating build/lib/evalscope/third_party 2025-02-13T06:11:18,346 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-02-13T06:11:18,350 creating build/lib/evalscope/evaluator 2025-02-13T06:11:18,351 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-02-13T06:11:18,355 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-02-13T06:11:18,357 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-02-13T06:11:18,360 creating build/lib/evalscope/models 2025-02-13T06:11:18,361 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-02-13T06:11:18,364 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-02-13T06:11:18,368 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-02-13T06:11:18,371 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-02-13T06:11:18,374 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-02-13T06:11:18,377 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-02-13T06:11:18,379 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-02-13T06:11:18,382 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-02-13T06:11:18,385 creating build/lib/evalscope/collections 2025-02-13T06:11:18,386 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-02-13T06:11:18,389 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-02-13T06:11:18,392 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-02-13T06:11:18,394 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-02-13T06:11:18,397 creating build/lib/evalscope/backend/rag_eval 2025-02-13T06:11:18,398 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-02-13T06:11:18,401 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-02-13T06:11:18,403 creating build/lib/evalscope/backend/opencompass 2025-02-13T06:11:18,405 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-02-13T06:11:18,407 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-02-13T06:11:18,410 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-02-13T06:11:18,413 creating build/lib/evalscope/backend/vlm_eval_kit 2025-02-13T06:11:18,414 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-13T06:11:18,417 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-13T06:11:18,419 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-13T06:11:18,422 creating build/lib/evalscope/backend/rag_eval/ragas 2025-02-13T06:11:18,424 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-13T06:11:18,427 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-13T06:11:18,429 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-13T06:11:18,432 creating build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,434 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,436 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,439 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,442 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,445 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-13T06:11:18,448 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:18,449 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:18,451 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:18,453 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:18,456 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:18,459 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:18,461 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:18,463 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:18,465 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:18,467 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:18,471 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,472 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,474 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,476 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,479 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,481 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:18,484 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:18,486 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:18,488 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:18,491 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:18,493 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:18,495 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,497 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,499 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,502 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,504 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,508 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,510 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,512 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,515 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:18,517 creating build/lib/evalscope/backend/opencompass/tasks 2025-02-13T06:11:18,519 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-13T06:11:18,522 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-13T06:11:18,524 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-13T06:11:18,527 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:18,528 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:18,532 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:18,535 creating build/lib/evalscope/benchmarks/cmmlu 2025-02-13T06:11:18,536 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-13T06:11:18,538 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-13T06:11:18,541 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-13T06:11:18,543 creating build/lib/evalscope/benchmarks/gpqa 2025-02-13T06:11:18,544 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-02-13T06:11:18,547 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-02-13T06:11:18,549 creating build/lib/evalscope/benchmarks/race 2025-02-13T06:11:18,550 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-02-13T06:11:18,553 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-02-13T06:11:18,555 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-02-13T06:11:18,557 creating build/lib/evalscope/benchmarks/hellaswag 2025-02-13T06:11:18,558 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-13T06:11:18,560 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-13T06:11:18,563 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-13T06:11:18,565 creating build/lib/evalscope/benchmarks/iquiz 2025-02-13T06:11:18,566 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-02-13T06:11:18,568 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-02-13T06:11:18,570 creating build/lib/evalscope/benchmarks/gsm8k 2025-02-13T06:11:18,571 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-13T06:11:18,574 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-13T06:11:18,577 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-13T06:11:18,580 creating build/lib/evalscope/benchmarks/data_collection 2025-02-13T06:11:18,582 copying evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/lib/evalscope/benchmarks/data_collection 2025-02-13T06:11:18,584 copying evalscope/benchmarks/data_collection/__init__.py -> build/lib/evalscope/benchmarks/data_collection 2025-02-13T06:11:18,587 creating build/lib/evalscope/benchmarks/arc 2025-02-13T06:11:18,589 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-02-13T06:11:18,593 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-02-13T06:11:18,596 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-02-13T06:11:18,600 creating build/lib/evalscope/benchmarks/competition_math 2025-02-13T06:11:18,602 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-13T06:11:18,604 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-13T06:11:18,607 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-13T06:11:18,610 creating build/lib/evalscope/benchmarks/bbh 2025-02-13T06:11:18,611 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-02-13T06:11:18,614 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-02-13T06:11:18,616 creating build/lib/evalscope/benchmarks/mmlu 2025-02-13T06:11:18,618 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-13T06:11:18,620 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-13T06:11:18,622 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-13T06:11:18,625 creating build/lib/evalscope/benchmarks/general_qa 2025-02-13T06:11:18,626 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-02-13T06:11:18,629 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-02-13T06:11:18,631 creating build/lib/evalscope/benchmarks/math_500 2025-02-13T06:11:18,632 copying evalscope/benchmarks/math_500/__init__.py -> build/lib/evalscope/benchmarks/math_500 2025-02-13T06:11:18,634 copying evalscope/benchmarks/math_500/math_500_adapter.py -> build/lib/evalscope/benchmarks/math_500 2025-02-13T06:11:18,636 creating build/lib/evalscope/benchmarks/humaneval 2025-02-13T06:11:18,638 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-13T06:11:18,640 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-13T06:11:18,642 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-13T06:11:18,645 creating build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,646 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,649 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,652 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,655 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,656 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,659 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-13T06:11:18,661 creating build/lib/evalscope/benchmarks/truthful_qa 2025-02-13T06:11:18,663 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-13T06:11:18,665 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-13T06:11:18,667 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-13T06:11:18,670 creating build/lib/evalscope/benchmarks/general_mcq 2025-02-13T06:11:18,671 copying evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/lib/evalscope/benchmarks/general_mcq 2025-02-13T06:11:18,673 copying evalscope/benchmarks/general_mcq/__init__.py -> build/lib/evalscope/benchmarks/general_mcq 2025-02-13T06:11:18,675 creating build/lib/evalscope/benchmarks/ceval 2025-02-13T06:11:18,676 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-02-13T06:11:18,679 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-02-13T06:11:18,681 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-02-13T06:11:18,684 creating build/lib/evalscope/benchmarks/aime24 2025-02-13T06:11:18,685 copying evalscope/benchmarks/aime24/aime24_adapter.py -> build/lib/evalscope/benchmarks/aime24 2025-02-13T06:11:18,687 copying evalscope/benchmarks/aime24/__init__.py -> build/lib/evalscope/benchmarks/aime24 2025-02-13T06:11:18,689 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:18,690 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:18,692 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:18,695 creating build/lib/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:18,696 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:18,699 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:18,702 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:18,704 creating build/lib/evalscope/perf/plugin 2025-02-13T06:11:18,706 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-02-13T06:11:18,707 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-02-13T06:11:18,710 creating build/lib/evalscope/perf/utils 2025-02-13T06:11:18,711 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,713 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,715 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,717 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,722 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,724 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-02-13T06:11:18,728 creating build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,729 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,731 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,733 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,734 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,736 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,738 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,740 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,742 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-13T06:11:18,744 creating build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,746 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,748 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,750 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,752 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,754 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-13T06:11:18,757 creating build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,758 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,761 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,763 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,764 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,767 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:18,769 creating build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:18,770 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:18,773 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:18,775 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:18,777 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:18,780 creating build/lib/evalscope/third_party/longbench_write/tools 2025-02-13T06:11:18,782 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-13T06:11:18,784 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-13T06:11:18,787 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-13T06:11:18,789 creating build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:18,790 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:18,793 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:18,794 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:18,795 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:18,798 creating build/lib/evalscope/evaluator/reviewer 2025-02-13T06:11:18,799 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-02-13T06:11:18,801 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-02-13T06:11:18,804 creating build/lib/evalscope/models/custom 2025-02-13T06:11:18,805 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-02-13T06:11:18,807 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-02-13T06:11:18,809 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-02-13T06:11:18,812 creating build/lib/tests/swift 2025-02-13T06:11:18,813 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-02-13T06:11:18,815 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-02-13T06:11:18,818 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-02-13T06:11:18,820 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-02-13T06:11:18,823 creating build/lib/tests/vlm 2025-02-13T06:11:18,824 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-02-13T06:11:18,826 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-02-13T06:11:18,829 creating build/lib/tests/cli 2025-02-13T06:11:18,830 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-02-13T06:11:18,832 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-02-13T06:11:18,834 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-02-13T06:11:18,837 creating build/lib/tests/perf 2025-02-13T06:11:18,838 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-02-13T06:11:18,840 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-02-13T06:11:18,843 creating build/lib/tests/rag 2025-02-13T06:11:18,844 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-02-13T06:11:18,845 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-02-13T06:11:18,847 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-02-13T06:11:18,850 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-02-13T06:11:18,852 running egg_info 2025-02-13T06:11:18,883 writing evalscope.egg-info/PKG-INFO 2025-02-13T06:11:18,914 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-02-13T06:11:18,915 writing entry points to evalscope.egg-info/entry_points.txt 2025-02-13T06:11:18,930 writing requirements to evalscope.egg-info/requires.txt 2025-02-13T06:11:18,931 writing top-level names to evalscope.egg-info/top_level.txt 2025-02-13T06:11:19,025 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-02-13T06:11:19,049 reading manifest template 'MANIFEST.in' 2025-02-13T06:11:19,191 adding license file 'LICENSE' 2025-02-13T06:11:19,222 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-02-13T06:11:19,227 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-02-13T06:11:19,227 !! 2025-02-13T06:11:19,228 ******************************************************************************** 2025-02-13T06:11:19,229 ############################ 2025-02-13T06:11:19,229 # Package would be ignored # 2025-02-13T06:11:19,230 ############################ 2025-02-13T06:11:19,231 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-02-13T06:11:19,231 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,232 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,232 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-02-13T06:11:19,233 to the `packages` configuration field. 2025-02-13T06:11:19,234 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,234 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,235 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,236 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,237 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,238 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-02-13T06:11:19,238 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-02-13T06:11:19,239 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,239 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,240 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,241 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,242 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,244 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,244 even if it does not contain any `.py` files. 2025-02-13T06:11:19,245 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,246 directory, all directories are treated like packages. 2025-02-13T06:11:19,246 ******************************************************************************** 2025-02-13T06:11:19,247 !! 2025-02-13T06:11:19,248 check.warn(importable) 2025-02-13T06:11:19,248 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-02-13T06:11:19,249 !! 2025-02-13T06:11:19,250 ******************************************************************************** 2025-02-13T06:11:19,251 ############################ 2025-02-13T06:11:19,251 # Package would be ignored # 2025-02-13T06:11:19,252 ############################ 2025-02-13T06:11:19,252 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-02-13T06:11:19,253 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,254 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,255 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-02-13T06:11:19,255 to the `packages` configuration field. 2025-02-13T06:11:19,256 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,257 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,257 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,258 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,259 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,260 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-02-13T06:11:19,260 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-02-13T06:11:19,261 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,261 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,262 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,262 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,263 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,265 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,265 even if it does not contain any `.py` files. 2025-02-13T06:11:19,266 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,266 directory, all directories are treated like packages. 2025-02-13T06:11:19,267 ******************************************************************************** 2025-02-13T06:11:19,268 !! 2025-02-13T06:11:19,268 check.warn(importable) 2025-02-13T06:11:19,269 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-02-13T06:11:19,269 !! 2025-02-13T06:11:19,270 ******************************************************************************** 2025-02-13T06:11:19,271 ############################ 2025-02-13T06:11:19,271 # Package would be ignored # 2025-02-13T06:11:19,272 ############################ 2025-02-13T06:11:19,272 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-02-13T06:11:19,273 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,275 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,275 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-02-13T06:11:19,276 to the `packages` configuration field. 2025-02-13T06:11:19,278 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,279 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,280 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,281 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,283 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,284 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-02-13T06:11:19,285 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-02-13T06:11:19,285 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,286 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,286 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,288 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,289 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,290 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,290 even if it does not contain any `.py` files. 2025-02-13T06:11:19,291 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,291 directory, all directories are treated like packages. 2025-02-13T06:11:19,292 ******************************************************************************** 2025-02-13T06:11:19,292 !! 2025-02-13T06:11:19,293 check.warn(importable) 2025-02-13T06:11:19,293 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-02-13T06:11:19,294 !! 2025-02-13T06:11:19,294 ******************************************************************************** 2025-02-13T06:11:19,295 ############################ 2025-02-13T06:11:19,295 # Package would be ignored # 2025-02-13T06:11:19,296 ############################ 2025-02-13T06:11:19,296 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-02-13T06:11:19,297 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,298 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,298 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-02-13T06:11:19,299 to the `packages` configuration field. 2025-02-13T06:11:19,300 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,301 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,301 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,302 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,303 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,304 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-02-13T06:11:19,305 already explicitly excluding 'evalscope.metrics.resources' via 2025-02-13T06:11:19,306 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,306 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,307 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,308 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,309 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,311 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,312 even if it does not contain any `.py` files. 2025-02-13T06:11:19,312 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,313 directory, all directories are treated like packages. 2025-02-13T06:11:19,313 ******************************************************************************** 2025-02-13T06:11:19,314 !! 2025-02-13T06:11:19,315 check.warn(importable) 2025-02-13T06:11:19,315 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-02-13T06:11:19,316 !! 2025-02-13T06:11:19,317 ******************************************************************************** 2025-02-13T06:11:19,317 ############################ 2025-02-13T06:11:19,318 # Package would be ignored # 2025-02-13T06:11:19,319 ############################ 2025-02-13T06:11:19,319 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-02-13T06:11:19,319 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,320 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,320 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-02-13T06:11:19,321 to the `packages` configuration field. 2025-02-13T06:11:19,322 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,322 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,323 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,324 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,324 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,326 If you don't want 'evalscope.registry.config' to be distributed and are 2025-02-13T06:11:19,326 already explicitly excluding 'evalscope.registry.config' via 2025-02-13T06:11:19,327 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,327 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,328 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,329 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,330 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,331 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,332 even if it does not contain any `.py` files. 2025-02-13T06:11:19,332 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,333 directory, all directories are treated like packages. 2025-02-13T06:11:19,333 ******************************************************************************** 2025-02-13T06:11:19,334 !! 2025-02-13T06:11:19,335 check.warn(importable) 2025-02-13T06:11:19,335 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-02-13T06:11:19,336 !! 2025-02-13T06:11:19,337 ******************************************************************************** 2025-02-13T06:11:19,337 ############################ 2025-02-13T06:11:19,338 # Package would be ignored # 2025-02-13T06:11:19,339 ############################ 2025-02-13T06:11:19,339 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-02-13T06:11:19,340 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,341 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,341 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-02-13T06:11:19,342 to the `packages` configuration field. 2025-02-13T06:11:19,343 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,344 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,344 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,345 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,346 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,347 If you don't want 'evalscope.registry.data' to be distributed and are 2025-02-13T06:11:19,348 already explicitly excluding 'evalscope.registry.data' via 2025-02-13T06:11:19,349 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,350 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,350 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,351 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,352 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,353 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,354 even if it does not contain any `.py` files. 2025-02-13T06:11:19,354 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,354 directory, all directories are treated like packages. 2025-02-13T06:11:19,355 ******************************************************************************** 2025-02-13T06:11:19,356 !! 2025-02-13T06:11:19,356 check.warn(importable) 2025-02-13T06:11:19,357 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-02-13T06:11:19,358 !! 2025-02-13T06:11:19,359 ******************************************************************************** 2025-02-13T06:11:19,359 ############################ 2025-02-13T06:11:19,360 # Package would be ignored # 2025-02-13T06:11:19,360 ############################ 2025-02-13T06:11:19,361 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-02-13T06:11:19,361 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,362 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,363 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-02-13T06:11:19,363 to the `packages` configuration field. 2025-02-13T06:11:19,364 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,365 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,365 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,366 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,367 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,368 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-02-13T06:11:19,369 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-02-13T06:11:19,370 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,370 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,371 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,372 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,373 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,374 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,375 even if it does not contain any `.py` files. 2025-02-13T06:11:19,375 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,376 directory, all directories are treated like packages. 2025-02-13T06:11:19,376 ******************************************************************************** 2025-02-13T06:11:19,378 !! 2025-02-13T06:11:19,378 check.warn(importable) 2025-02-13T06:11:19,379 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-02-13T06:11:19,379 !! 2025-02-13T06:11:19,380 ******************************************************************************** 2025-02-13T06:11:19,380 ############################ 2025-02-13T06:11:19,381 # Package would be ignored # 2025-02-13T06:11:19,381 ############################ 2025-02-13T06:11:19,382 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-02-13T06:11:19,382 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,383 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,383 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-02-13T06:11:19,384 to the `packages` configuration field. 2025-02-13T06:11:19,385 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,385 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,386 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,387 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,388 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,389 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-02-13T06:11:19,389 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-02-13T06:11:19,390 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,391 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,391 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,392 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,393 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,395 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,395 even if it does not contain any `.py` files. 2025-02-13T06:11:19,396 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,396 directory, all directories are treated like packages. 2025-02-13T06:11:19,397 ******************************************************************************** 2025-02-13T06:11:19,398 !! 2025-02-13T06:11:19,399 check.warn(importable) 2025-02-13T06:11:19,399 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-02-13T06:11:19,400 !! 2025-02-13T06:11:19,401 ******************************************************************************** 2025-02-13T06:11:19,402 ############################ 2025-02-13T06:11:19,402 # Package would be ignored # 2025-02-13T06:11:19,403 ############################ 2025-02-13T06:11:19,404 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-02-13T06:11:19,404 but it is absent from setuptools' `packages` configuration. 2025-02-13T06:11:19,405 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-13T06:11:19,406 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-02-13T06:11:19,406 to the `packages` configuration field. 2025-02-13T06:11:19,408 Alternatively, you can also rely on setuptools' discovery methods 2025-02-13T06:11:19,408 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-13T06:11:19,409 instead of `find_packages(...)`/`find:`). 2025-02-13T06:11:19,410 You can read more about "package discovery" on setuptools documentation page: 2025-02-13T06:11:19,411 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-13T06:11:19,411 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-02-13T06:11:19,412 already explicitly excluding 'evalscope.registry.tasks' via 2025-02-13T06:11:19,412 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-13T06:11:19,413 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-13T06:11:19,413 combination with a more fine grained `package-data` configuration. 2025-02-13T06:11:19,414 You can read more about "package data files" on setuptools documentation page: 2025-02-13T06:11:19,415 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-13T06:11:19,416 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-13T06:11:19,417 even if it does not contain any `.py` files. 2025-02-13T06:11:19,417 On the other hand, currently there is no concept of package data 2025-02-13T06:11:19,418 directory, all directories are treated like packages. 2025-02-13T06:11:19,418 ******************************************************************************** 2025-02-13T06:11:19,419 !! 2025-02-13T06:11:19,420 check.warn(importable) 2025-02-13T06:11:19,420 creating build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,421 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,421 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,422 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,422 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,423 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,423 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,424 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,424 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,425 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,426 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,426 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-13T06:11:19,427 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,427 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,428 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,428 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,429 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,429 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,430 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,430 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,431 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,432 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,432 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,432 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,433 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,433 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,434 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,434 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,434 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,435 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,435 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,436 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,436 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,437 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,437 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,438 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,439 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,439 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,440 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,441 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:19,441 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:19,442 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:19,442 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:19,443 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:19,444 creating build/lib/evalscope/registry/config 2025-02-13T06:11:19,445 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-02-13T06:11:19,446 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-02-13T06:11:19,446 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-02-13T06:11:19,447 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-02-13T06:11:19,448 creating build/lib/evalscope/registry/data 2025-02-13T06:11:19,448 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-02-13T06:11:19,449 creating build/lib/evalscope/registry/data/prompt_template 2025-02-13T06:11:19,449 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-02-13T06:11:19,450 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-02-13T06:11:19,450 creating build/lib/evalscope/registry/data/qa_browser 2025-02-13T06:11:19,451 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-02-13T06:11:19,467 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-02-13T06:11:19,475 creating build/lib/evalscope/metrics/resources 2025-02-13T06:11:19,476 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-02-13T06:11:19,487 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-02-13T06:11:19,509 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-02-13T06:11:19,510 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-02-13T06:11:19,512 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,513 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,516 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,518 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-02-13T06:11:19,521 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-02-13T06:11:19,523 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-02-13T06:11:19,537 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-02-13T06:11:19,539 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:19,542 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:19,544 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:19,547 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-02-13T06:11:19,549 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:19,552 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:19,554 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:19,556 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-02-13T06:11:19,611 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-02-13T06:11:19,612 !! 2025-02-13T06:11:19,613 ******************************************************************************** 2025-02-13T06:11:19,614 Please avoid running ``setup.py`` directly. 2025-02-13T06:11:19,615 Instead, use pypa/build, pypa/installer or other 2025-02-13T06:11:19,615 standards-based tools. 2025-02-13T06:11:19,616 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-02-13T06:11:19,617 ******************************************************************************** 2025-02-13T06:11:19,618 !! 2025-02-13T06:11:19,618 self.initialize_options() 2025-02-13T06:11:19,642 installing to build/bdist.linux-armv7l/wheel 2025-02-13T06:11:19,643 running install 2025-02-13T06:11:19,668 running install_lib 2025-02-13T06:11:19,697 creating build/bdist.linux-armv7l/wheel 2025-02-13T06:11:19,699 creating build/bdist.linux-armv7l/wheel/evalscope 2025-02-13T06:11:19,701 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-02-13T06:11:19,703 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-02-13T06:11:19,704 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-02-13T06:11:19,707 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-02-13T06:11:19,708 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-02-13T06:11:19,729 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-02-13T06:11:19,732 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-02-13T06:11:19,733 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-02-13T06:11:19,735 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-02-13T06:11:19,738 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-02-13T06:11:19,739 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,742 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,744 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,745 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,747 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,750 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,751 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,753 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,755 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,757 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,759 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-13T06:11:19,760 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-02-13T06:11:19,763 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-02-13T06:11:19,764 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-13T06:11:19,766 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-13T06:11:19,768 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-13T06:11:19,770 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-13T06:11:19,772 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-02-13T06:11:19,779 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-02-13T06:11:19,781 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-02-13T06:11:19,783 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-02-13T06:11:19,784 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-02-13T06:11:19,787 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,789 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,792 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,794 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,797 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,799 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-13T06:11:19,801 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-13T06:11:19,802 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-13T06:11:19,804 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-13T06:11:19,807 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-02-13T06:11:19,809 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,810 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,812 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,815 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,817 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,819 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-13T06:11:19,821 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:19,823 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:19,824 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:19,827 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:19,829 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:19,831 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-13T06:11:19,833 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:19,835 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:19,838 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,839 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,841 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-13T06:11:19,843 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:19,845 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-13T06:11:19,847 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-02-13T06:11:19,849 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:19,851 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,852 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,854 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,856 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,859 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,861 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,863 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,865 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,867 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-13T06:11:19,870 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:19,871 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:19,873 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:19,875 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-13T06:11:19,878 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-02-13T06:11:19,879 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-13T06:11:19,881 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-02-13T06:11:19,882 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-13T06:11:19,884 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-13T06:11:19,886 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-13T06:11:19,889 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-13T06:11:19,891 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-13T06:11:19,894 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-02-13T06:11:19,896 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-02-13T06:11:19,898 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-02-13T06:11:19,899 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-13T06:11:19,901 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-13T06:11:19,902 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-13T06:11:19,905 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:19,907 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-02-13T06:11:19,909 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,911 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:19,912 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:19,915 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-02-13T06:11:19,917 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-02-13T06:11:19,918 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-02-13T06:11:19,929 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-02-13T06:11:19,949 copying build/lib/evalscope/metrics/math_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,951 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,953 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,955 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,958 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-13T06:11:19,960 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:19,962 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-02-13T06:11:19,963 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,966 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,968 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,970 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,972 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,975 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,977 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-13T06:11:19,980 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-02-13T06:11:19,981 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-13T06:11:19,983 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-13T06:11:19,984 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-13T06:11:19,986 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-13T06:11:19,989 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-13T06:11:19,991 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:19,993 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-02-13T06:11:19,995 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-02-13T06:11:19,996 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-13T06:11:19,998 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-13T06:11:20,000 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-13T06:11:20,002 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-13T06:11:20,005 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-02-13T06:11:20,006 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-13T06:11:20,008 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-13T06:11:20,010 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-13T06:11:20,013 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-02-13T06:11:20,014 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-13T06:11:20,016 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-13T06:11:20,018 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-13T06:11:20,020 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-13T06:11:20,022 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-02-13T06:11:20,024 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-13T06:11:20,026 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-13T06:11:20,028 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-13T06:11:20,030 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-13T06:11:20,033 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-02-13T06:11:20,034 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-02-13T06:11:20,036 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-02-13T06:11:20,038 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-02-13T06:11:20,039 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-13T06:11:20,042 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-13T06:11:20,044 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-13T06:11:20,047 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/data_collection 2025-02-13T06:11:20,048 copying build/lib/evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-02-13T06:11:20,050 copying build/lib/evalscope/benchmarks/data_collection/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-02-13T06:11:20,052 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-02-13T06:11:20,054 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-13T06:11:20,057 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-13T06:11:20,059 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-13T06:11:20,062 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-02-13T06:11:20,063 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-13T06:11:20,065 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-13T06:11:20,067 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-13T06:11:20,070 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-02-13T06:11:20,071 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-02-13T06:11:20,073 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-02-13T06:11:20,076 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,077 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,079 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,082 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,084 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,086 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,088 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,090 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,092 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,094 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,096 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,098 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,099 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,101 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,103 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,105 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,107 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,109 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,111 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,113 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,114 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,116 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,118 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,120 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,122 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,124 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,126 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,128 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-13T06:11:20,130 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-02-13T06:11:20,132 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-13T06:11:20,134 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-13T06:11:20,136 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-13T06:11:20,139 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-13T06:11:20,142 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-13T06:11:20,145 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-02-13T06:11:20,147 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-02-13T06:11:20,148 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-02-13T06:11:20,151 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/math_500 2025-02-13T06:11:20,152 copying build/lib/evalscope/benchmarks/math_500/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-02-13T06:11:20,153 copying build/lib/evalscope/benchmarks/math_500/math_500_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-02-13T06:11:20,156 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-02-13T06:11:20,157 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-13T06:11:20,159 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-13T06:11:20,161 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-13T06:11:20,163 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-02-13T06:11:20,164 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,167 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,170 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,172 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,174 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,176 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-13T06:11:20,179 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-02-13T06:11:20,180 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-13T06:11:20,183 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-13T06:11:20,184 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-13T06:11:20,187 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-13T06:11:20,189 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_mcq 2025-02-13T06:11:20,190 copying build/lib/evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-02-13T06:11:20,193 copying build/lib/evalscope/benchmarks/general_mcq/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-02-13T06:11:20,195 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-02-13T06:11:20,197 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-13T06:11:20,199 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-13T06:11:20,202 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-13T06:11:20,204 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/aime24 2025-02-13T06:11:20,206 copying build/lib/evalscope/benchmarks/aime24/aime24_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime24 2025-02-13T06:11:20,208 copying build/lib/evalscope/benchmarks/aime24/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime24 2025-02-13T06:11:20,210 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:20,211 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:20,213 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-02-13T06:11:20,215 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-02-13T06:11:20,216 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-13T06:11:20,219 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-13T06:11:20,222 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-13T06:11:20,224 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-13T06:11:20,226 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:20,228 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-02-13T06:11:20,229 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,232 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,233 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,236 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,238 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,240 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,242 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,244 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-13T06:11:20,246 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:20,248 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:20,250 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:20,253 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-02-13T06:11:20,254 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-13T06:11:20,256 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-13T06:11:20,259 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-02-13T06:11:20,261 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-02-13T06:11:20,262 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,264 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,267 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,268 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,271 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,272 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,274 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,276 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-13T06:11:20,278 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-02-13T06:11:20,279 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-13T06:11:20,282 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-13T06:11:20,283 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-13T06:11:20,285 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-13T06:11:20,287 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-13T06:11:20,289 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-02-13T06:11:20,291 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-02-13T06:11:20,293 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-13T06:11:20,295 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-02-13T06:11:20,296 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,299 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,302 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,305 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,306 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,309 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-13T06:11:20,311 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-13T06:11:20,314 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-13T06:11:20,317 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-02-13T06:11:20,318 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-02-13T06:11:20,320 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-02-13T06:11:20,321 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-13T06:11:20,324 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-13T06:11:20,326 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-13T06:11:20,328 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,330 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,332 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,334 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,336 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,338 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,339 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,342 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,343 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,346 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,348 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,350 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,354 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-13T06:11:20,356 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-13T06:11:20,359 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-02-13T06:11:20,360 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,362 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,364 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,366 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,368 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,369 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,371 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,374 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-13T06:11:20,376 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:20,377 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:20,379 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-02-13T06:11:20,381 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-02-13T06:11:20,383 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-13T06:11:20,385 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-02-13T06:11:20,386 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-13T06:11:20,390 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-02-13T06:11:20,391 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-02-13T06:11:20,393 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-02-13T06:11:20,395 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-13T06:11:20,397 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-13T06:11:20,400 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-02-13T06:11:20,402 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-02-13T06:11:20,403 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-13T06:11:20,405 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-13T06:11:20,407 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-13T06:11:20,409 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,411 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,413 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,415 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,417 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,419 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,421 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,422 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-13T06:11:20,425 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-02-13T06:11:20,426 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-13T06:11:20,429 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-13T06:11:20,431 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-13T06:11:20,432 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-13T06:11:20,436 creating build/bdist.linux-armv7l/wheel/tests 2025-02-13T06:11:20,437 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-02-13T06:11:20,439 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-02-13T06:11:20,440 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-13T06:11:20,443 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-13T06:11:20,444 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-13T06:11:20,447 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-13T06:11:20,449 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-02-13T06:11:20,450 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-02-13T06:11:20,452 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-02-13T06:11:20,454 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-02-13T06:11:20,455 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-13T06:11:20,457 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-13T06:11:20,459 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-13T06:11:20,461 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-02-13T06:11:20,463 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-02-13T06:11:20,464 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-02-13T06:11:20,467 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-02-13T06:11:20,469 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-02-13T06:11:20,470 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-13T06:11:20,472 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-13T06:11:20,474 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-13T06:11:20,476 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-13T06:11:20,478 running install_egg_info 2025-02-13T06:11:20,512 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.11.0-py3.11.egg-info 2025-02-13T06:11:20,526 running install_scripts 2025-02-13T06:11:20,581 creating build/bdist.linux-armv7l/wheel/evalscope-0.11.0.dist-info/WHEEL 2025-02-13T06:11:20,584 creating '/tmp/pip-wheel-w7xbvc6h/evalscope-0.11.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-02-13T06:11:20,586 adding 'evalscope/__init__.py' 2025-02-13T06:11:20,588 adding 'evalscope/arguments.py' 2025-02-13T06:11:20,590 adding 'evalscope/config.py' 2025-02-13T06:11:20,591 adding 'evalscope/constants.py' 2025-02-13T06:11:20,593 adding 'evalscope/run.py' 2025-02-13T06:11:20,594 adding 'evalscope/run_arena.py' 2025-02-13T06:11:20,596 adding 'evalscope/summarizer.py' 2025-02-13T06:11:20,598 adding 'evalscope/version.py' 2025-02-13T06:11:20,599 adding 'evalscope/backend/__init__.py' 2025-02-13T06:11:20,601 adding 'evalscope/backend/base.py' 2025-02-13T06:11:20,602 adding 'evalscope/backend/opencompass/__init__.py' 2025-02-13T06:11:20,604 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-02-13T06:11:20,605 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-02-13T06:11:20,607 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-02-13T06:11:20,608 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-02-13T06:11:20,610 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-02-13T06:11:20,611 adding 'evalscope/backend/rag_eval/__init__.py' 2025-02-13T06:11:20,613 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-02-13T06:11:20,614 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-02-13T06:11:20,616 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-02-13T06:11:20,617 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-02-13T06:11:20,619 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-02-13T06:11:20,621 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-02-13T06:11:20,622 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-02-13T06:11:20,624 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-02-13T06:11:20,625 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-02-13T06:11:20,628 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-02-13T06:11:20,629 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-02-13T06:11:20,631 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-02-13T06:11:20,632 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-02-13T06:11:20,633 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-02-13T06:11:20,635 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-02-13T06:11:20,637 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-02-13T06:11:20,639 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-02-13T06:11:20,640 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-02-13T06:11:20,641 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-02-13T06:11:20,643 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-02-13T06:11:20,644 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-02-13T06:11:20,646 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-02-13T06:11:20,647 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-02-13T06:11:20,649 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-02-13T06:11:20,650 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-02-13T06:11:20,651 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-02-13T06:11:20,653 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-02-13T06:11:20,655 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-02-13T06:11:20,656 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-02-13T06:11:20,657 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-02-13T06:11:20,659 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-02-13T06:11:20,660 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-02-13T06:11:20,662 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-02-13T06:11:20,664 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-02-13T06:11:20,665 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-02-13T06:11:20,666 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-02-13T06:11:20,668 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-02-13T06:11:20,669 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-02-13T06:11:20,671 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-02-13T06:11:20,672 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-02-13T06:11:20,674 adding 'evalscope/benchmarks/__init__.py' 2025-02-13T06:11:20,676 adding 'evalscope/benchmarks/benchmark.py' 2025-02-13T06:11:20,678 adding 'evalscope/benchmarks/data_adapter.py' 2025-02-13T06:11:20,679 adding 'evalscope/benchmarks/aime24/__init__.py' 2025-02-13T06:11:20,681 adding 'evalscope/benchmarks/aime24/aime24_adapter.py' 2025-02-13T06:11:20,682 adding 'evalscope/benchmarks/arc/__init__.py' 2025-02-13T06:11:20,684 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-02-13T06:11:20,685 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-02-13T06:11:20,687 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-02-13T06:11:20,689 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-02-13T06:11:20,691 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-02-13T06:11:20,692 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-02-13T06:11:20,694 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-02-13T06:11:20,695 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-02-13T06:11:20,696 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-02-13T06:11:20,697 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-02-13T06:11:20,699 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-02-13T06:11:20,700 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-02-13T06:11:20,701 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-02-13T06:11:20,702 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-02-13T06:11:20,703 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-02-13T06:11:20,705 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-02-13T06:11:20,706 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-02-13T06:11:20,708 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-02-13T06:11:20,709 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-02-13T06:11:20,711 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-02-13T06:11:20,712 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-02-13T06:11:20,713 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-02-13T06:11:20,714 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-02-13T06:11:20,716 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-02-13T06:11:20,717 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-02-13T06:11:20,718 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-02-13T06:11:20,720 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-02-13T06:11:20,721 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-02-13T06:11:20,722 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-02-13T06:11:20,723 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-02-13T06:11:20,724 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-02-13T06:11:20,726 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-02-13T06:11:20,728 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-02-13T06:11:20,730 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-02-13T06:11:20,732 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-02-13T06:11:20,733 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-02-13T06:11:20,735 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-02-13T06:11:20,736 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-02-13T06:11:20,738 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-02-13T06:11:20,739 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-02-13T06:11:20,741 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-02-13T06:11:20,743 adding 'evalscope/benchmarks/data_collection/__init__.py' 2025-02-13T06:11:20,744 adding 'evalscope/benchmarks/data_collection/data_collection_adapter.py' 2025-02-13T06:11:20,746 adding 'evalscope/benchmarks/general_mcq/__init__.py' 2025-02-13T06:11:20,747 adding 'evalscope/benchmarks/general_mcq/general_mcq_adapter.py' 2025-02-13T06:11:20,749 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-02-13T06:11:20,750 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-02-13T06:11:20,752 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-02-13T06:11:20,753 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-02-13T06:11:20,755 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-02-13T06:11:20,756 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-02-13T06:11:20,758 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-02-13T06:11:20,760 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-02-13T06:11:20,762 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-02-13T06:11:20,763 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-02-13T06:11:20,765 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-02-13T06:11:20,766 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-02-13T06:11:20,768 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-02-13T06:11:20,769 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-02-13T06:11:20,771 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-02-13T06:11:20,772 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-02-13T06:11:20,777 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-02-13T06:11:20,778 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-02-13T06:11:20,782 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-02-13T06:11:20,783 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-02-13T06:11:20,785 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-02-13T06:11:20,786 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-02-13T06:11:20,788 adding 'evalscope/benchmarks/math_500/__init__.py' 2025-02-13T06:11:20,790 adding 'evalscope/benchmarks/math_500/math_500_adapter.py' 2025-02-13T06:11:20,791 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-02-13T06:11:20,793 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-02-13T06:11:20,795 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-02-13T06:11:20,796 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-02-13T06:11:20,798 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-02-13T06:11:20,799 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-02-13T06:11:20,801 adding 'evalscope/benchmarks/race/__init__.py' 2025-02-13T06:11:20,802 adding 'evalscope/benchmarks/race/race.py' 2025-02-13T06:11:20,804 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-02-13T06:11:20,805 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-02-13T06:11:20,807 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-02-13T06:11:20,808 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-02-13T06:11:20,809 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-02-13T06:11:20,811 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-02-13T06:11:20,812 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-02-13T06:11:20,814 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-02-13T06:11:20,816 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-02-13T06:11:20,818 adding 'evalscope/cli/__init__.py' 2025-02-13T06:11:20,819 adding 'evalscope/cli/base.py' 2025-02-13T06:11:20,820 adding 'evalscope/cli/cli.py' 2025-02-13T06:11:20,822 adding 'evalscope/cli/start_app.py' 2025-02-13T06:11:20,823 adding 'evalscope/cli/start_eval.py' 2025-02-13T06:11:20,824 adding 'evalscope/cli/start_perf.py' 2025-02-13T06:11:20,825 adding 'evalscope/cli/start_server.py' 2025-02-13T06:11:20,827 adding 'evalscope/collections/__init__.py' 2025-02-13T06:11:20,829 adding 'evalscope/collections/evaluator.py' 2025-02-13T06:11:20,830 adding 'evalscope/collections/sampler.py' 2025-02-13T06:11:20,832 adding 'evalscope/collections/schema.py' 2025-02-13T06:11:20,834 adding 'evalscope/evaluator/__init__.py' 2025-02-13T06:11:20,836 adding 'evalscope/evaluator/evaluator.py' 2025-02-13T06:11:20,838 adding 'evalscope/evaluator/rating_eval.py' 2025-02-13T06:11:20,840 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-02-13T06:11:20,842 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-02-13T06:11:20,843 adding 'evalscope/metrics/__init__.py' 2025-02-13T06:11:20,845 adding 'evalscope/metrics/code_metric.py' 2025-02-13T06:11:20,847 adding 'evalscope/metrics/math_parser.py' 2025-02-13T06:11:20,850 adding 'evalscope/metrics/metrics.py' 2025-02-13T06:11:20,851 adding 'evalscope/metrics/named_metrics.py' 2025-02-13T06:11:20,853 adding 'evalscope/metrics/rouge_metric.py' 2025-02-13T06:11:20,854 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-02-13T06:11:20,856 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-02-13T06:11:21,014 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-02-13T06:11:21,259 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-02-13T06:11:21,268 adding 'evalscope/models/__init__.py' 2025-02-13T06:11:21,269 adding 'evalscope/models/base_adapter.py' 2025-02-13T06:11:21,271 adding 'evalscope/models/chat_adapter.py' 2025-02-13T06:11:21,272 adding 'evalscope/models/choice_adapter.py' 2025-02-13T06:11:21,274 adding 'evalscope/models/custom_adapter.py' 2025-02-13T06:11:21,275 adding 'evalscope/models/local_model.py' 2025-02-13T06:11:21,276 adding 'evalscope/models/model.py' 2025-02-13T06:11:21,278 adding 'evalscope/models/server_adapter.py' 2025-02-13T06:11:21,280 adding 'evalscope/models/custom/__init__.py' 2025-02-13T06:11:21,281 adding 'evalscope/models/custom/custom_model.py' 2025-02-13T06:11:21,282 adding 'evalscope/models/custom/dummy_model.py' 2025-02-13T06:11:21,284 adding 'evalscope/perf/__init__.py' 2025-02-13T06:11:21,286 adding 'evalscope/perf/arguments.py' 2025-02-13T06:11:21,288 adding 'evalscope/perf/benchmark.py' 2025-02-13T06:11:21,289 adding 'evalscope/perf/http_client.py' 2025-02-13T06:11:21,291 adding 'evalscope/perf/main.py' 2025-02-13T06:11:21,292 adding 'evalscope/perf/plugin/__init__.py' 2025-02-13T06:11:21,293 adding 'evalscope/perf/plugin/registry.py' 2025-02-13T06:11:21,295 adding 'evalscope/perf/plugin/api/__init__.py' 2025-02-13T06:11:21,296 adding 'evalscope/perf/plugin/api/base.py' 2025-02-13T06:11:21,298 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-02-13T06:11:21,300 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-02-13T06:11:21,301 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-02-13T06:11:21,304 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-02-13T06:11:21,305 adding 'evalscope/perf/plugin/datasets/base.py' 2025-02-13T06:11:21,306 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-02-13T06:11:21,308 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-02-13T06:11:21,309 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-02-13T06:11:21,310 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-02-13T06:11:21,311 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-02-13T06:11:21,313 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-02-13T06:11:21,314 adding 'evalscope/perf/utils/__init__.py' 2025-02-13T06:11:21,316 adding 'evalscope/perf/utils/analysis_result.py' 2025-02-13T06:11:21,317 adding 'evalscope/perf/utils/benchmark_util.py' 2025-02-13T06:11:21,319 adding 'evalscope/perf/utils/db_util.py' 2025-02-13T06:11:21,320 adding 'evalscope/perf/utils/handler.py' 2025-02-13T06:11:21,322 adding 'evalscope/perf/utils/local_server.py' 2025-02-13T06:11:21,323 adding 'evalscope/registry/__init__.py' 2025-02-13T06:11:21,325 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-02-13T06:11:21,326 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-02-13T06:11:21,328 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-02-13T06:11:21,329 adding 'evalscope/registry/config/cfg_single.yaml' 2025-02-13T06:11:21,331 adding 'evalscope/registry/data/question.jsonl' 2025-02-13T06:11:21,334 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-02-13T06:11:21,335 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-02-13T06:11:21,499 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-02-13T06:11:21,508 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-02-13T06:11:21,509 adding 'evalscope/registry/tasks/arc.yaml' 2025-02-13T06:11:21,511 adding 'evalscope/registry/tasks/bbh.yaml' 2025-02-13T06:11:21,512 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-02-13T06:11:21,513 adding 'evalscope/registry/tasks/ceval.yaml' 2025-02-13T06:11:21,514 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-02-13T06:11:21,515 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-02-13T06:11:21,516 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-02-13T06:11:21,518 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-02-13T06:11:21,519 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-02-13T06:11:21,520 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-02-13T06:11:21,521 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-02-13T06:11:21,523 adding 'evalscope/report/__init__.py' 2025-02-13T06:11:21,526 adding 'evalscope/report/app.py' 2025-02-13T06:11:21,527 adding 'evalscope/report/combinator.py' 2025-02-13T06:11:21,528 adding 'evalscope/report/generator.py' 2025-02-13T06:11:21,530 adding 'evalscope/report/utils.py' 2025-02-13T06:11:21,531 adding 'evalscope/third_party/__init__.py' 2025-02-13T06:11:21,533 adding 'evalscope/third_party/longbench_write/README.md' 2025-02-13T06:11:21,534 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-02-13T06:11:21,536 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-02-13T06:11:21,537 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-02-13T06:11:21,539 adding 'evalscope/third_party/longbench_write/eval.py' 2025-02-13T06:11:21,540 adding 'evalscope/third_party/longbench_write/infer.py' 2025-02-13T06:11:21,541 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-02-13T06:11:21,542 adding 'evalscope/third_party/longbench_write/utils.py' 2025-02-13T06:11:21,544 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-02-13T06:11:21,545 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-02-13T06:11:21,553 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-02-13T06:11:21,557 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-02-13T06:11:21,558 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-02-13T06:11:21,560 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-02-13T06:11:21,561 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-02-13T06:11:21,563 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-02-13T06:11:21,565 adding 'evalscope/third_party/toolbench_static/README.md' 2025-02-13T06:11:21,566 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-02-13T06:11:21,567 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-02-13T06:11:21,568 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-02-13T06:11:21,570 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-02-13T06:11:21,572 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-02-13T06:11:21,573 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-02-13T06:11:21,574 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-02-13T06:11:21,576 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-02-13T06:11:21,577 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-02-13T06:11:21,579 adding 'evalscope/utils/__init__.py' 2025-02-13T06:11:21,581 adding 'evalscope/utils/arena_utils.py' 2025-02-13T06:11:21,582 adding 'evalscope/utils/chat_service.py' 2025-02-13T06:11:21,584 adding 'evalscope/utils/completion_parsers.py' 2025-02-13T06:11:21,585 adding 'evalscope/utils/io_utils.py' 2025-02-13T06:11:21,587 adding 'evalscope/utils/logger.py' 2025-02-13T06:11:21,588 adding 'evalscope/utils/model_utils.py' 2025-02-13T06:11:21,590 adding 'evalscope/utils/utils.py' 2025-02-13T06:11:21,593 adding 'tests/__init__.py' 2025-02-13T06:11:21,594 adding 'tests/test_run_all.py' 2025-02-13T06:11:21,595 adding 'tests/cli/__init__.py' 2025-02-13T06:11:21,597 adding 'tests/cli/test_collection.py' 2025-02-13T06:11:21,598 adding 'tests/cli/test_run.py' 2025-02-13T06:11:21,600 adding 'tests/perf/__init__.py' 2025-02-13T06:11:21,601 adding 'tests/perf/test_perf.py' 2025-02-13T06:11:21,603 adding 'tests/rag/__init__.py' 2025-02-13T06:11:21,604 adding 'tests/rag/test_clip_benchmark.py' 2025-02-13T06:11:21,606 adding 'tests/rag/test_mteb.py' 2025-02-13T06:11:21,607 adding 'tests/rag/test_ragas.py' 2025-02-13T06:11:21,609 adding 'tests/swift/__init__.py' 2025-02-13T06:11:21,611 adding 'tests/swift/test_run_swift_eval.py' 2025-02-13T06:11:21,612 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-02-13T06:11:21,613 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-02-13T06:11:21,615 adding 'tests/vlm/__init__.py' 2025-02-13T06:11:21,616 adding 'tests/vlm/test_vlmeval.py' 2025-02-13T06:11:21,618 adding 'evalscope-0.11.0.dist-info/LICENSE' 2025-02-13T06:11:21,621 adding 'evalscope-0.11.0.dist-info/METADATA' 2025-02-13T06:11:21,623 adding 'evalscope-0.11.0.dist-info/WHEEL' 2025-02-13T06:11:21,623 adding 'evalscope-0.11.0.dist-info/entry_points.txt' 2025-02-13T06:11:21,624 adding 'evalscope-0.11.0.dist-info/top_level.txt' 2025-02-13T06:11:21,629 adding 'evalscope-0.11.0.dist-info/RECORD' 2025-02-13T06:11:21,648 removing build/bdist.linux-armv7l/wheel 2025-02-13T06:11:21,854 Building wheel for evalscope (setup.py): finished with status 'done' 2025-02-13T06:11:21,870 Created wheel for evalscope: filename=evalscope-0.11.0-py3-none-any.whl size=1439682 sha256=6e7d3242c5bf97b54d24644a1300575fdf41c1d90eef7c1344c20bf0d1518671 2025-02-13T06:11:21,871 Stored in directory: /tmp/pip-ephem-wheel-cache-k6kh3au9/wheels/4c/b0/d6/4dc24e55546d22ffc649642034986722b5555acfa298449a8d 2025-02-13T06:11:21,899 Successfully built evalscope 2025-02-13T06:11:21,955 Removed build tracker: '/tmp/pip-build-tracker-gmjuwxp7'