2025-02-27T14:35:03,524 Created temporary directory: /tmp/pip-build-tracker-t0nw88ih 2025-02-27T14:35:03,525 Initialized build tracking at /tmp/pip-build-tracker-t0nw88ih 2025-02-27T14:35:03,526 Created build tracker: /tmp/pip-build-tracker-t0nw88ih 2025-02-27T14:35:03,526 Entered build tracker: /tmp/pip-build-tracker-t0nw88ih 2025-02-27T14:35:03,527 Created temporary directory: /tmp/pip-wheel-o_fyz2xz 2025-02-27T14:35:03,531 Created temporary directory: /tmp/pip-ephem-wheel-cache-1fok5o2s 2025-02-27T14:35:03,576 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-02-27T14:35:03,579 2 location(s) to search for versions of evalscope: 2025-02-27T14:35:03,579 * https://pypi.org/simple/evalscope/ 2025-02-27T14:35:03,579 * https://www.piwheels.org/simple/evalscope/ 2025-02-27T14:35:03,580 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-02-27T14:35:03,580 Getting page https://pypi.org/simple/evalscope/ 2025-02-27T14:35:03,582 Found index url https://pypi.org/simple/ 2025-02-27T14:35:03,801 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-02-27T14:35:03,810 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,811 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-02-27T14:35:03,812 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,813 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-02-27T14:35:03,814 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,814 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-02-27T14:35:03,815 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,816 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-02-27T14:35:03,817 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,818 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-02-27T14:35:03,818 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,819 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,820 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-02-27T14:35:03,821 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,822 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-02-27T14:35:03,822 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,823 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-02-27T14:35:03,824 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,824 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-02-27T14:35:03,825 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,826 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-02-27T14:35:03,826 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,827 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-02-27T14:35:03,828 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,829 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-02-27T14:35:03,829 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,830 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-02-27T14:35:03,831 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,832 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-02-27T14:35:03,832 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,833 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-02-27T14:35:03,834 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,834 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-02-27T14:35:03,835 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,836 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-02-27T14:35:03,836 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,837 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-02-27T14:35:03,838 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,839 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-02-27T14:35:03,839 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d6/e5/852326943d86c85b5ca6b548a5f3753c217b771d93968c61ec2ca46ee0b1/evalscope-0.11.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,840 Found link https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.11.0 2025-02-27T14:35:03,841 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7d/8e/f9eceecf8bc7d740603f915eef7fab3e9d657a01f5de2c523e531445299c/evalscope-0.12.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:03,842 Found link https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.0 2025-02-27T14:35:03,843 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-02-27T14:35:03,843 Getting page https://www.piwheels.org/simple/evalscope/ 2025-02-27T14:35:03,845 Found index url https://www.piwheels.org/simple/ 2025-02-27T14:35:04,008 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-02-27T14:35:04,012 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.11.0-py3-none-any.whl#sha256=6e7d3242c5bf97b54d24644a1300575fdf41c1d90eef7c1344c20bf0d1518671 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,013 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.1-py3-none-any.whl#sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,013 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,014 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,014 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,015 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,015 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,016 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,016 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,017 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-02-27T14:35:04,017 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-02-27T14:35:04,018 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-02-27T14:35:04,039 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-02-27T14:35:04,041 Collecting evalscope==0.12.0 2025-02-27T14:35:04,044 Created temporary directory: /tmp/pip-unpack-6ek4b0va 2025-02-27T14:35:04,262 Downloading evalscope-0.12.0.tar.gz (1.3 MB) 2025-02-27T14:35:05,254 Added evalscope==0.12.0 from https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz to build tracker '/tmp/pip-build-tracker-t0nw88ih' 2025-02-27T14:35:05,257 Running setup.py (path:/tmp/pip-wheel-o_fyz2xz/evalscope_31bb627906fd4ba9860b81447088b108/setup.py) egg_info for package evalscope 2025-02-27T14:35:05,258 Created temporary directory: /tmp/pip-pip-egg-info-g18llfeh 2025-02-27T14:35:05,258 Preparing metadata (setup.py): started 2025-02-27T14:35:05,259 Running command python setup.py egg_info 2025-02-27T14:35:05,874 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-27T14:35:05,874 !! 2025-02-27T14:35:05,875 ******************************************************************************** 2025-02-27T14:35:05,876 Usage of dash-separated 'index-url' will not be supported in future 2025-02-27T14:35:05,876 versions. Please use the underscore name 'index_url' instead. 2025-02-27T14:35:05,877 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-27T14:35:05,878 or your builds will no longer be supported. 2025-02-27T14:35:05,878 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-27T14:35:05,879 ******************************************************************************** 2025-02-27T14:35:05,880 !! 2025-02-27T14:35:05,881 opt = self.warn_dash_deprecation(opt, section) 2025-02-27T14:35:06,465 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-27T14:35:06,465 !! 2025-02-27T14:35:06,466 ******************************************************************************** 2025-02-27T14:35:06,467 Usage of dash-separated 'index-url' will not be supported in future 2025-02-27T14:35:06,467 versions. Please use the underscore name 'index_url' instead. 2025-02-27T14:35:06,469 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-27T14:35:06,469 or your builds will no longer be supported. 2025-02-27T14:35:06,470 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-27T14:35:06,471 ******************************************************************************** 2025-02-27T14:35:06,472 !! 2025-02-27T14:35:06,473 opt = self.warn_dash_deprecation(opt, section) 2025-02-27T14:35:06,502 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-02-27T14:35:06,503 running egg_info 2025-02-27T14:35:06,529 creating /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info 2025-02-27T14:35:06,531 writing /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/PKG-INFO 2025-02-27T14:35:06,562 writing dependency_links to /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/dependency_links.txt 2025-02-27T14:35:06,563 writing entry points to /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/entry_points.txt 2025-02-27T14:35:06,579 writing requirements to /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/requires.txt 2025-02-27T14:35:06,580 writing top-level names to /tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/top_level.txt 2025-02-27T14:35:06,582 writing manifest file '/tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/SOURCES.txt' 2025-02-27T14:35:06,753 reading manifest file '/tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/SOURCES.txt' 2025-02-27T14:35:06,754 reading manifest template 'MANIFEST.in' 2025-02-27T14:35:06,945 adding license file 'LICENSE' 2025-02-27T14:35:06,960 writing manifest file '/tmp/pip-pip-egg-info-g18llfeh/evalscope.egg-info/SOURCES.txt' 2025-02-27T14:35:07,073 Preparing metadata (setup.py): finished with status 'done' 2025-02-27T14:35:07,080 Source in /tmp/pip-wheel-o_fyz2xz/evalscope_31bb627906fd4ba9860b81447088b108 has version 0.12.0, which satisfies requirement evalscope==0.12.0 from https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz 2025-02-27T14:35:07,081 Removed evalscope==0.12.0 from https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz from build tracker '/tmp/pip-build-tracker-t0nw88ih' 2025-02-27T14:35:07,144 Created temporary directory: /tmp/pip-unpack-i7qvj9zr 2025-02-27T14:35:07,145 Created temporary directory: /tmp/pip-unpack-uij5tbyv 2025-02-27T14:35:07,146 Building wheels for collected packages: evalscope 2025-02-27T14:35:07,150 Created temporary directory: /tmp/pip-wheel-3a0shavb 2025-02-27T14:35:07,151 Building wheel for evalscope (setup.py): started 2025-02-27T14:35:07,152 Destination directory: /tmp/pip-wheel-3a0shavb 2025-02-27T14:35:07,153 Running command python setup.py bdist_wheel 2025-02-27T14:35:07,615 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-02-27T14:35:07,723 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-27T14:35:07,724 !! 2025-02-27T14:35:07,725 ******************************************************************************** 2025-02-27T14:35:07,725 Usage of dash-separated 'index-url' will not be supported in future 2025-02-27T14:35:07,726 versions. Please use the underscore name 'index_url' instead. 2025-02-27T14:35:07,727 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-27T14:35:07,727 or your builds will no longer be supported. 2025-02-27T14:35:07,728 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-27T14:35:07,729 ******************************************************************************** 2025-02-27T14:35:07,730 !! 2025-02-27T14:35:07,731 opt = self.warn_dash_deprecation(opt, section) 2025-02-27T14:35:08,305 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-02-27T14:35:08,305 !! 2025-02-27T14:35:08,306 ******************************************************************************** 2025-02-27T14:35:08,307 Usage of dash-separated 'index-url' will not be supported in future 2025-02-27T14:35:08,307 versions. Please use the underscore name 'index_url' instead. 2025-02-27T14:35:08,309 By 2025-Mar-03, you need to update your project and remove deprecated calls 2025-02-27T14:35:08,309 or your builds will no longer be supported. 2025-02-27T14:35:08,310 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-02-27T14:35:08,311 ******************************************************************************** 2025-02-27T14:35:08,312 !! 2025-02-27T14:35:08,313 opt = self.warn_dash_deprecation(opt, section) 2025-02-27T14:35:08,315 running bdist_wheel 2025-02-27T14:35:08,450 running build 2025-02-27T14:35:08,450 running build_py 2025-02-27T14:35:08,482 creating build/lib/evalscope 2025-02-27T14:35:08,484 copying evalscope/summarizer.py -> build/lib/evalscope 2025-02-27T14:35:08,487 copying evalscope/constants.py -> build/lib/evalscope 2025-02-27T14:35:08,490 copying evalscope/version.py -> build/lib/evalscope 2025-02-27T14:35:08,492 copying evalscope/run.py -> build/lib/evalscope 2025-02-27T14:35:08,494 copying evalscope/config.py -> build/lib/evalscope 2025-02-27T14:35:08,497 copying evalscope/__init__.py -> build/lib/evalscope 2025-02-27T14:35:08,500 copying evalscope/arguments.py -> build/lib/evalscope 2025-02-27T14:35:08,503 copying evalscope/run_arena.py -> build/lib/evalscope 2025-02-27T14:35:08,506 creating build/lib/tests 2025-02-27T14:35:08,507 copying tests/__init__.py -> build/lib/tests 2025-02-27T14:35:08,510 copying tests/test_run_all.py -> build/lib/tests 2025-02-27T14:35:08,513 creating build/lib/evalscope/models 2025-02-27T14:35:08,514 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-02-27T14:35:08,517 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-02-27T14:35:08,520 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-02-27T14:35:08,522 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-02-27T14:35:08,524 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-02-27T14:35:08,526 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-02-27T14:35:08,528 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-02-27T14:35:08,530 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-02-27T14:35:08,533 creating build/lib/evalscope/registry 2025-02-27T14:35:08,535 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-02-27T14:35:08,538 creating build/lib/evalscope/metrics 2025-02-27T14:35:08,539 copying evalscope/metrics/math_parser.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,543 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,545 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,547 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,550 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,552 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-02-27T14:35:08,555 creating build/lib/evalscope/utils 2025-02-27T14:35:08,556 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,559 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,561 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,564 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,566 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,568 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,570 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,572 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-02-27T14:35:08,575 creating build/lib/evalscope/perf 2025-02-27T14:35:08,576 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-02-27T14:35:08,578 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-02-27T14:35:08,580 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-02-27T14:35:08,584 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-02-27T14:35:08,586 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-02-27T14:35:08,590 creating build/lib/evalscope/cli 2025-02-27T14:35:08,591 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,593 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,595 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,598 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,600 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,602 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,604 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-02-27T14:35:08,607 creating build/lib/evalscope/report 2025-02-27T14:35:08,609 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-02-27T14:35:08,611 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-02-27T14:35:08,613 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-02-27T14:35:08,616 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-02-27T14:35:08,618 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-02-27T14:35:08,621 creating build/lib/evalscope/benchmarks 2025-02-27T14:35:08,622 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-02-27T14:35:08,624 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-02-27T14:35:08,626 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-02-27T14:35:08,629 creating build/lib/evalscope/evaluator 2025-02-27T14:35:08,630 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-02-27T14:35:08,633 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-02-27T14:35:08,635 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-02-27T14:35:08,638 creating build/lib/evalscope/collections 2025-02-27T14:35:08,639 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-02-27T14:35:08,642 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-02-27T14:35:08,644 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-02-27T14:35:08,646 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-02-27T14:35:08,648 creating build/lib/evalscope/third_party 2025-02-27T14:35:08,649 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-02-27T14:35:08,652 creating build/lib/evalscope/backend 2025-02-27T14:35:08,653 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-02-27T14:35:08,655 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-02-27T14:35:08,657 creating build/lib/evalscope/models/custom 2025-02-27T14:35:08,658 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-02-27T14:35:08,660 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-02-27T14:35:08,661 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-02-27T14:35:08,664 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:08,665 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:08,668 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:08,671 creating build/lib/evalscope/perf/utils 2025-02-27T14:35:08,672 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,675 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,677 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,679 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,681 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,683 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-02-27T14:35:08,685 creating build/lib/evalscope/perf/plugin 2025-02-27T14:35:08,686 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-02-27T14:35:08,688 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-02-27T14:35:08,691 creating build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,692 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,694 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,696 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,698 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,700 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-02-27T14:35:08,703 creating build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,704 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,706 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,708 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,710 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,711 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,713 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,715 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,716 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-02-27T14:35:08,719 creating build/lib/evalscope/benchmarks/general_qa 2025-02-27T14:35:08,720 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-02-27T14:35:08,722 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-02-27T14:35:08,724 creating build/lib/evalscope/benchmarks/arc 2025-02-27T14:35:08,725 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-02-27T14:35:08,728 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-02-27T14:35:08,730 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-02-27T14:35:08,732 creating build/lib/evalscope/benchmarks/ceval 2025-02-27T14:35:08,733 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-02-27T14:35:08,735 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-02-27T14:35:08,738 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-02-27T14:35:08,741 creating build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,742 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,744 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,746 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,749 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,752 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,754 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-02-27T14:35:08,757 creating build/lib/evalscope/benchmarks/truthful_qa 2025-02-27T14:35:08,758 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-27T14:35:08,761 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-27T14:35:08,763 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-02-27T14:35:08,766 creating build/lib/evalscope/benchmarks/general_mcq 2025-02-27T14:35:08,767 copying evalscope/benchmarks/general_mcq/__init__.py -> build/lib/evalscope/benchmarks/general_mcq 2025-02-27T14:35:08,769 copying evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/lib/evalscope/benchmarks/general_mcq 2025-02-27T14:35:08,772 creating build/lib/evalscope/benchmarks/competition_math 2025-02-27T14:35:08,773 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-27T14:35:08,775 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-27T14:35:08,778 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-02-27T14:35:08,780 creating build/lib/evalscope/benchmarks/process_bench 2025-02-27T14:35:08,781 copying evalscope/benchmarks/process_bench/__init__.py -> build/lib/evalscope/benchmarks/process_bench 2025-02-27T14:35:08,783 copying evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/lib/evalscope/benchmarks/process_bench 2025-02-27T14:35:08,785 creating build/lib/evalscope/benchmarks/gsm8k 2025-02-27T14:35:08,786 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-27T14:35:08,789 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-27T14:35:08,790 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-02-27T14:35:08,794 creating build/lib/evalscope/benchmarks/humaneval 2025-02-27T14:35:08,795 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-27T14:35:08,797 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-27T14:35:08,799 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-02-27T14:35:08,801 creating build/lib/evalscope/benchmarks/gpqa 2025-02-27T14:35:08,802 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-02-27T14:35:08,805 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-02-27T14:35:08,807 creating build/lib/evalscope/benchmarks/mmlu 2025-02-27T14:35:08,808 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-27T14:35:08,810 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-27T14:35:08,812 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-02-27T14:35:08,815 creating build/lib/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:08,816 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:08,818 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:08,820 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:08,823 creating build/lib/evalscope/benchmarks/iquiz 2025-02-27T14:35:08,824 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-02-27T14:35:08,826 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-02-27T14:35:08,828 creating build/lib/evalscope/benchmarks/race 2025-02-27T14:35:08,829 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-02-27T14:35:08,831 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-02-27T14:35:08,833 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-02-27T14:35:08,836 creating build/lib/evalscope/benchmarks/data_collection 2025-02-27T14:35:08,837 copying evalscope/benchmarks/data_collection/__init__.py -> build/lib/evalscope/benchmarks/data_collection 2025-02-27T14:35:08,839 copying evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/lib/evalscope/benchmarks/data_collection 2025-02-27T14:35:08,841 creating build/lib/evalscope/benchmarks/musr 2025-02-27T14:35:08,842 copying evalscope/benchmarks/musr/__init__.py -> build/lib/evalscope/benchmarks/musr 2025-02-27T14:35:08,844 copying evalscope/benchmarks/musr/musr_adapter.py -> build/lib/evalscope/benchmarks/musr 2025-02-27T14:35:08,846 creating build/lib/evalscope/benchmarks/aime 2025-02-27T14:35:08,847 copying evalscope/benchmarks/aime/aime24_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-02-27T14:35:08,849 copying evalscope/benchmarks/aime/aime25_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-02-27T14:35:08,851 copying evalscope/benchmarks/aime/__init__.py -> build/lib/evalscope/benchmarks/aime 2025-02-27T14:35:08,854 creating build/lib/evalscope/benchmarks/math_500 2025-02-27T14:35:08,855 copying evalscope/benchmarks/math_500/__init__.py -> build/lib/evalscope/benchmarks/math_500 2025-02-27T14:35:08,856 copying evalscope/benchmarks/math_500/math_500_adapter.py -> build/lib/evalscope/benchmarks/math_500 2025-02-27T14:35:08,859 creating build/lib/evalscope/benchmarks/hellaswag 2025-02-27T14:35:08,860 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-27T14:35:08,862 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-27T14:35:08,864 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-02-27T14:35:08,867 creating build/lib/evalscope/benchmarks/cmmlu 2025-02-27T14:35:08,868 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-27T14:35:08,870 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-27T14:35:08,873 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-02-27T14:35:08,876 creating build/lib/evalscope/benchmarks/bbh 2025-02-27T14:35:08,877 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-02-27T14:35:08,880 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-02-27T14:35:08,882 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:08,883 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:08,886 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:08,888 creating build/lib/evalscope/evaluator/reviewer 2025-02-27T14:35:08,889 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-02-27T14:35:08,891 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-02-27T14:35:08,894 creating build/lib/evalscope/third_party/thinkbench 2025-02-27T14:35:08,895 copying evalscope/third_party/thinkbench/eval.py -> build/lib/evalscope/third_party/thinkbench 2025-02-27T14:35:08,898 copying evalscope/third_party/thinkbench/__init__.py -> build/lib/evalscope/third_party/thinkbench 2025-02-27T14:35:08,900 copying evalscope/third_party/thinkbench/infer.py -> build/lib/evalscope/third_party/thinkbench 2025-02-27T14:35:08,903 creating build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,904 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,906 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,908 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,910 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,912 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:08,915 creating build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:08,917 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:08,919 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:08,921 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:08,923 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:08,926 creating build/lib/evalscope/third_party/thinkbench/tools 2025-02-27T14:35:08,927 copying evalscope/third_party/thinkbench/tools/utils.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-02-27T14:35:08,929 copying evalscope/third_party/thinkbench/tools/llm.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-02-27T14:35:08,931 copying evalscope/third_party/thinkbench/tools/__init__.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-02-27T14:35:08,933 creating build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:08,934 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:08,937 creating build/lib/evalscope/third_party/longbench_write/tools 2025-02-27T14:35:08,938 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-27T14:35:08,940 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-27T14:35:08,942 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-02-27T14:35:08,945 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:08,946 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:08,948 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:08,950 creating build/lib/evalscope/backend/rag_eval 2025-02-27T14:35:08,951 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-02-27T14:35:08,953 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-02-27T14:35:08,956 creating build/lib/evalscope/backend/opencompass 2025-02-27T14:35:08,957 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-02-27T14:35:08,959 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-02-27T14:35:08,961 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-02-27T14:35:08,964 creating build/lib/evalscope/backend/vlm_eval_kit 2025-02-27T14:35:08,965 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-27T14:35:08,967 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-27T14:35:08,969 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-02-27T14:35:08,971 creating build/lib/evalscope/backend/rag_eval/ragas 2025-02-27T14:35:08,973 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-27T14:35:08,975 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-27T14:35:08,977 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-02-27T14:35:08,979 creating build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,980 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,982 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,985 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,987 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,988 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-02-27T14:35:08,991 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:08,993 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:08,995 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:08,997 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:08,999 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:09,002 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:09,003 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:09,005 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:09,007 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:09,009 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:09,012 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,013 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,015 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,016 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,019 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,021 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:09,023 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:09,024 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:09,026 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:09,028 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:09,030 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:09,033 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,034 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,037 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,039 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,041 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,043 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,046 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,048 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,051 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:09,054 creating build/lib/evalscope/backend/opencompass/tasks 2025-02-27T14:35:09,055 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-27T14:35:09,057 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-27T14:35:09,059 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-02-27T14:35:09,062 creating build/lib/tests/perf 2025-02-27T14:35:09,063 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-02-27T14:35:09,065 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-02-27T14:35:09,068 creating build/lib/tests/cli 2025-02-27T14:35:09,069 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-02-27T14:35:09,072 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-02-27T14:35:09,074 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-02-27T14:35:09,077 creating build/lib/tests/swift 2025-02-27T14:35:09,079 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-02-27T14:35:09,081 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-02-27T14:35:09,083 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-02-27T14:35:09,086 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-02-27T14:35:09,088 creating build/lib/tests/rag 2025-02-27T14:35:09,090 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-02-27T14:35:09,092 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-02-27T14:35:09,093 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-02-27T14:35:09,096 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-02-27T14:35:09,098 creating build/lib/tests/vlm 2025-02-27T14:35:09,099 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-02-27T14:35:09,102 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-02-27T14:35:09,104 running egg_info 2025-02-27T14:35:09,132 writing evalscope.egg-info/PKG-INFO 2025-02-27T14:35:09,163 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-02-27T14:35:09,164 writing entry points to evalscope.egg-info/entry_points.txt 2025-02-27T14:35:09,180 writing requirements to evalscope.egg-info/requires.txt 2025-02-27T14:35:09,181 writing top-level names to evalscope.egg-info/top_level.txt 2025-02-27T14:35:09,305 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-02-27T14:35:09,325 reading manifest template 'MANIFEST.in' 2025-02-27T14:35:09,458 adding license file 'LICENSE' 2025-02-27T14:35:09,478 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-02-27T14:35:09,481 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-02-27T14:35:09,482 !! 2025-02-27T14:35:09,483 ******************************************************************************** 2025-02-27T14:35:09,483 ############################ 2025-02-27T14:35:09,484 # Package would be ignored # 2025-02-27T14:35:09,485 ############################ 2025-02-27T14:35:09,485 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-02-27T14:35:09,486 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,487 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,487 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-02-27T14:35:09,488 to the `packages` configuration field. 2025-02-27T14:35:09,489 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,490 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,491 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,492 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,493 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,493 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-02-27T14:35:09,494 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-02-27T14:35:09,494 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,495 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,495 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,496 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,497 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,499 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,499 even if it does not contain any `.py` files. 2025-02-27T14:35:09,500 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,500 directory, all directories are treated like packages. 2025-02-27T14:35:09,501 ******************************************************************************** 2025-02-27T14:35:09,502 !! 2025-02-27T14:35:09,502 check.warn(importable) 2025-02-27T14:35:09,503 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-02-27T14:35:09,503 !! 2025-02-27T14:35:09,505 ******************************************************************************** 2025-02-27T14:35:09,505 ############################ 2025-02-27T14:35:09,506 # Package would be ignored # 2025-02-27T14:35:09,506 ############################ 2025-02-27T14:35:09,507 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-02-27T14:35:09,507 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,509 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,509 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-02-27T14:35:09,510 to the `packages` configuration field. 2025-02-27T14:35:09,511 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,511 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,512 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,513 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,515 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,516 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-02-27T14:35:09,516 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-02-27T14:35:09,517 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,517 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,518 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,519 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,520 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,522 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,522 even if it does not contain any `.py` files. 2025-02-27T14:35:09,523 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,524 directory, all directories are treated like packages. 2025-02-27T14:35:09,524 ******************************************************************************** 2025-02-27T14:35:09,525 !! 2025-02-27T14:35:09,526 check.warn(importable) 2025-02-27T14:35:09,526 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-02-27T14:35:09,526 !! 2025-02-27T14:35:09,527 ******************************************************************************** 2025-02-27T14:35:09,528 ############################ 2025-02-27T14:35:09,528 # Package would be ignored # 2025-02-27T14:35:09,529 ############################ 2025-02-27T14:35:09,529 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-02-27T14:35:09,530 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,531 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,531 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-02-27T14:35:09,531 to the `packages` configuration field. 2025-02-27T14:35:09,533 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,533 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,534 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,535 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,536 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,537 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-02-27T14:35:09,538 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-02-27T14:35:09,538 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,539 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,539 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,541 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,542 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,544 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,545 even if it does not contain any `.py` files. 2025-02-27T14:35:09,545 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,546 directory, all directories are treated like packages. 2025-02-27T14:35:09,547 ******************************************************************************** 2025-02-27T14:35:09,548 !! 2025-02-27T14:35:09,548 check.warn(importable) 2025-02-27T14:35:09,549 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-02-27T14:35:09,549 !! 2025-02-27T14:35:09,550 ******************************************************************************** 2025-02-27T14:35:09,551 ############################ 2025-02-27T14:35:09,551 # Package would be ignored # 2025-02-27T14:35:09,552 ############################ 2025-02-27T14:35:09,553 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-02-27T14:35:09,553 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,555 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,556 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-02-27T14:35:09,556 to the `packages` configuration field. 2025-02-27T14:35:09,557 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,558 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,558 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,559 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,560 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,561 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-02-27T14:35:09,562 already explicitly excluding 'evalscope.metrics.resources' via 2025-02-27T14:35:09,562 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,563 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,563 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,564 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,565 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,567 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,567 even if it does not contain any `.py` files. 2025-02-27T14:35:09,568 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,569 directory, all directories are treated like packages. 2025-02-27T14:35:09,569 ******************************************************************************** 2025-02-27T14:35:09,570 !! 2025-02-27T14:35:09,571 check.warn(importable) 2025-02-27T14:35:09,571 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-02-27T14:35:09,572 !! 2025-02-27T14:35:09,573 ******************************************************************************** 2025-02-27T14:35:09,574 ############################ 2025-02-27T14:35:09,575 # Package would be ignored # 2025-02-27T14:35:09,575 ############################ 2025-02-27T14:35:09,576 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-02-27T14:35:09,576 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,577 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,578 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-02-27T14:35:09,578 to the `packages` configuration field. 2025-02-27T14:35:09,580 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,580 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,581 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,582 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,583 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,584 If you don't want 'evalscope.registry.config' to be distributed and are 2025-02-27T14:35:09,585 already explicitly excluding 'evalscope.registry.config' via 2025-02-27T14:35:09,585 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,586 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,586 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,588 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,589 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,590 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,591 even if it does not contain any `.py` files. 2025-02-27T14:35:09,591 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,592 directory, all directories are treated like packages. 2025-02-27T14:35:09,592 ******************************************************************************** 2025-02-27T14:35:09,593 !! 2025-02-27T14:35:09,594 check.warn(importable) 2025-02-27T14:35:09,594 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-02-27T14:35:09,595 !! 2025-02-27T14:35:09,596 ******************************************************************************** 2025-02-27T14:35:09,596 ############################ 2025-02-27T14:35:09,597 # Package would be ignored # 2025-02-27T14:35:09,597 ############################ 2025-02-27T14:35:09,598 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-02-27T14:35:09,598 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,599 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,600 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-02-27T14:35:09,600 to the `packages` configuration field. 2025-02-27T14:35:09,601 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,602 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,602 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,603 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,604 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,605 If you don't want 'evalscope.registry.data' to be distributed and are 2025-02-27T14:35:09,606 already explicitly excluding 'evalscope.registry.data' via 2025-02-27T14:35:09,606 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,607 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,607 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,609 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,610 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,611 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,612 even if it does not contain any `.py` files. 2025-02-27T14:35:09,612 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,613 directory, all directories are treated like packages. 2025-02-27T14:35:09,613 ******************************************************************************** 2025-02-27T14:35:09,614 !! 2025-02-27T14:35:09,615 check.warn(importable) 2025-02-27T14:35:09,615 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-02-27T14:35:09,616 !! 2025-02-27T14:35:09,618 ******************************************************************************** 2025-02-27T14:35:09,618 ############################ 2025-02-27T14:35:09,619 # Package would be ignored # 2025-02-27T14:35:09,619 ############################ 2025-02-27T14:35:09,620 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-02-27T14:35:09,620 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,621 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,621 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-02-27T14:35:09,622 to the `packages` configuration field. 2025-02-27T14:35:09,623 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,623 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,623 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,625 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,626 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,627 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-02-27T14:35:09,627 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-02-27T14:35:09,627 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,628 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,629 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,630 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,631 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,632 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,633 even if it does not contain any `.py` files. 2025-02-27T14:35:09,633 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,634 directory, all directories are treated like packages. 2025-02-27T14:35:09,634 ******************************************************************************** 2025-02-27T14:35:09,635 !! 2025-02-27T14:35:09,635 check.warn(importable) 2025-02-27T14:35:09,636 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-02-27T14:35:09,637 !! 2025-02-27T14:35:09,638 ******************************************************************************** 2025-02-27T14:35:09,638 ############################ 2025-02-27T14:35:09,639 # Package would be ignored # 2025-02-27T14:35:09,639 ############################ 2025-02-27T14:35:09,640 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-02-27T14:35:09,641 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,642 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,642 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-02-27T14:35:09,643 to the `packages` configuration field. 2025-02-27T14:35:09,644 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,645 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,645 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,646 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,647 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,648 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-02-27T14:35:09,649 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-02-27T14:35:09,649 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,649 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,650 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,651 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,651 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,653 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,653 even if it does not contain any `.py` files. 2025-02-27T14:35:09,654 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,654 directory, all directories are treated like packages. 2025-02-27T14:35:09,655 ******************************************************************************** 2025-02-27T14:35:09,656 !! 2025-02-27T14:35:09,657 check.warn(importable) 2025-02-27T14:35:09,657 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-02-27T14:35:09,657 !! 2025-02-27T14:35:09,658 ******************************************************************************** 2025-02-27T14:35:09,659 ############################ 2025-02-27T14:35:09,659 # Package would be ignored # 2025-02-27T14:35:09,660 ############################ 2025-02-27T14:35:09,661 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-02-27T14:35:09,661 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,662 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,663 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-02-27T14:35:09,663 to the `packages` configuration field. 2025-02-27T14:35:09,664 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,665 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,665 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,666 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,667 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,668 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-02-27T14:35:09,669 already explicitly excluding 'evalscope.registry.tasks' via 2025-02-27T14:35:09,669 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,670 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,670 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,671 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,672 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,674 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,675 even if it does not contain any `.py` files. 2025-02-27T14:35:09,675 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,675 directory, all directories are treated like packages. 2025-02-27T14:35:09,676 ******************************************************************************** 2025-02-27T14:35:09,677 !! 2025-02-27T14:35:09,678 check.warn(importable) 2025-02-27T14:35:09,678 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.third_party.thinkbench.resources' is absent from the `packages` configuration. 2025-02-27T14:35:09,679 !! 2025-02-27T14:35:09,679 ******************************************************************************** 2025-02-27T14:35:09,680 ############################ 2025-02-27T14:35:09,680 # Package would be ignored # 2025-02-27T14:35:09,681 ############################ 2025-02-27T14:35:09,681 Python recognizes 'evalscope.third_party.thinkbench.resources' as an importable package[^1], 2025-02-27T14:35:09,682 but it is absent from setuptools' `packages` configuration. 2025-02-27T14:35:09,683 This leads to an ambiguous overall configuration. If you want to distribute this 2025-02-27T14:35:09,683 package, please make sure that 'evalscope.third_party.thinkbench.resources' is explicitly added 2025-02-27T14:35:09,683 to the `packages` configuration field. 2025-02-27T14:35:09,684 Alternatively, you can also rely on setuptools' discovery methods 2025-02-27T14:35:09,685 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-02-27T14:35:09,685 instead of `find_packages(...)`/`find:`). 2025-02-27T14:35:09,686 You can read more about "package discovery" on setuptools documentation page: 2025-02-27T14:35:09,687 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-02-27T14:35:09,688 If you don't want 'evalscope.third_party.thinkbench.resources' to be distributed and are 2025-02-27T14:35:09,689 already explicitly excluding 'evalscope.third_party.thinkbench.resources' via 2025-02-27T14:35:09,689 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-02-27T14:35:09,690 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-02-27T14:35:09,690 combination with a more fine grained `package-data` configuration. 2025-02-27T14:35:09,691 You can read more about "package data files" on setuptools documentation page: 2025-02-27T14:35:09,692 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-02-27T14:35:09,693 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-02-27T14:35:09,694 even if it does not contain any `.py` files. 2025-02-27T14:35:09,694 On the other hand, currently there is no concept of package data 2025-02-27T14:35:09,695 directory, all directories are treated like packages. 2025-02-27T14:35:09,695 ******************************************************************************** 2025-02-27T14:35:09,697 !! 2025-02-27T14:35:09,697 check.warn(importable) 2025-02-27T14:35:09,698 creating build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,698 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,699 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,699 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,700 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,701 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,703 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,708 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,714 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,715 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,716 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,716 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-02-27T14:35:09,717 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,717 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,718 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,718 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,719 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,719 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,719 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,720 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,721 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,721 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,722 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,722 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,723 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,723 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,724 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,724 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,725 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,725 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,726 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,726 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,727 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,727 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,728 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,729 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,729 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,730 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,731 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,732 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:09,732 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:09,733 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:09,734 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:09,734 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:09,735 creating build/lib/evalscope/registry/config 2025-02-27T14:35:09,736 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-02-27T14:35:09,737 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-02-27T14:35:09,738 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-02-27T14:35:09,738 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-02-27T14:35:09,739 creating build/lib/evalscope/registry/data 2025-02-27T14:35:09,740 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-02-27T14:35:09,741 creating build/lib/evalscope/registry/data/prompt_template 2025-02-27T14:35:09,742 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-02-27T14:35:09,743 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-02-27T14:35:09,744 creating build/lib/evalscope/registry/data/qa_browser 2025-02-27T14:35:09,744 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-02-27T14:35:09,745 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-02-27T14:35:09,745 creating build/lib/evalscope/metrics/resources 2025-02-27T14:35:09,746 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-02-27T14:35:09,746 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-02-27T14:35:09,768 copying evalscope/benchmarks/process_bench/critique_template.txt -> build/lib/evalscope/benchmarks/process_bench 2025-02-27T14:35:09,770 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-02-27T14:35:09,773 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-02-27T14:35:09,775 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:09,778 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-02-27T14:35:09,780 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-02-27T14:35:09,794 creating build/lib/evalscope/third_party/thinkbench/resources 2025-02-27T14:35:09,796 copying evalscope/third_party/thinkbench/resources/critique_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-02-27T14:35:09,798 copying evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-02-27T14:35:09,800 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:09,803 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:09,806 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-02-27T14:35:09,808 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:09,811 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:09,815 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:09,823 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-02-27T14:35:09,833 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-02-27T14:35:09,836 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-02-27T14:35:09,846 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:09,850 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:09,859 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:09,986 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-02-27T14:35:09,987 !! 2025-02-27T14:35:09,990 ******************************************************************************** 2025-02-27T14:35:09,991 Please avoid running ``setup.py`` directly. 2025-02-27T14:35:09,993 Instead, use pypa/build, pypa/installer or other 2025-02-27T14:35:09,995 standards-based tools. 2025-02-27T14:35:09,999 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-02-27T14:35:10,001 ******************************************************************************** 2025-02-27T14:35:10,004 !! 2025-02-27T14:35:10,005 self.initialize_options() 2025-02-27T14:35:10,031 installing to build/bdist.linux-armv7l/wheel 2025-02-27T14:35:10,032 running install 2025-02-27T14:35:10,066 running install_lib 2025-02-27T14:35:10,103 creating build/bdist.linux-armv7l/wheel 2025-02-27T14:35:10,106 creating build/bdist.linux-armv7l/wheel/evalscope 2025-02-27T14:35:10,107 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-02-27T14:35:10,109 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,112 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-02-27T14:35:10,113 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-27T14:35:10,115 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-27T14:35:10,117 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-02-27T14:35:10,119 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,121 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,123 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,125 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,127 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,130 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,132 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-02-27T14:35:10,135 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-02-27T14:35:10,137 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-02-27T14:35:10,139 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-02-27T14:35:10,140 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-02-27T14:35:10,143 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-02-27T14:35:10,146 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-02-27T14:35:10,147 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-02-27T14:35:10,172 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-02-27T14:35:10,174 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-02-27T14:35:10,177 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-02-27T14:35:10,179 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,180 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,182 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,184 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,186 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,188 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,190 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,192 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,194 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,196 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,198 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-02-27T14:35:10,201 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-02-27T14:35:10,202 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-27T14:35:10,204 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-27T14:35:10,206 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-27T14:35:10,208 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-02-27T14:35:10,210 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-02-27T14:35:10,212 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,215 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,217 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-02-27T14:35:10,219 copying build/lib/evalscope/metrics/math_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,221 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,223 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,226 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-02-27T14:35:10,227 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-02-27T14:35:10,250 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-02-27T14:35:10,264 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,266 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,269 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:10,270 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:10,273 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-02-27T14:35:10,275 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-02-27T14:35:10,278 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-02-27T14:35:10,279 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,282 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,284 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,286 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,288 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,290 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,292 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,295 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-02-27T14:35:10,298 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-02-27T14:35:10,299 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-27T14:35:10,302 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-02-27T14:35:10,303 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,305 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,308 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,310 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,312 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,314 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-02-27T14:35:10,316 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-02-27T14:35:10,317 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-02-27T14:35:10,320 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-02-27T14:35:10,321 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-27T14:35:10,324 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-27T14:35:10,327 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-27T14:35:10,329 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-27T14:35:10,332 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-02-27T14:35:10,337 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-02-27T14:35:10,340 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-02-27T14:35:10,342 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,345 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,347 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,349 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,351 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,353 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,355 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,357 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-02-27T14:35:10,359 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-27T14:35:10,360 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-27T14:35:10,362 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-27T14:35:10,365 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-02-27T14:35:10,368 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,370 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-02-27T14:35:10,371 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,373 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,375 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,377 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,379 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,381 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,384 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-02-27T14:35:10,386 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,389 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-02-27T14:35:10,390 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-27T14:35:10,393 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-27T14:35:10,395 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-27T14:35:10,398 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-27T14:35:10,400 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-02-27T14:35:10,402 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-02-27T14:35:10,404 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-02-27T14:35:10,406 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-02-27T14:35:10,408 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-02-27T14:35:10,410 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-02-27T14:35:10,412 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-27T14:35:10,414 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-27T14:35:10,416 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-02-27T14:35:10,419 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-02-27T14:35:10,420 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-27T14:35:10,422 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-27T14:35:10,424 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-02-27T14:35:10,427 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-27T14:35:10,430 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-02-27T14:35:10,431 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,435 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,437 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,440 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,442 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,445 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-02-27T14:35:10,448 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-02-27T14:35:10,449 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-27T14:35:10,452 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-27T14:35:10,455 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-02-27T14:35:10,458 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_mcq 2025-02-27T14:35:10,459 copying build/lib/evalscope/benchmarks/general_mcq/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-02-27T14:35:10,461 copying build/lib/evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-02-27T14:35:10,464 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-02-27T14:35:10,466 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-27T14:35:10,468 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-27T14:35:10,471 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-02-27T14:35:10,474 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/process_bench 2025-02-27T14:35:10,475 copying build/lib/evalscope/benchmarks/process_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-02-27T14:35:10,477 copying build/lib/evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-02-27T14:35:10,479 copying build/lib/evalscope/benchmarks/process_bench/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-02-27T14:35:10,482 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-27T14:35:10,484 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-02-27T14:35:10,486 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-27T14:35:10,489 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-27T14:35:10,491 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-02-27T14:35:10,495 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-02-27T14:35:10,497 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-27T14:35:10,500 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-27T14:35:10,502 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-02-27T14:35:10,505 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-02-27T14:35:10,506 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-27T14:35:10,509 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-27T14:35:10,512 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-02-27T14:35:10,515 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-02-27T14:35:10,517 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-27T14:35:10,520 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-27T14:35:10,522 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-27T14:35:10,526 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-02-27T14:35:10,528 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-02-27T14:35:10,530 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-27T14:35:10,533 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-27T14:35:10,535 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-27T14:35:10,537 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-02-27T14:35:10,540 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-02-27T14:35:10,542 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-02-27T14:35:10,543 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-02-27T14:35:10,546 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-02-27T14:35:10,548 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-27T14:35:10,551 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-27T14:35:10,553 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-27T14:35:10,556 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-02-27T14:35:10,560 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/data_collection 2025-02-27T14:35:10,562 copying build/lib/evalscope/benchmarks/data_collection/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-02-27T14:35:10,564 copying build/lib/evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-02-27T14:35:10,567 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/musr 2025-02-27T14:35:10,569 copying build/lib/evalscope/benchmarks/musr/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-02-27T14:35:10,572 copying build/lib/evalscope/benchmarks/musr/musr_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-02-27T14:35:10,577 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/aime 2025-02-27T14:35:10,579 copying build/lib/evalscope/benchmarks/aime/aime24_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-02-27T14:35:10,582 copying build/lib/evalscope/benchmarks/aime/aime25_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-02-27T14:35:10,584 copying build/lib/evalscope/benchmarks/aime/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-02-27T14:35:10,587 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/math_500 2025-02-27T14:35:10,589 copying build/lib/evalscope/benchmarks/math_500/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-02-27T14:35:10,591 copying build/lib/evalscope/benchmarks/math_500/math_500_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-02-27T14:35:10,595 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-02-27T14:35:10,596 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-27T14:35:10,599 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-27T14:35:10,602 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-02-27T14:35:10,605 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-02-27T14:35:10,608 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-02-27T14:35:10,609 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-27T14:35:10,612 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-27T14:35:10,615 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-27T14:35:10,618 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-02-27T14:35:10,621 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-02-27T14:35:10,623 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-02-27T14:35:10,636 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,637 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,641 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,644 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,647 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,649 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,652 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,654 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,657 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,660 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,662 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,665 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,668 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,671 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,674 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,678 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,680 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,682 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,684 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,686 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,689 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,692 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,694 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,697 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,699 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,703 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,707 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,710 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-02-27T14:35:10,712 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-02-27T14:35:10,715 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:10,717 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:10,720 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-02-27T14:35:10,722 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,725 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:10,728 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-02-27T14:35:10,730 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-27T14:35:10,734 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-02-27T14:35:10,736 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-02-27T14:35:10,739 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-02-27T14:35:10,742 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-27T14:35:10,745 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-02-27T14:35:10,982 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-02-27T14:35:10,984 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-27T14:35:10,988 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-27T14:35:10,991 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-27T14:35:10,994 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-02-27T14:35:10,997 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:11,000 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-02-27T14:35:11,003 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-02-27T14:35:11,005 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-02-27T14:35:11,007 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench 2025-02-27T14:35:11,009 copying build/lib/evalscope/third_party/thinkbench/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-02-27T14:35:11,011 copying build/lib/evalscope/third_party/thinkbench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-02-27T14:35:11,014 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/resources 2025-02-27T14:35:11,015 copying build/lib/evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-02-27T14:35:11,017 copying build/lib/evalscope/third_party/thinkbench/resources/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-02-27T14:35:11,020 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/tools 2025-02-27T14:35:11,021 copying build/lib/evalscope/third_party/thinkbench/tools/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-02-27T14:35:11,023 copying build/lib/evalscope/third_party/thinkbench/tools/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-02-27T14:35:11,025 copying build/lib/evalscope/third_party/thinkbench/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-02-27T14:35:11,026 copying build/lib/evalscope/third_party/thinkbench/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-02-27T14:35:11,029 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-02-27T14:35:11,030 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,032 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,035 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,038 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,039 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,042 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,045 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,048 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,050 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-02-27T14:35:11,053 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,057 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-02-27T14:35:11,058 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-27T14:35:11,063 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-27T14:35:11,066 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-02-27T14:35:11,068 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,071 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,073 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,076 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-02-27T14:35:11,078 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-02-27T14:35:11,080 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,082 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,084 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,087 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,090 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:11,091 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:11,094 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-02-27T14:35:11,096 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,098 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,100 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,103 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-02-27T14:35:11,106 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-02-27T14:35:11,107 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-02-27T14:35:11,110 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-02-27T14:35:11,112 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-02-27T14:35:11,114 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,116 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,118 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,121 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,123 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,125 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-02-27T14:35:11,127 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-27T14:35:11,130 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-02-27T14:35:11,131 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-02-27T14:35:11,133 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-27T14:35:11,135 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-02-27T14:35:11,138 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,139 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,141 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,144 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,146 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,148 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-02-27T14:35:11,151 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:11,154 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:11,155 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:11,159 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-02-27T14:35:11,162 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:11,164 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:11,166 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:11,168 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:11,170 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-02-27T14:35:11,172 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:11,174 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:11,176 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:11,178 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-02-27T14:35:11,181 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-02-27T14:35:11,183 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:11,185 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,187 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,190 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,192 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,194 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,197 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,199 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,202 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,205 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-02-27T14:35:11,208 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:11,210 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:11,212 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:11,214 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-02-27T14:35:11,216 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-02-27T14:35:11,218 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-02-27T14:35:11,220 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-02-27T14:35:11,222 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-02-27T14:35:11,224 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-27T14:35:11,227 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-27T14:35:11,229 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-02-27T14:35:11,231 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-27T14:35:11,234 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-27T14:35:11,237 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-02-27T14:35:11,239 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-02-27T14:35:11,241 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-27T14:35:11,243 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-27T14:35:11,245 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-02-27T14:35:11,248 creating build/bdist.linux-armv7l/wheel/tests 2025-02-27T14:35:11,250 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-02-27T14:35:11,251 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-02-27T14:35:11,254 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-02-27T14:35:11,256 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-02-27T14:35:11,257 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-27T14:35:11,260 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-27T14:35:11,262 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-02-27T14:35:11,263 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-02-27T14:35:11,265 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-02-27T14:35:11,267 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-02-27T14:35:11,269 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-27T14:35:11,271 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-27T14:35:11,274 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-27T14:35:11,277 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-02-27T14:35:11,279 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-02-27T14:35:11,281 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-27T14:35:11,284 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-27T14:35:11,286 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-27T14:35:11,289 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-02-27T14:35:11,293 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-02-27T14:35:11,295 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-02-27T14:35:11,297 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-02-27T14:35:11,300 running install_egg_info 2025-02-27T14:35:11,336 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.12.0-py3.11.egg-info 2025-02-27T14:35:11,354 running install_scripts 2025-02-27T14:35:11,412 creating build/bdist.linux-armv7l/wheel/evalscope-0.12.0.dist-info/WHEEL 2025-02-27T14:35:11,414 creating '/tmp/pip-wheel-3a0shavb/evalscope-0.12.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-02-27T14:35:11,417 adding 'evalscope/__init__.py' 2025-02-27T14:35:11,418 adding 'evalscope/arguments.py' 2025-02-27T14:35:11,421 adding 'evalscope/config.py' 2025-02-27T14:35:11,423 adding 'evalscope/constants.py' 2025-02-27T14:35:11,425 adding 'evalscope/run.py' 2025-02-27T14:35:11,427 adding 'evalscope/run_arena.py' 2025-02-27T14:35:11,429 adding 'evalscope/summarizer.py' 2025-02-27T14:35:11,430 adding 'evalscope/version.py' 2025-02-27T14:35:11,432 adding 'evalscope/backend/__init__.py' 2025-02-27T14:35:11,434 adding 'evalscope/backend/base.py' 2025-02-27T14:35:11,436 adding 'evalscope/backend/opencompass/__init__.py' 2025-02-27T14:35:11,438 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-02-27T14:35:11,440 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-02-27T14:35:11,442 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-02-27T14:35:11,444 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-02-27T14:35:11,446 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-02-27T14:35:11,448 adding 'evalscope/backend/rag_eval/__init__.py' 2025-02-27T14:35:11,450 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-02-27T14:35:11,452 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-02-27T14:35:11,453 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-02-27T14:35:11,455 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-02-27T14:35:11,457 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-02-27T14:35:11,459 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-02-27T14:35:11,461 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-02-27T14:35:11,463 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-02-27T14:35:11,465 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-02-27T14:35:11,467 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-02-27T14:35:11,469 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-02-27T14:35:11,472 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-02-27T14:35:11,473 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-02-27T14:35:11,475 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-02-27T14:35:11,476 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-02-27T14:35:11,478 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-02-27T14:35:11,480 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-02-27T14:35:11,481 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-02-27T14:35:11,483 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-02-27T14:35:11,484 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-02-27T14:35:11,486 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-02-27T14:35:11,488 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-02-27T14:35:11,489 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-02-27T14:35:11,491 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-02-27T14:35:11,492 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-02-27T14:35:11,494 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-02-27T14:35:11,496 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-02-27T14:35:11,498 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-02-27T14:35:11,499 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-02-27T14:35:11,501 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-02-27T14:35:11,502 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-02-27T14:35:11,503 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-02-27T14:35:11,505 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-02-27T14:35:11,507 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-02-27T14:35:11,509 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-02-27T14:35:11,510 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-02-27T14:35:11,511 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-02-27T14:35:11,513 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-02-27T14:35:11,515 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-02-27T14:35:11,516 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-02-27T14:35:11,518 adding 'evalscope/benchmarks/__init__.py' 2025-02-27T14:35:11,520 adding 'evalscope/benchmarks/benchmark.py' 2025-02-27T14:35:11,522 adding 'evalscope/benchmarks/data_adapter.py' 2025-02-27T14:35:11,524 adding 'evalscope/benchmarks/aime/__init__.py' 2025-02-27T14:35:11,526 adding 'evalscope/benchmarks/aime/aime24_adapter.py' 2025-02-27T14:35:11,527 adding 'evalscope/benchmarks/aime/aime25_adapter.py' 2025-02-27T14:35:11,529 adding 'evalscope/benchmarks/arc/__init__.py' 2025-02-27T14:35:11,530 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-02-27T14:35:11,532 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-02-27T14:35:11,536 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-02-27T14:35:11,539 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-02-27T14:35:11,542 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-02-27T14:35:11,544 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-02-27T14:35:11,546 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-02-27T14:35:11,548 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-02-27T14:35:11,549 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-02-27T14:35:11,551 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-02-27T14:35:11,553 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-02-27T14:35:11,555 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-02-27T14:35:11,557 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-02-27T14:35:11,558 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-02-27T14:35:11,560 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-02-27T14:35:11,562 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-02-27T14:35:11,564 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-02-27T14:35:11,566 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-02-27T14:35:11,567 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-02-27T14:35:11,569 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-02-27T14:35:11,571 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-02-27T14:35:11,573 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-02-27T14:35:11,575 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-02-27T14:35:11,577 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-02-27T14:35:11,579 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-02-27T14:35:11,580 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-02-27T14:35:11,582 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-02-27T14:35:11,584 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-02-27T14:35:11,586 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-02-27T14:35:11,588 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-02-27T14:35:11,590 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-02-27T14:35:11,592 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-02-27T14:35:11,596 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-02-27T14:35:11,598 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-02-27T14:35:11,601 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-02-27T14:35:11,603 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-02-27T14:35:11,605 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-02-27T14:35:11,607 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-02-27T14:35:11,610 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-02-27T14:35:11,612 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-02-27T14:35:11,614 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-02-27T14:35:11,616 adding 'evalscope/benchmarks/data_collection/__init__.py' 2025-02-27T14:35:11,618 adding 'evalscope/benchmarks/data_collection/data_collection_adapter.py' 2025-02-27T14:35:11,620 adding 'evalscope/benchmarks/general_mcq/__init__.py' 2025-02-27T14:35:11,622 adding 'evalscope/benchmarks/general_mcq/general_mcq_adapter.py' 2025-02-27T14:35:11,625 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-02-27T14:35:11,626 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-02-27T14:35:11,629 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-02-27T14:35:11,631 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-02-27T14:35:11,632 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-02-27T14:35:11,634 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-02-27T14:35:11,635 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-02-27T14:35:11,637 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-02-27T14:35:11,639 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-02-27T14:35:11,640 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-02-27T14:35:11,642 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-02-27T14:35:11,644 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-02-27T14:35:11,646 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-02-27T14:35:11,647 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-02-27T14:35:11,649 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-02-27T14:35:11,650 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-02-27T14:35:11,655 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-02-27T14:35:11,657 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-02-27T14:35:11,660 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-02-27T14:35:11,662 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-02-27T14:35:11,663 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-02-27T14:35:11,665 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-02-27T14:35:11,667 adding 'evalscope/benchmarks/math_500/__init__.py' 2025-02-27T14:35:11,669 adding 'evalscope/benchmarks/math_500/math_500_adapter.py' 2025-02-27T14:35:11,671 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-02-27T14:35:11,672 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-02-27T14:35:11,674 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-02-27T14:35:11,676 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-02-27T14:35:11,678 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-02-27T14:35:11,679 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-02-27T14:35:11,682 adding 'evalscope/benchmarks/musr/__init__.py' 2025-02-27T14:35:11,683 adding 'evalscope/benchmarks/musr/musr_adapter.py' 2025-02-27T14:35:11,685 adding 'evalscope/benchmarks/process_bench/__init__.py' 2025-02-27T14:35:11,686 adding 'evalscope/benchmarks/process_bench/critique_template.txt' 2025-02-27T14:35:11,687 adding 'evalscope/benchmarks/process_bench/process_bench_adapter.py' 2025-02-27T14:35:11,905 adding 'evalscope/benchmarks/race/__init__.py' 2025-02-27T14:35:11,906 adding 'evalscope/benchmarks/race/race.py' 2025-02-27T14:35:11,908 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-02-27T14:35:11,909 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-02-27T14:35:11,912 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-02-27T14:35:11,913 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-02-27T14:35:11,915 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-02-27T14:35:11,917 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-02-27T14:35:11,918 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-02-27T14:35:11,920 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-02-27T14:35:11,922 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-02-27T14:35:11,925 adding 'evalscope/cli/__init__.py' 2025-02-27T14:35:11,926 adding 'evalscope/cli/base.py' 2025-02-27T14:35:11,928 adding 'evalscope/cli/cli.py' 2025-02-27T14:35:11,929 adding 'evalscope/cli/start_app.py' 2025-02-27T14:35:11,930 adding 'evalscope/cli/start_eval.py' 2025-02-27T14:35:11,932 adding 'evalscope/cli/start_perf.py' 2025-02-27T14:35:11,933 adding 'evalscope/cli/start_server.py' 2025-02-27T14:35:11,934 adding 'evalscope/collections/__init__.py' 2025-02-27T14:35:11,936 adding 'evalscope/collections/evaluator.py' 2025-02-27T14:35:11,938 adding 'evalscope/collections/sampler.py' 2025-02-27T14:35:11,939 adding 'evalscope/collections/schema.py' 2025-02-27T14:35:11,941 adding 'evalscope/evaluator/__init__.py' 2025-02-27T14:35:11,943 adding 'evalscope/evaluator/evaluator.py' 2025-02-27T14:35:11,945 adding 'evalscope/evaluator/rating_eval.py' 2025-02-27T14:35:11,946 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-02-27T14:35:11,948 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-02-27T14:35:11,950 adding 'evalscope/metrics/__init__.py' 2025-02-27T14:35:11,951 adding 'evalscope/metrics/code_metric.py' 2025-02-27T14:35:11,954 adding 'evalscope/metrics/math_parser.py' 2025-02-27T14:35:11,956 adding 'evalscope/metrics/metrics.py' 2025-02-27T14:35:11,958 adding 'evalscope/metrics/named_metrics.py' 2025-02-27T14:35:11,959 adding 'evalscope/metrics/rouge_metric.py' 2025-02-27T14:35:11,961 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-02-27T14:35:11,963 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-02-27T14:35:12,121 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-02-27T14:35:12,364 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-02-27T14:35:12,374 adding 'evalscope/models/__init__.py' 2025-02-27T14:35:12,375 adding 'evalscope/models/base_adapter.py' 2025-02-27T14:35:12,377 adding 'evalscope/models/chat_adapter.py' 2025-02-27T14:35:12,378 adding 'evalscope/models/choice_adapter.py' 2025-02-27T14:35:12,380 adding 'evalscope/models/custom_adapter.py' 2025-02-27T14:35:12,381 adding 'evalscope/models/local_model.py' 2025-02-27T14:35:12,383 adding 'evalscope/models/model.py' 2025-02-27T14:35:12,384 adding 'evalscope/models/server_adapter.py' 2025-02-27T14:35:12,386 adding 'evalscope/models/custom/__init__.py' 2025-02-27T14:35:12,387 adding 'evalscope/models/custom/custom_model.py' 2025-02-27T14:35:12,389 adding 'evalscope/models/custom/dummy_model.py' 2025-02-27T14:35:12,390 adding 'evalscope/perf/__init__.py' 2025-02-27T14:35:12,392 adding 'evalscope/perf/arguments.py' 2025-02-27T14:35:12,394 adding 'evalscope/perf/benchmark.py' 2025-02-27T14:35:12,396 adding 'evalscope/perf/http_client.py' 2025-02-27T14:35:12,397 adding 'evalscope/perf/main.py' 2025-02-27T14:35:12,398 adding 'evalscope/perf/plugin/__init__.py' 2025-02-27T14:35:12,400 adding 'evalscope/perf/plugin/registry.py' 2025-02-27T14:35:12,402 adding 'evalscope/perf/plugin/api/__init__.py' 2025-02-27T14:35:12,403 adding 'evalscope/perf/plugin/api/base.py' 2025-02-27T14:35:12,404 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-02-27T14:35:12,406 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-02-27T14:35:12,407 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-02-27T14:35:12,409 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-02-27T14:35:12,410 adding 'evalscope/perf/plugin/datasets/base.py' 2025-02-27T14:35:12,412 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-02-27T14:35:12,413 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-02-27T14:35:12,415 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-02-27T14:35:12,416 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-02-27T14:35:12,418 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-02-27T14:35:12,420 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-02-27T14:35:12,422 adding 'evalscope/perf/utils/__init__.py' 2025-02-27T14:35:12,423 adding 'evalscope/perf/utils/analysis_result.py' 2025-02-27T14:35:12,425 adding 'evalscope/perf/utils/benchmark_util.py' 2025-02-27T14:35:12,427 adding 'evalscope/perf/utils/db_util.py' 2025-02-27T14:35:12,429 adding 'evalscope/perf/utils/handler.py' 2025-02-27T14:35:12,430 adding 'evalscope/perf/utils/local_server.py' 2025-02-27T14:35:12,432 adding 'evalscope/registry/__init__.py' 2025-02-27T14:35:12,434 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-02-27T14:35:12,436 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-02-27T14:35:12,438 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-02-27T14:35:12,439 adding 'evalscope/registry/config/cfg_single.yaml' 2025-02-27T14:35:12,442 adding 'evalscope/registry/data/question.jsonl' 2025-02-27T14:35:12,444 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-02-27T14:35:12,446 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-02-27T14:35:12,609 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-02-27T14:35:12,618 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-02-27T14:35:12,620 adding 'evalscope/registry/tasks/arc.yaml' 2025-02-27T14:35:12,621 adding 'evalscope/registry/tasks/bbh.yaml' 2025-02-27T14:35:12,623 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-02-27T14:35:12,624 adding 'evalscope/registry/tasks/ceval.yaml' 2025-02-27T14:35:12,626 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-02-27T14:35:12,627 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-02-27T14:35:12,629 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-02-27T14:35:12,630 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-02-27T14:35:12,632 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-02-27T14:35:12,633 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-02-27T14:35:12,635 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-02-27T14:35:12,636 adding 'evalscope/report/__init__.py' 2025-02-27T14:35:12,640 adding 'evalscope/report/app.py' 2025-02-27T14:35:12,641 adding 'evalscope/report/combinator.py' 2025-02-27T14:35:12,643 adding 'evalscope/report/generator.py' 2025-02-27T14:35:12,644 adding 'evalscope/report/utils.py' 2025-02-27T14:35:12,646 adding 'evalscope/third_party/__init__.py' 2025-02-27T14:35:12,648 adding 'evalscope/third_party/longbench_write/README.md' 2025-02-27T14:35:12,649 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-02-27T14:35:12,651 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-02-27T14:35:12,652 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-02-27T14:35:12,654 adding 'evalscope/third_party/longbench_write/eval.py' 2025-02-27T14:35:12,655 adding 'evalscope/third_party/longbench_write/infer.py' 2025-02-27T14:35:12,657 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-02-27T14:35:12,659 adding 'evalscope/third_party/longbench_write/utils.py' 2025-02-27T14:35:12,660 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-02-27T14:35:12,662 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-02-27T14:35:12,669 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-02-27T14:35:12,673 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-02-27T14:35:12,674 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-02-27T14:35:12,676 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-02-27T14:35:12,678 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-02-27T14:35:12,679 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-02-27T14:35:12,681 adding 'evalscope/third_party/thinkbench/__init__.py' 2025-02-27T14:35:12,683 adding 'evalscope/third_party/thinkbench/eval.py' 2025-02-27T14:35:12,684 adding 'evalscope/third_party/thinkbench/infer.py' 2025-02-27T14:35:12,686 adding 'evalscope/third_party/thinkbench/resources/critique_template.txt' 2025-02-27T14:35:12,687 adding 'evalscope/third_party/thinkbench/resources/reformat_template.txt' 2025-02-27T14:35:12,689 adding 'evalscope/third_party/thinkbench/tools/__init__.py' 2025-02-27T14:35:12,690 adding 'evalscope/third_party/thinkbench/tools/llm.py' 2025-02-27T14:35:12,692 adding 'evalscope/third_party/thinkbench/tools/utils.py' 2025-02-27T14:35:12,694 adding 'evalscope/third_party/toolbench_static/README.md' 2025-02-27T14:35:12,695 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-02-27T14:35:12,696 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-02-27T14:35:12,697 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-02-27T14:35:12,699 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-02-27T14:35:12,701 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-02-27T14:35:12,702 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-02-27T14:35:12,703 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-02-27T14:35:12,706 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-02-27T14:35:12,707 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-02-27T14:35:12,708 adding 'evalscope/utils/__init__.py' 2025-02-27T14:35:12,710 adding 'evalscope/utils/arena_utils.py' 2025-02-27T14:35:12,711 adding 'evalscope/utils/chat_service.py' 2025-02-27T14:35:12,713 adding 'evalscope/utils/completion_parsers.py' 2025-02-27T14:35:12,714 adding 'evalscope/utils/io_utils.py' 2025-02-27T14:35:12,716 adding 'evalscope/utils/logger.py' 2025-02-27T14:35:12,718 adding 'evalscope/utils/model_utils.py' 2025-02-27T14:35:12,719 adding 'evalscope/utils/utils.py' 2025-02-27T14:35:12,722 adding 'tests/__init__.py' 2025-02-27T14:35:12,724 adding 'tests/test_run_all.py' 2025-02-27T14:35:12,725 adding 'tests/cli/__init__.py' 2025-02-27T14:35:12,727 adding 'tests/cli/test_collection.py' 2025-02-27T14:35:12,729 adding 'tests/cli/test_run.py' 2025-02-27T14:35:12,731 adding 'tests/perf/__init__.py' 2025-02-27T14:35:12,732 adding 'tests/perf/test_perf.py' 2025-02-27T14:35:12,734 adding 'tests/rag/__init__.py' 2025-02-27T14:35:12,735 adding 'tests/rag/test_clip_benchmark.py' 2025-02-27T14:35:12,737 adding 'tests/rag/test_mteb.py' 2025-02-27T14:35:12,738 adding 'tests/rag/test_ragas.py' 2025-02-27T14:35:12,740 adding 'tests/swift/__init__.py' 2025-02-27T14:35:12,741 adding 'tests/swift/test_run_swift_eval.py' 2025-02-27T14:35:12,746 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-02-27T14:35:12,747 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-02-27T14:35:12,749 adding 'tests/vlm/__init__.py' 2025-02-27T14:35:12,751 adding 'tests/vlm/test_vlmeval.py' 2025-02-27T14:35:12,753 adding 'evalscope-0.12.0.dist-info/LICENSE' 2025-02-27T14:35:12,757 adding 'evalscope-0.12.0.dist-info/METADATA' 2025-02-27T14:35:12,759 adding 'evalscope-0.12.0.dist-info/WHEEL' 2025-02-27T14:35:12,760 adding 'evalscope-0.12.0.dist-info/entry_points.txt' 2025-02-27T14:35:12,762 adding 'evalscope-0.12.0.dist-info/top_level.txt' 2025-02-27T14:35:12,767 adding 'evalscope-0.12.0.dist-info/RECORD' 2025-02-27T14:35:12,800 removing build/bdist.linux-armv7l/wheel 2025-02-27T14:35:13,037 Building wheel for evalscope (setup.py): finished with status 'done' 2025-02-27T14:35:13,054 Created wheel for evalscope: filename=evalscope-0.12.0-py3-none-any.whl size=1453232 sha256=f26c7317a5bacac8527806723d45bac74563a2608ed761d822ace03be3a5e45f 2025-02-27T14:35:13,055 Stored in directory: /tmp/pip-ephem-wheel-cache-1fok5o2s/wheels/5e/fc/18/021f48542f0497d816b2c5e0acd84840d954c633314cd0db9e 2025-02-27T14:35:13,096 Successfully built evalscope 2025-02-27T14:35:13,157 Removed build tracker: '/tmp/pip-build-tracker-t0nw88ih'