2025-03-10T13:35:59,276 Created temporary directory: /tmp/pip-build-tracker-fzl8vsqs 2025-03-10T13:35:59,277 Initialized build tracking at /tmp/pip-build-tracker-fzl8vsqs 2025-03-10T13:35:59,277 Created build tracker: /tmp/pip-build-tracker-fzl8vsqs 2025-03-10T13:35:59,278 Entered build tracker: /tmp/pip-build-tracker-fzl8vsqs 2025-03-10T13:35:59,278 Created temporary directory: /tmp/pip-wheel-9wc7lblx 2025-03-10T13:35:59,282 Created temporary directory: /tmp/pip-ephem-wheel-cache-1scw3w3r 2025-03-10T13:35:59,330 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-03-10T13:35:59,333 2 location(s) to search for versions of evalscope: 2025-03-10T13:35:59,333 * https://pypi.org/simple/evalscope/ 2025-03-10T13:35:59,333 * https://www.piwheels.org/simple/evalscope/ 2025-03-10T13:35:59,334 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-03-10T13:35:59,334 Getting page https://pypi.org/simple/evalscope/ 2025-03-10T13:35:59,336 Found index url https://pypi.org/simple/ 2025-03-10T13:35:59,559 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-03-10T13:35:59,568 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,570 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-03-10T13:35:59,570 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,571 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-03-10T13:35:59,572 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,573 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-03-10T13:35:59,574 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,575 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-03-10T13:35:59,576 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,577 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-03-10T13:35:59,578 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,579 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,581 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-03-10T13:35:59,582 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,582 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-03-10T13:35:59,583 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,584 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-03-10T13:35:59,584 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,585 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-03-10T13:35:59,586 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,587 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-03-10T13:35:59,587 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,588 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-03-10T13:35:59,589 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,590 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-03-10T13:35:59,590 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,591 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-03-10T13:35:59,592 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,593 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-03-10T13:35:59,594 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,594 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-03-10T13:35:59,595 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,596 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-03-10T13:35:59,596 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,597 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-03-10T13:35:59,598 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,599 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-03-10T13:35:59,599 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,600 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-03-10T13:35:59,601 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d6/e5/852326943d86c85b5ca6b548a5f3753c217b771d93968c61ec2ca46ee0b1/evalscope-0.11.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,602 Found link https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.11.0 2025-03-10T13:35:59,603 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7d/8e/f9eceecf8bc7d740603f915eef7fab3e9d657a01f5de2c523e531445299c/evalscope-0.12.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,603 Found link https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.0 2025-03-10T13:35:59,604 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ee/4c/84a5e18985e149eb4283fef2b58a81ff2cec2d099c017684938ec3a3935f/evalscope-0.12.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,605 Found link https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.1 2025-03-10T13:35:59,606 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-03-10T13:35:59,607 Getting page https://www.piwheels.org/simple/evalscope/ 2025-03-10T13:35:59,608 Found index url https://www.piwheels.org/simple/ 2025-03-10T13:35:59,811 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-03-10T13:35:59,815 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.12.0-py3-none-any.whl#sha256=f26c7317a5bacac8527806723d45bac74563a2608ed761d822ace03be3a5e45f (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,816 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.11.0-py3-none-any.whl#sha256=6e7d3242c5bf97b54d24644a1300575fdf41c1d90eef7c1344c20bf0d1518671 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,817 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.1-py3-none-any.whl#sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,817 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,818 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,819 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,819 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,820 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,820 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,821 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,822 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-10T13:35:59,823 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-03-10T13:35:59,823 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-03-10T13:35:59,844 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-03-10T13:35:59,846 Collecting evalscope==0.12.1 2025-03-10T13:35:59,848 Created temporary directory: /tmp/pip-unpack-on_b56ef 2025-03-10T13:36:00,067 Downloading evalscope-0.12.1.tar.gz (1.3 MB) 2025-03-10T13:36:01,064 Added evalscope==0.12.1 from https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz to build tracker '/tmp/pip-build-tracker-fzl8vsqs' 2025-03-10T13:36:01,066 Running setup.py (path:/tmp/pip-wheel-9wc7lblx/evalscope_4634e6366c244796a46f48764ed7160f/setup.py) egg_info for package evalscope 2025-03-10T13:36:01,067 Created temporary directory: /tmp/pip-pip-egg-info-5iktqu0_ 2025-03-10T13:36:01,067 Preparing metadata (setup.py): started 2025-03-10T13:36:01,068 Running command python setup.py egg_info 2025-03-10T13:36:01,700 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-10T13:36:01,700 !! 2025-03-10T13:36:01,701 ******************************************************************************** 2025-03-10T13:36:01,702 Usage of dash-separated 'index-url' will not be supported in future 2025-03-10T13:36:01,702 versions. Please use the underscore name 'index_url' instead. 2025-03-10T13:36:01,703 This deprecation is overdue, please update your project and remove deprecated 2025-03-10T13:36:01,704 calls to avoid build errors in the future. 2025-03-10T13:36:01,706 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-10T13:36:01,706 ******************************************************************************** 2025-03-10T13:36:01,707 !! 2025-03-10T13:36:01,708 opt = self.warn_dash_deprecation(opt, section) 2025-03-10T13:36:02,311 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-10T13:36:02,312 !! 2025-03-10T13:36:02,313 ******************************************************************************** 2025-03-10T13:36:02,314 Usage of dash-separated 'index-url' will not be supported in future 2025-03-10T13:36:02,315 versions. Please use the underscore name 'index_url' instead. 2025-03-10T13:36:02,316 This deprecation is overdue, please update your project and remove deprecated 2025-03-10T13:36:02,316 calls to avoid build errors in the future. 2025-03-10T13:36:02,317 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-10T13:36:02,318 ******************************************************************************** 2025-03-10T13:36:02,319 !! 2025-03-10T13:36:02,320 opt = self.warn_dash_deprecation(opt, section) 2025-03-10T13:36:02,348 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-03-10T13:36:02,348 running egg_info 2025-03-10T13:36:02,375 creating /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info 2025-03-10T13:36:02,376 writing /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/PKG-INFO 2025-03-10T13:36:02,408 writing dependency_links to /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/dependency_links.txt 2025-03-10T13:36:02,410 writing entry points to /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/entry_points.txt 2025-03-10T13:36:02,425 writing requirements to /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/requires.txt 2025-03-10T13:36:02,426 writing top-level names to /tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/top_level.txt 2025-03-10T13:36:02,428 writing manifest file '/tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/SOURCES.txt' 2025-03-10T13:36:02,591 reading manifest file '/tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/SOURCES.txt' 2025-03-10T13:36:02,593 reading manifest template 'MANIFEST.in' 2025-03-10T13:36:02,722 adding license file 'LICENSE' 2025-03-10T13:36:02,738 writing manifest file '/tmp/pip-pip-egg-info-5iktqu0_/evalscope.egg-info/SOURCES.txt' 2025-03-10T13:36:02,850 Preparing metadata (setup.py): finished with status 'done' 2025-03-10T13:36:02,857 Source in /tmp/pip-wheel-9wc7lblx/evalscope_4634e6366c244796a46f48764ed7160f has version 0.12.1, which satisfies requirement evalscope==0.12.1 from https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz 2025-03-10T13:36:02,858 Removed evalscope==0.12.1 from https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz from build tracker '/tmp/pip-build-tracker-fzl8vsqs' 2025-03-10T13:36:02,922 Created temporary directory: /tmp/pip-unpack-1kcnz0js 2025-03-10T13:36:02,923 Created temporary directory: /tmp/pip-unpack-h4ky4_iw 2025-03-10T13:36:02,923 Building wheels for collected packages: evalscope 2025-03-10T13:36:02,928 Created temporary directory: /tmp/pip-wheel-4c_awxpa 2025-03-10T13:36:02,928 Building wheel for evalscope (setup.py): started 2025-03-10T13:36:02,929 Destination directory: /tmp/pip-wheel-4c_awxpa 2025-03-10T13:36:02,930 Running command python setup.py bdist_wheel 2025-03-10T13:36:03,393 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-03-10T13:36:03,498 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-10T13:36:03,499 !! 2025-03-10T13:36:03,500 ******************************************************************************** 2025-03-10T13:36:03,500 Usage of dash-separated 'index-url' will not be supported in future 2025-03-10T13:36:03,501 versions. Please use the underscore name 'index_url' instead. 2025-03-10T13:36:03,502 This deprecation is overdue, please update your project and remove deprecated 2025-03-10T13:36:03,503 calls to avoid build errors in the future. 2025-03-10T13:36:03,504 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-10T13:36:03,505 ******************************************************************************** 2025-03-10T13:36:03,506 !! 2025-03-10T13:36:03,507 opt = self.warn_dash_deprecation(opt, section) 2025-03-10T13:36:04,079 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-10T13:36:04,079 !! 2025-03-10T13:36:04,080 ******************************************************************************** 2025-03-10T13:36:04,081 Usage of dash-separated 'index-url' will not be supported in future 2025-03-10T13:36:04,082 versions. Please use the underscore name 'index_url' instead. 2025-03-10T13:36:04,083 This deprecation is overdue, please update your project and remove deprecated 2025-03-10T13:36:04,083 calls to avoid build errors in the future. 2025-03-10T13:36:04,085 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-10T13:36:04,086 ******************************************************************************** 2025-03-10T13:36:04,087 !! 2025-03-10T13:36:04,087 opt = self.warn_dash_deprecation(opt, section) 2025-03-10T13:36:04,089 running bdist_wheel 2025-03-10T13:36:04,221 running build 2025-03-10T13:36:04,222 running build_py 2025-03-10T13:36:04,252 creating build/lib/tests 2025-03-10T13:36:04,254 copying tests/test_run_all.py -> build/lib/tests 2025-03-10T13:36:04,256 copying tests/__init__.py -> build/lib/tests 2025-03-10T13:36:04,259 creating build/lib/evalscope 2025-03-10T13:36:04,260 copying evalscope/config.py -> build/lib/evalscope 2025-03-10T13:36:04,262 copying evalscope/run_arena.py -> build/lib/evalscope 2025-03-10T13:36:04,265 copying evalscope/summarizer.py -> build/lib/evalscope 2025-03-10T13:36:04,267 copying evalscope/version.py -> build/lib/evalscope 2025-03-10T13:36:04,268 copying evalscope/run.py -> build/lib/evalscope 2025-03-10T13:36:04,271 copying evalscope/arguments.py -> build/lib/evalscope 2025-03-10T13:36:04,273 copying evalscope/__init__.py -> build/lib/evalscope 2025-03-10T13:36:04,275 copying evalscope/constants.py -> build/lib/evalscope 2025-03-10T13:36:04,277 creating build/lib/tests/swift 2025-03-10T13:36:04,278 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-03-10T13:36:04,280 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-03-10T13:36:04,283 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-03-10T13:36:04,285 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-03-10T13:36:04,287 creating build/lib/tests/cli 2025-03-10T13:36:04,288 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-03-10T13:36:04,290 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-03-10T13:36:04,293 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-03-10T13:36:04,295 creating build/lib/tests/vlm 2025-03-10T13:36:04,296 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-03-10T13:36:04,298 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-03-10T13:36:04,300 creating build/lib/tests/perf 2025-03-10T13:36:04,302 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-03-10T13:36:04,303 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-03-10T13:36:04,306 creating build/lib/tests/rag 2025-03-10T13:36:04,307 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-03-10T13:36:04,309 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-03-10T13:36:04,311 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-03-10T13:36:04,313 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-03-10T13:36:04,316 creating build/lib/evalscope/benchmarks 2025-03-10T13:36:04,317 copying evalscope/benchmarks/utils.py -> build/lib/evalscope/benchmarks 2025-03-10T13:36:04,319 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-03-10T13:36:04,322 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-03-10T13:36:04,324 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-03-10T13:36:04,327 creating build/lib/evalscope/report 2025-03-10T13:36:04,329 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-03-10T13:36:04,331 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-03-10T13:36:04,334 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-03-10T13:36:04,336 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-03-10T13:36:04,339 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-03-10T13:36:04,342 creating build/lib/evalscope/evaluator 2025-03-10T13:36:04,343 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-03-10T13:36:04,346 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-03-10T13:36:04,350 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-03-10T13:36:04,352 creating build/lib/evalscope/cli 2025-03-10T13:36:04,354 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,356 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,357 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,359 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,361 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,363 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,365 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-03-10T13:36:04,367 creating build/lib/evalscope/utils 2025-03-10T13:36:04,368 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,371 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,373 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,375 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,376 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,379 copying evalscope/utils/filters.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,380 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,382 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,384 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-03-10T13:36:04,387 creating build/lib/evalscope/collections 2025-03-10T13:36:04,388 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-03-10T13:36:04,390 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-03-10T13:36:04,392 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-03-10T13:36:04,394 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-03-10T13:36:04,396 creating build/lib/evalscope/backend 2025-03-10T13:36:04,397 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-03-10T13:36:04,399 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-03-10T13:36:04,401 creating build/lib/evalscope/perf 2025-03-10T13:36:04,403 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-03-10T13:36:04,405 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-03-10T13:36:04,407 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-03-10T13:36:04,410 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-03-10T13:36:04,411 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-03-10T13:36:04,414 creating build/lib/evalscope/third_party 2025-03-10T13:36:04,415 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-03-10T13:36:04,417 creating build/lib/evalscope/models 2025-03-10T13:36:04,418 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-03-10T13:36:04,420 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-03-10T13:36:04,422 copying evalscope/models/register.py -> build/lib/evalscope/models 2025-03-10T13:36:04,425 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-03-10T13:36:04,426 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-03-10T13:36:04,428 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-03-10T13:36:04,431 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-03-10T13:36:04,433 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-03-10T13:36:04,435 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-03-10T13:36:04,438 creating build/lib/evalscope/registry 2025-03-10T13:36:04,439 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-03-10T13:36:04,442 creating build/lib/evalscope/metrics 2025-03-10T13:36:04,443 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,445 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,447 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,450 copying evalscope/metrics/math_parser.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,452 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,455 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-03-10T13:36:04,457 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:04,458 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:04,460 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:04,462 creating build/lib/evalscope/benchmarks/gsm8k 2025-03-10T13:36:04,463 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-10T13:36:04,466 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-10T13:36:04,467 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-10T13:36:04,470 creating build/lib/evalscope/benchmarks/arc 2025-03-10T13:36:04,471 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-03-10T13:36:04,473 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-03-10T13:36:04,475 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-03-10T13:36:04,478 creating build/lib/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:04,479 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:04,481 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:04,483 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:04,486 creating build/lib/evalscope/benchmarks/gpqa 2025-03-10T13:36:04,487 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-03-10T13:36:04,489 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-03-10T13:36:04,491 creating build/lib/evalscope/benchmarks/general_qa 2025-03-10T13:36:04,493 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-03-10T13:36:04,496 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-03-10T13:36:04,498 creating build/lib/evalscope/benchmarks/hellaswag 2025-03-10T13:36:04,499 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-10T13:36:04,502 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-10T13:36:04,504 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-10T13:36:04,506 creating build/lib/evalscope/benchmarks/race 2025-03-10T13:36:04,508 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-03-10T13:36:04,510 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-03-10T13:36:04,512 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-03-10T13:36:04,514 creating build/lib/evalscope/benchmarks/simple_qa 2025-03-10T13:36:04,515 copying evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/lib/evalscope/benchmarks/simple_qa 2025-03-10T13:36:04,517 copying evalscope/benchmarks/simple_qa/__init__.py -> build/lib/evalscope/benchmarks/simple_qa 2025-03-10T13:36:04,519 creating build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:04,521 copying evalscope/benchmarks/super_gpqa/utils.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:04,523 copying evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:04,525 copying evalscope/benchmarks/super_gpqa/__init__.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:04,527 creating build/lib/evalscope/benchmarks/bbh 2025-03-10T13:36:04,528 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-03-10T13:36:04,531 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-03-10T13:36:04,533 creating build/lib/evalscope/benchmarks/musr 2025-03-10T13:36:04,535 copying evalscope/benchmarks/musr/musr_adapter.py -> build/lib/evalscope/benchmarks/musr 2025-03-10T13:36:04,536 copying evalscope/benchmarks/musr/__init__.py -> build/lib/evalscope/benchmarks/musr 2025-03-10T13:36:04,538 creating build/lib/evalscope/benchmarks/math_500 2025-03-10T13:36:04,539 copying evalscope/benchmarks/math_500/math_500_adapter.py -> build/lib/evalscope/benchmarks/math_500 2025-03-10T13:36:04,542 copying evalscope/benchmarks/math_500/__init__.py -> build/lib/evalscope/benchmarks/math_500 2025-03-10T13:36:04,543 creating build/lib/evalscope/benchmarks/competition_math 2025-03-10T13:36:04,544 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-10T13:36:04,546 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-10T13:36:04,548 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-10T13:36:04,551 creating build/lib/evalscope/benchmarks/truthful_qa 2025-03-10T13:36:04,552 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-10T13:36:04,555 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-10T13:36:04,557 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-10T13:36:04,559 creating build/lib/evalscope/benchmarks/cmmlu 2025-03-10T13:36:04,560 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-10T13:36:04,563 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-10T13:36:04,565 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-10T13:36:04,568 creating build/lib/evalscope/benchmarks/process_bench 2025-03-10T13:36:04,569 copying evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/lib/evalscope/benchmarks/process_bench 2025-03-10T13:36:04,571 copying evalscope/benchmarks/process_bench/__init__.py -> build/lib/evalscope/benchmarks/process_bench 2025-03-10T13:36:04,573 creating build/lib/evalscope/benchmarks/data_collection 2025-03-10T13:36:04,575 copying evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/lib/evalscope/benchmarks/data_collection 2025-03-10T13:36:04,577 copying evalscope/benchmarks/data_collection/__init__.py -> build/lib/evalscope/benchmarks/data_collection 2025-03-10T13:36:04,580 creating build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,581 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,583 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,585 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,588 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,590 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,593 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-10T13:36:04,595 creating build/lib/evalscope/benchmarks/mmlu 2025-03-10T13:36:04,596 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-10T13:36:04,599 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-10T13:36:04,601 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-10T13:36:04,604 creating build/lib/evalscope/benchmarks/iquiz 2025-03-10T13:36:04,605 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-03-10T13:36:04,607 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-03-10T13:36:04,609 creating build/lib/evalscope/benchmarks/aime 2025-03-10T13:36:04,610 copying evalscope/benchmarks/aime/__init__.py -> build/lib/evalscope/benchmarks/aime 2025-03-10T13:36:04,612 copying evalscope/benchmarks/aime/aime25_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-03-10T13:36:04,614 copying evalscope/benchmarks/aime/aime24_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-03-10T13:36:04,616 creating build/lib/evalscope/benchmarks/ceval 2025-03-10T13:36:04,617 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-03-10T13:36:04,619 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-03-10T13:36:04,622 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-03-10T13:36:04,624 creating build/lib/evalscope/benchmarks/humaneval 2025-03-10T13:36:04,626 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-10T13:36:04,628 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-10T13:36:04,630 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-10T13:36:04,633 creating build/lib/evalscope/benchmarks/general_mcq 2025-03-10T13:36:04,634 copying evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/lib/evalscope/benchmarks/general_mcq 2025-03-10T13:36:04,636 copying evalscope/benchmarks/general_mcq/__init__.py -> build/lib/evalscope/benchmarks/general_mcq 2025-03-10T13:36:04,639 creating build/lib/evalscope/evaluator/reviewer 2025-03-10T13:36:04,640 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-03-10T13:36:04,643 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-03-10T13:36:04,645 creating build/lib/evalscope/backend/opencompass 2025-03-10T13:36:04,646 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-03-10T13:36:04,648 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-03-10T13:36:04,651 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-03-10T13:36:04,653 creating build/lib/evalscope/backend/rag_eval 2025-03-10T13:36:04,654 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-03-10T13:36:04,656 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-03-10T13:36:04,659 creating build/lib/evalscope/backend/vlm_eval_kit 2025-03-10T13:36:04,660 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-10T13:36:04,662 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-10T13:36:04,664 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-10T13:36:04,666 creating build/lib/evalscope/backend/opencompass/tasks 2025-03-10T13:36:04,668 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-10T13:36:04,670 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-10T13:36:04,672 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-10T13:36:04,674 creating build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,676 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,678 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,679 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,681 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,683 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-10T13:36:04,686 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:04,687 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:04,689 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:04,691 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:04,693 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:04,695 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:04,696 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:04,698 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:04,700 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:04,702 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:04,705 creating build/lib/evalscope/backend/rag_eval/ragas 2025-03-10T13:36:04,706 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-10T13:36:04,708 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-10T13:36:04,710 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-10T13:36:04,712 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:04,714 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:04,716 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:04,718 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:04,720 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:04,722 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,724 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,726 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,729 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,731 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,733 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,735 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,738 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,740 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:04,743 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,744 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,746 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,748 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,751 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,752 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:04,755 creating build/lib/evalscope/perf/utils 2025-03-10T13:36:04,756 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,758 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,760 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,762 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,764 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,766 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-03-10T13:36:04,768 creating build/lib/evalscope/perf/plugin 2025-03-10T13:36:04,769 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-03-10T13:36:04,771 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-03-10T13:36:04,773 creating build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,775 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,777 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,779 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,781 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,783 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-03-10T13:36:04,785 creating build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,786 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,788 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,790 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,792 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,794 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,796 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,798 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,800 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-10T13:36:04,802 creating build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,803 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,806 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,808 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,810 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,812 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:04,814 creating build/lib/evalscope/third_party/thinkbench 2025-03-10T13:36:04,815 copying evalscope/third_party/thinkbench/infer.py -> build/lib/evalscope/third_party/thinkbench 2025-03-10T13:36:04,817 copying evalscope/third_party/thinkbench/eval.py -> build/lib/evalscope/third_party/thinkbench 2025-03-10T13:36:04,819 copying evalscope/third_party/thinkbench/__init__.py -> build/lib/evalscope/third_party/thinkbench 2025-03-10T13:36:04,822 creating build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:04,823 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:04,825 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:04,827 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:04,829 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:04,831 creating build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:04,832 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:04,835 creating build/lib/evalscope/third_party/longbench_write/tools 2025-03-10T13:36:04,836 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-10T13:36:04,839 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-10T13:36:04,841 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-10T13:36:04,843 creating build/lib/evalscope/third_party/thinkbench/tools 2025-03-10T13:36:04,844 copying evalscope/third_party/thinkbench/tools/utils.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-10T13:36:04,846 copying evalscope/third_party/thinkbench/tools/llm.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-10T13:36:04,848 copying evalscope/third_party/thinkbench/tools/__init__.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-10T13:36:04,850 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:04,851 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:04,853 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:04,856 creating build/lib/evalscope/models/custom 2025-03-10T13:36:04,857 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-03-10T13:36:04,859 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-03-10T13:36:04,861 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-03-10T13:36:04,863 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:04,864 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:04,867 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:04,869 running egg_info 2025-03-10T13:36:04,898 writing evalscope.egg-info/PKG-INFO 2025-03-10T13:36:04,931 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-03-10T13:36:04,933 writing entry points to evalscope.egg-info/entry_points.txt 2025-03-10T13:36:04,955 writing requirements to evalscope.egg-info/requires.txt 2025-03-10T13:36:04,957 writing top-level names to evalscope.egg-info/top_level.txt 2025-03-10T13:36:05,069 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-03-10T13:36:05,090 reading manifest template 'MANIFEST.in' 2025-03-10T13:36:05,234 adding license file 'LICENSE' 2025-03-10T13:36:05,255 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-03-10T13:36:05,258 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-03-10T13:36:05,258 !! 2025-03-10T13:36:05,259 ******************************************************************************** 2025-03-10T13:36:05,260 ############################ 2025-03-10T13:36:05,260 # Package would be ignored # 2025-03-10T13:36:05,260 ############################ 2025-03-10T13:36:05,261 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-03-10T13:36:05,261 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,262 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,263 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-03-10T13:36:05,263 to the `packages` configuration field. 2025-03-10T13:36:05,264 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,265 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,265 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,267 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,268 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,269 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-03-10T13:36:05,269 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-03-10T13:36:05,270 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,270 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,271 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,272 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,273 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,275 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,276 even if it does not contain any `.py` files. 2025-03-10T13:36:05,276 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,277 directory, all directories are treated like packages. 2025-03-10T13:36:05,277 ******************************************************************************** 2025-03-10T13:36:05,278 !! 2025-03-10T13:36:05,279 check.warn(importable) 2025-03-10T13:36:05,280 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-03-10T13:36:05,280 !! 2025-03-10T13:36:05,281 ******************************************************************************** 2025-03-10T13:36:05,282 ############################ 2025-03-10T13:36:05,282 # Package would be ignored # 2025-03-10T13:36:05,283 ############################ 2025-03-10T13:36:05,284 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-03-10T13:36:05,284 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,285 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,286 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-03-10T13:36:05,286 to the `packages` configuration field. 2025-03-10T13:36:05,287 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,287 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,288 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,289 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,290 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,291 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-03-10T13:36:05,291 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-03-10T13:36:05,291 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,292 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,292 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,293 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,294 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,296 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,296 even if it does not contain any `.py` files. 2025-03-10T13:36:05,297 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,297 directory, all directories are treated like packages. 2025-03-10T13:36:05,298 ******************************************************************************** 2025-03-10T13:36:05,299 !! 2025-03-10T13:36:05,300 check.warn(importable) 2025-03-10T13:36:05,300 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-03-10T13:36:05,301 !! 2025-03-10T13:36:05,302 ******************************************************************************** 2025-03-10T13:36:05,302 ############################ 2025-03-10T13:36:05,303 # Package would be ignored # 2025-03-10T13:36:05,303 ############################ 2025-03-10T13:36:05,304 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-03-10T13:36:05,304 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,306 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,306 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-03-10T13:36:05,307 to the `packages` configuration field. 2025-03-10T13:36:05,308 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,308 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,309 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,310 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,311 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,313 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-03-10T13:36:05,314 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-03-10T13:36:05,314 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,315 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,316 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,316 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,317 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,319 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,319 even if it does not contain any `.py` files. 2025-03-10T13:36:05,319 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,320 directory, all directories are treated like packages. 2025-03-10T13:36:05,320 ******************************************************************************** 2025-03-10T13:36:05,321 !! 2025-03-10T13:36:05,322 check.warn(importable) 2025-03-10T13:36:05,322 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-03-10T13:36:05,322 !! 2025-03-10T13:36:05,323 ******************************************************************************** 2025-03-10T13:36:05,324 ############################ 2025-03-10T13:36:05,324 # Package would be ignored # 2025-03-10T13:36:05,324 ############################ 2025-03-10T13:36:05,325 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-03-10T13:36:05,325 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,326 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,327 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-03-10T13:36:05,327 to the `packages` configuration field. 2025-03-10T13:36:05,328 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,329 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,329 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,330 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,331 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,332 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-03-10T13:36:05,333 already explicitly excluding 'evalscope.metrics.resources' via 2025-03-10T13:36:05,333 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,334 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,334 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,335 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,336 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,338 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,338 even if it does not contain any `.py` files. 2025-03-10T13:36:05,339 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,339 directory, all directories are treated like packages. 2025-03-10T13:36:05,340 ******************************************************************************** 2025-03-10T13:36:05,340 !! 2025-03-10T13:36:05,341 check.warn(importable) 2025-03-10T13:36:05,342 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-03-10T13:36:05,342 !! 2025-03-10T13:36:05,343 ******************************************************************************** 2025-03-10T13:36:05,343 ############################ 2025-03-10T13:36:05,344 # Package would be ignored # 2025-03-10T13:36:05,344 ############################ 2025-03-10T13:36:05,345 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-03-10T13:36:05,345 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,346 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,346 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-03-10T13:36:05,347 to the `packages` configuration field. 2025-03-10T13:36:05,347 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,348 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,348 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,349 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,350 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,351 If you don't want 'evalscope.registry.config' to be distributed and are 2025-03-10T13:36:05,351 already explicitly excluding 'evalscope.registry.config' via 2025-03-10T13:36:05,352 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,352 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,353 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,354 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,355 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,356 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,356 even if it does not contain any `.py` files. 2025-03-10T13:36:05,357 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,357 directory, all directories are treated like packages. 2025-03-10T13:36:05,358 ******************************************************************************** 2025-03-10T13:36:05,359 !! 2025-03-10T13:36:05,359 check.warn(importable) 2025-03-10T13:36:05,360 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-03-10T13:36:05,360 !! 2025-03-10T13:36:05,361 ******************************************************************************** 2025-03-10T13:36:05,362 ############################ 2025-03-10T13:36:05,362 # Package would be ignored # 2025-03-10T13:36:05,363 ############################ 2025-03-10T13:36:05,363 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-03-10T13:36:05,364 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,365 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,365 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-03-10T13:36:05,366 to the `packages` configuration field. 2025-03-10T13:36:05,367 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,368 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,368 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,369 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,370 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,371 If you don't want 'evalscope.registry.data' to be distributed and are 2025-03-10T13:36:05,371 already explicitly excluding 'evalscope.registry.data' via 2025-03-10T13:36:05,372 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,372 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,372 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,373 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,374 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,375 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,376 even if it does not contain any `.py` files. 2025-03-10T13:36:05,376 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,377 directory, all directories are treated like packages. 2025-03-10T13:36:05,377 ******************************************************************************** 2025-03-10T13:36:05,378 !! 2025-03-10T13:36:05,379 check.warn(importable) 2025-03-10T13:36:05,379 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-03-10T13:36:05,379 !! 2025-03-10T13:36:05,380 ******************************************************************************** 2025-03-10T13:36:05,381 ############################ 2025-03-10T13:36:05,381 # Package would be ignored # 2025-03-10T13:36:05,382 ############################ 2025-03-10T13:36:05,382 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-03-10T13:36:05,383 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,384 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,384 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-03-10T13:36:05,385 to the `packages` configuration field. 2025-03-10T13:36:05,386 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,386 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,387 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,388 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,389 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,390 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-03-10T13:36:05,390 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-03-10T13:36:05,391 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,391 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,392 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,393 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,394 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,396 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,396 even if it does not contain any `.py` files. 2025-03-10T13:36:05,397 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,397 directory, all directories are treated like packages. 2025-03-10T13:36:05,398 ******************************************************************************** 2025-03-10T13:36:05,399 !! 2025-03-10T13:36:05,399 check.warn(importable) 2025-03-10T13:36:05,399 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-03-10T13:36:05,400 !! 2025-03-10T13:36:05,401 ******************************************************************************** 2025-03-10T13:36:05,402 ############################ 2025-03-10T13:36:05,402 # Package would be ignored # 2025-03-10T13:36:05,402 ############################ 2025-03-10T13:36:05,403 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-03-10T13:36:05,403 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,404 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,405 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-03-10T13:36:05,405 to the `packages` configuration field. 2025-03-10T13:36:05,406 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,407 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,407 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,408 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,409 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,410 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-03-10T13:36:05,410 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-03-10T13:36:05,411 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,411 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,412 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,413 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,414 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,415 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,416 even if it does not contain any `.py` files. 2025-03-10T13:36:05,417 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,417 directory, all directories are treated like packages. 2025-03-10T13:36:05,418 ******************************************************************************** 2025-03-10T13:36:05,419 !! 2025-03-10T13:36:05,419 check.warn(importable) 2025-03-10T13:36:05,420 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-03-10T13:36:05,420 !! 2025-03-10T13:36:05,421 ******************************************************************************** 2025-03-10T13:36:05,422 ############################ 2025-03-10T13:36:05,423 # Package would be ignored # 2025-03-10T13:36:05,423 ############################ 2025-03-10T13:36:05,424 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-03-10T13:36:05,424 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,425 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,426 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-03-10T13:36:05,426 to the `packages` configuration field. 2025-03-10T13:36:05,427 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,428 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,428 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,429 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,431 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,432 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-03-10T13:36:05,432 already explicitly excluding 'evalscope.registry.tasks' via 2025-03-10T13:36:05,433 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,433 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,434 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,435 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,436 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,437 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,437 even if it does not contain any `.py` files. 2025-03-10T13:36:05,438 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,438 directory, all directories are treated like packages. 2025-03-10T13:36:05,439 ******************************************************************************** 2025-03-10T13:36:05,440 !! 2025-03-10T13:36:05,440 check.warn(importable) 2025-03-10T13:36:05,441 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.third_party.thinkbench.resources' is absent from the `packages` configuration. 2025-03-10T13:36:05,441 !! 2025-03-10T13:36:05,442 ******************************************************************************** 2025-03-10T13:36:05,443 ############################ 2025-03-10T13:36:05,443 # Package would be ignored # 2025-03-10T13:36:05,443 ############################ 2025-03-10T13:36:05,444 Python recognizes 'evalscope.third_party.thinkbench.resources' as an importable package[^1], 2025-03-10T13:36:05,445 but it is absent from setuptools' `packages` configuration. 2025-03-10T13:36:05,446 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-10T13:36:05,446 package, please make sure that 'evalscope.third_party.thinkbench.resources' is explicitly added 2025-03-10T13:36:05,447 to the `packages` configuration field. 2025-03-10T13:36:05,448 Alternatively, you can also rely on setuptools' discovery methods 2025-03-10T13:36:05,448 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-10T13:36:05,449 instead of `find_packages(...)`/`find:`). 2025-03-10T13:36:05,450 You can read more about "package discovery" on setuptools documentation page: 2025-03-10T13:36:05,451 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-10T13:36:05,452 If you don't want 'evalscope.third_party.thinkbench.resources' to be distributed and are 2025-03-10T13:36:05,453 already explicitly excluding 'evalscope.third_party.thinkbench.resources' via 2025-03-10T13:36:05,453 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-10T13:36:05,454 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-10T13:36:05,454 combination with a more fine grained `package-data` configuration. 2025-03-10T13:36:05,455 You can read more about "package data files" on setuptools documentation page: 2025-03-10T13:36:05,456 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-10T13:36:05,458 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-10T13:36:05,458 even if it does not contain any `.py` files. 2025-03-10T13:36:05,458 On the other hand, currently there is no concept of package data 2025-03-10T13:36:05,459 directory, all directories are treated like packages. 2025-03-10T13:36:05,459 ******************************************************************************** 2025-03-10T13:36:05,460 !! 2025-03-10T13:36:05,460 check.warn(importable) 2025-03-10T13:36:05,461 creating build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,461 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,462 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,462 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,463 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,463 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,464 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,464 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,465 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,466 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,466 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,467 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-03-10T13:36:05,468 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,470 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,472 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,476 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,480 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,481 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,481 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,482 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,482 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,483 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,483 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,484 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,485 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,485 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,486 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,487 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,487 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,488 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,488 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,488 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,489 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,489 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,490 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,490 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,491 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,491 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,492 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,492 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,492 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:05,493 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:05,494 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:05,494 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:05,495 creating build/lib/evalscope/registry/config 2025-03-10T13:36:05,497 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-03-10T13:36:05,500 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-03-10T13:36:05,502 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-03-10T13:36:05,503 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-03-10T13:36:05,504 creating build/lib/evalscope/registry/data 2025-03-10T13:36:05,505 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-03-10T13:36:05,505 creating build/lib/evalscope/registry/data/prompt_template 2025-03-10T13:36:05,506 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-03-10T13:36:05,511 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-03-10T13:36:05,513 creating build/lib/evalscope/registry/data/qa_browser 2025-03-10T13:36:05,517 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-03-10T13:36:05,522 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-03-10T13:36:05,525 creating build/lib/evalscope/metrics/resources 2025-03-10T13:36:05,526 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-03-10T13:36:05,526 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-03-10T13:36:05,527 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,529 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-03-10T13:36:05,531 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-03-10T13:36:05,534 copying evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,536 copying evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,550 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,553 copying evalscope/benchmarks/process_bench/critique_template.txt -> build/lib/evalscope/benchmarks/process_bench 2025-03-10T13:36:05,555 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-03-10T13:36:05,557 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:05,558 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:05,561 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:05,563 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-03-10T13:36:05,564 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-03-10T13:36:05,567 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:05,569 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:05,571 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-03-10T13:36:05,573 creating build/lib/evalscope/third_party/thinkbench/resources 2025-03-10T13:36:05,574 copying evalscope/third_party/thinkbench/resources/critique_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-03-10T13:36:05,577 copying evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-03-10T13:36:05,579 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:05,581 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:05,583 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:05,586 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-03-10T13:36:05,644 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-10T13:36:05,644 !! 2025-03-10T13:36:05,646 ******************************************************************************** 2025-03-10T13:36:05,646 Please avoid running ``setup.py`` directly. 2025-03-10T13:36:05,647 Instead, use pypa/build, pypa/installer or other 2025-03-10T13:36:05,647 standards-based tools. 2025-03-10T13:36:05,649 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-10T13:36:05,650 ******************************************************************************** 2025-03-10T13:36:05,651 !! 2025-03-10T13:36:05,652 self.initialize_options() 2025-03-10T13:36:05,673 installing to build/bdist.linux-armv7l/wheel 2025-03-10T13:36:05,673 running install 2025-03-10T13:36:05,698 running install_lib 2025-03-10T13:36:05,725 creating build/bdist.linux-armv7l/wheel 2025-03-10T13:36:05,727 creating build/bdist.linux-armv7l/wheel/tests 2025-03-10T13:36:05,729 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-03-10T13:36:05,730 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-10T13:36:05,734 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-10T13:36:05,736 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-10T13:36:05,739 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-10T13:36:05,742 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-03-10T13:36:05,744 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-10T13:36:05,746 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-10T13:36:05,750 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-10T13:36:05,752 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-03-10T13:36:05,754 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-03-10T13:36:05,756 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-03-10T13:36:05,759 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-03-10T13:36:05,761 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-03-10T13:36:05,764 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-03-10T13:36:05,766 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-03-10T13:36:05,769 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-03-10T13:36:05,770 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-10T13:36:05,773 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-10T13:36:05,775 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-10T13:36:05,778 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-10T13:36:05,781 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-03-10T13:36:05,784 creating build/bdist.linux-armv7l/wheel/evalscope 2025-03-10T13:36:05,786 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:05,790 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-03-10T13:36:05,792 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:05,794 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:05,797 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-03-10T13:36:05,799 copying build/lib/evalscope/benchmarks/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-10T13:36:05,802 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-03-10T13:36:05,804 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-10T13:36:05,807 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-10T13:36:05,809 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-10T13:36:05,813 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-03-10T13:36:05,815 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-10T13:36:05,818 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-10T13:36:05,820 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-10T13:36:05,823 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,825 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,828 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,830 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,833 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-10T13:36:05,835 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-03-10T13:36:05,837 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-10T13:36:05,839 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-10T13:36:05,840 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-10T13:36:05,843 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-03-10T13:36:05,844 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-03-10T13:36:05,847 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-03-10T13:36:05,849 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-03-10T13:36:05,850 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-10T13:36:05,853 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-10T13:36:05,855 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-10T13:36:05,858 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-03-10T13:36:05,859 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-10T13:36:05,861 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-10T13:36:05,863 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-10T13:36:05,865 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-10T13:36:05,868 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/simple_qa 2025-03-10T13:36:05,869 copying build/lib/evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-03-10T13:36:05,871 copying build/lib/evalscope/benchmarks/simple_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-03-10T13:36:05,873 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,875 copying build/lib/evalscope/benchmarks/super_gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,877 copying build/lib/evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,879 copying build/lib/evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,881 copying build/lib/evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,883 copying build/lib/evalscope/benchmarks/super_gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-10T13:36:05,886 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-03-10T13:36:05,888 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,889 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,891 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,893 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,895 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,897 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,899 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,901 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,903 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,905 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,907 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,909 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,911 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,913 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,915 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,917 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,919 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,921 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,923 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,926 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,928 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,930 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,932 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,934 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,936 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,938 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,940 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,941 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-10T13:36:05,943 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-03-10T13:36:05,946 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-03-10T13:36:05,948 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/musr 2025-03-10T13:36:05,950 copying build/lib/evalscope/benchmarks/musr/musr_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-03-10T13:36:05,952 copying build/lib/evalscope/benchmarks/musr/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-03-10T13:36:05,954 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/math_500 2025-03-10T13:36:05,955 copying build/lib/evalscope/benchmarks/math_500/math_500_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-03-10T13:36:05,957 copying build/lib/evalscope/benchmarks/math_500/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-03-10T13:36:05,959 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-03-10T13:36:05,960 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-10T13:36:05,963 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-10T13:36:05,965 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-10T13:36:05,967 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-10T13:36:05,969 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-10T13:36:05,972 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-03-10T13:36:05,973 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-10T13:36:05,976 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-10T13:36:05,978 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-10T13:36:05,981 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,982 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,985 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,987 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,989 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-10T13:36:05,992 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/process_bench 2025-03-10T13:36:05,993 copying build/lib/evalscope/benchmarks/process_bench/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-10T13:36:05,995 copying build/lib/evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-10T13:36:05,997 copying build/lib/evalscope/benchmarks/process_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-10T13:36:05,999 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/data_collection 2025-03-10T13:36:06,000 copying build/lib/evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-03-10T13:36:06,002 copying build/lib/evalscope/benchmarks/data_collection/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-03-10T13:36:06,005 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-03-10T13:36:06,006 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,008 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,011 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,015 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,018 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,025 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-10T13:36:06,027 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-03-10T13:36:06,028 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-10T13:36:06,031 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-10T13:36:06,033 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-10T13:36:06,035 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-10T13:36:06,038 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-03-10T13:36:06,039 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-03-10T13:36:06,041 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-03-10T13:36:06,043 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/aime 2025-03-10T13:36:06,045 copying build/lib/evalscope/benchmarks/aime/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-10T13:36:06,047 copying build/lib/evalscope/benchmarks/aime/aime25_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-10T13:36:06,048 copying build/lib/evalscope/benchmarks/aime/aime24_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-10T13:36:06,051 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-03-10T13:36:06,052 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-10T13:36:06,055 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-10T13:36:06,057 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-10T13:36:06,059 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-03-10T13:36:06,060 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-10T13:36:06,063 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-10T13:36:06,064 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-10T13:36:06,067 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-10T13:36:06,069 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_mcq 2025-03-10T13:36:06,071 copying build/lib/evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-03-10T13:36:06,073 copying build/lib/evalscope/benchmarks/general_mcq/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-03-10T13:36:06,075 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-03-10T13:36:06,077 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-10T13:36:06,079 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-10T13:36:06,081 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-10T13:36:06,083 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-10T13:36:06,087 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-10T13:36:06,089 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-03-10T13:36:06,091 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-03-10T13:36:06,092 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-03-10T13:36:06,095 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-03-10T13:36:06,097 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-10T13:36:06,100 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-10T13:36:06,103 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-10T13:36:06,106 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,109 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,112 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-03-10T13:36:06,114 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,116 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,118 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,120 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,122 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,124 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,127 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-10T13:36:06,129 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,130 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,134 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-03-10T13:36:06,135 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,138 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,140 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,142 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,144 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,147 copying build/lib/evalscope/utils/filters.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,149 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,152 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,155 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-10T13:36:06,158 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-03-10T13:36:06,160 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-10T13:36:06,163 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-10T13:36:06,167 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-10T13:36:06,171 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-10T13:36:06,175 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-03-10T13:36:06,176 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-03-10T13:36:06,178 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-10T13:36:06,181 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-03-10T13:36:06,182 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-10T13:36:06,184 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-10T13:36:06,187 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-10T13:36:06,189 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-10T13:36:06,192 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-10T13:36:06,195 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-03-10T13:36:06,196 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,198 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,200 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,201 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,203 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,205 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-10T13:36:06,208 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:06,209 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:06,212 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:06,213 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:06,215 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-10T13:36:06,217 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:06,220 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:06,221 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:06,223 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:06,226 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:06,228 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-10T13:36:06,229 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:06,231 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-10T13:36:06,234 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:06,235 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:06,238 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,239 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,242 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,244 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,246 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,248 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,250 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,252 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,255 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-10T13:36:06,257 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:06,258 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:06,260 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-10T13:36:06,262 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-03-10T13:36:06,265 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-03-10T13:36:06,266 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-03-10T13:36:06,268 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-03-10T13:36:06,270 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-10T13:36:06,272 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,274 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,276 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,278 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,280 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,282 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-10T13:36:06,284 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-10T13:36:06,286 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-10T13:36:06,288 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-03-10T13:36:06,291 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-03-10T13:36:06,292 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-10T13:36:06,294 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-10T13:36:06,296 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-10T13:36:06,298 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-03-10T13:36:06,300 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-03-10T13:36:06,302 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-03-10T13:36:06,304 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-10T13:36:06,306 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-10T13:36:06,309 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-03-10T13:36:06,310 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,312 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,315 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,316 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,319 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,320 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-10T13:36:06,322 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-03-10T13:36:06,324 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-03-10T13:36:06,326 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-10T13:36:06,328 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-10T13:36:06,331 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-10T13:36:06,332 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-10T13:36:06,334 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-10T13:36:06,337 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-03-10T13:36:06,338 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,340 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,342 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,344 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,346 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,348 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,350 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,352 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-10T13:36:06,354 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-03-10T13:36:06,356 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-03-10T13:36:06,357 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-10T13:36:06,360 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-10T13:36:06,362 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-10T13:36:06,364 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-03-10T13:36:06,366 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-03-10T13:36:06,367 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,369 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,370 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,373 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,375 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,377 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,380 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-10T13:36:06,382 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,384 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,386 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,388 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,391 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,392 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,395 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-03-10T13:36:06,397 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-10T13:36:06,399 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-10T13:36:06,401 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-10T13:36:06,403 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-10T13:36:06,405 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench 2025-03-10T13:36:06,407 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/resources 2025-03-10T13:36:06,408 copying build/lib/evalscope/third_party/thinkbench/resources/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-03-10T13:36:06,411 copying build/lib/evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-03-10T13:36:06,412 copying build/lib/evalscope/third_party/thinkbench/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-10T13:36:06,415 copying build/lib/evalscope/third_party/thinkbench/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-10T13:36:06,418 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/tools 2025-03-10T13:36:06,419 copying build/lib/evalscope/third_party/thinkbench/tools/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-10T13:36:06,421 copying build/lib/evalscope/third_party/thinkbench/tools/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-10T13:36:06,423 copying build/lib/evalscope/third_party/thinkbench/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-10T13:36:06,424 copying build/lib/evalscope/third_party/thinkbench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-10T13:36:06,426 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-03-10T13:36:06,428 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-03-10T13:36:06,430 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,431 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,433 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,436 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,438 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,439 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,442 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,444 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-10T13:36:06,446 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:06,447 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:06,449 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-03-10T13:36:06,452 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-03-10T13:36:06,453 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,455 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,457 copying build/lib/evalscope/models/register.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,459 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,461 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,463 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,466 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,469 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-03-10T13:36:06,470 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-10T13:36:06,472 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-10T13:36:06,473 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-10T13:36:06,475 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,477 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-10T13:36:06,479 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,482 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-03-10T13:36:06,483 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-03-10T13:36:06,485 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-03-10T13:36:06,487 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-03-10T13:36:06,489 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-03-10T13:36:06,492 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-03-10T13:36:06,496 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-03-10T13:36:06,497 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-03-10T13:36:06,499 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-03-10T13:36:06,520 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-03-10T13:36:06,521 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-10T13:36:06,523 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-10T13:36:06,525 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-10T13:36:06,527 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-10T13:36:06,530 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-03-10T13:36:06,532 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,534 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,536 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,538 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,540 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,542 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,544 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,546 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,548 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,550 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,552 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-10T13:36:06,554 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-03-10T13:36:06,556 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,559 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-03-10T13:36:06,560 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-03-10T13:36:06,562 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-03-10T13:36:06,573 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-03-10T13:36:06,596 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,598 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,600 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,602 copying build/lib/evalscope/metrics/math_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,605 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,608 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:06,609 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:06,611 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-03-10T13:36:06,613 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-10T13:36:06,615 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-10T13:36:06,617 running install_egg_info 2025-03-10T13:36:06,651 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.12.1-py3.11.egg-info 2025-03-10T13:36:06,665 running install_scripts 2025-03-10T13:36:06,721 creating build/bdist.linux-armv7l/wheel/evalscope-0.12.1.dist-info/WHEEL 2025-03-10T13:36:06,723 creating '/tmp/pip-wheel-4c_awxpa/evalscope-0.12.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-03-10T13:36:06,726 adding 'evalscope/__init__.py' 2025-03-10T13:36:06,727 adding 'evalscope/arguments.py' 2025-03-10T13:36:06,729 adding 'evalscope/config.py' 2025-03-10T13:36:06,731 adding 'evalscope/constants.py' 2025-03-10T13:36:06,732 adding 'evalscope/run.py' 2025-03-10T13:36:06,734 adding 'evalscope/run_arena.py' 2025-03-10T13:36:06,736 adding 'evalscope/summarizer.py' 2025-03-10T13:36:06,737 adding 'evalscope/version.py' 2025-03-10T13:36:06,739 adding 'evalscope/backend/__init__.py' 2025-03-10T13:36:06,740 adding 'evalscope/backend/base.py' 2025-03-10T13:36:06,742 adding 'evalscope/backend/opencompass/__init__.py' 2025-03-10T13:36:06,743 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-03-10T13:36:06,745 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-03-10T13:36:06,747 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-03-10T13:36:06,748 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-03-10T13:36:06,750 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-03-10T13:36:06,752 adding 'evalscope/backend/rag_eval/__init__.py' 2025-03-10T13:36:06,753 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-03-10T13:36:06,755 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-03-10T13:36:06,756 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-03-10T13:36:06,757 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-03-10T13:36:06,759 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-03-10T13:36:06,760 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-03-10T13:36:06,762 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-03-10T13:36:06,763 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-03-10T13:36:06,765 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-03-10T13:36:06,767 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-03-10T13:36:06,768 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-03-10T13:36:06,769 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-03-10T13:36:06,771 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-03-10T13:36:06,772 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-03-10T13:36:06,774 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-03-10T13:36:06,776 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-03-10T13:36:06,778 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-03-10T13:36:06,779 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-03-10T13:36:06,780 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-03-10T13:36:06,782 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-03-10T13:36:06,784 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-03-10T13:36:06,785 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-03-10T13:36:06,787 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-03-10T13:36:06,788 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-03-10T13:36:06,790 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-03-10T13:36:06,791 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-03-10T13:36:06,793 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-03-10T13:36:06,795 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-03-10T13:36:06,796 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-03-10T13:36:06,798 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-03-10T13:36:06,799 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-03-10T13:36:06,800 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-03-10T13:36:06,802 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-03-10T13:36:06,804 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-03-10T13:36:06,805 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-03-10T13:36:06,806 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-03-10T13:36:06,808 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-03-10T13:36:06,810 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-03-10T13:36:06,811 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-03-10T13:36:06,812 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-03-10T13:36:06,815 adding 'evalscope/benchmarks/__init__.py' 2025-03-10T13:36:06,816 adding 'evalscope/benchmarks/benchmark.py' 2025-03-10T13:36:06,818 adding 'evalscope/benchmarks/data_adapter.py' 2025-03-10T13:36:06,820 adding 'evalscope/benchmarks/utils.py' 2025-03-10T13:36:06,821 adding 'evalscope/benchmarks/aime/__init__.py' 2025-03-10T13:36:06,823 adding 'evalscope/benchmarks/aime/aime24_adapter.py' 2025-03-10T13:36:06,824 adding 'evalscope/benchmarks/aime/aime25_adapter.py' 2025-03-10T13:36:06,826 adding 'evalscope/benchmarks/arc/__init__.py' 2025-03-10T13:36:06,828 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-03-10T13:36:06,829 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-03-10T13:36:06,831 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-03-10T13:36:06,832 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-03-10T13:36:06,835 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-03-10T13:36:06,836 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-03-10T13:36:06,837 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-03-10T13:36:06,839 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-03-10T13:36:06,840 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-03-10T13:36:06,841 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-03-10T13:36:06,842 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-03-10T13:36:06,844 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-03-10T13:36:06,845 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-03-10T13:36:06,846 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-03-10T13:36:06,847 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-03-10T13:36:06,849 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-03-10T13:36:06,850 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-03-10T13:36:06,851 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-03-10T13:36:06,852 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-03-10T13:36:06,854 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-03-10T13:36:06,855 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-03-10T13:36:06,856 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-03-10T13:36:06,858 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-03-10T13:36:06,859 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-03-10T13:36:06,860 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-03-10T13:36:06,862 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-03-10T13:36:06,863 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-03-10T13:36:06,864 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-03-10T13:36:06,865 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-03-10T13:36:06,867 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-03-10T13:36:06,868 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-03-10T13:36:06,870 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-03-10T13:36:06,872 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-03-10T13:36:06,873 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-03-10T13:36:06,875 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-03-10T13:36:06,877 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-03-10T13:36:06,878 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-03-10T13:36:06,880 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-03-10T13:36:06,882 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-03-10T13:36:06,883 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-03-10T13:36:06,885 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-03-10T13:36:06,887 adding 'evalscope/benchmarks/data_collection/__init__.py' 2025-03-10T13:36:06,888 adding 'evalscope/benchmarks/data_collection/data_collection_adapter.py' 2025-03-10T13:36:06,890 adding 'evalscope/benchmarks/general_mcq/__init__.py' 2025-03-10T13:36:06,891 adding 'evalscope/benchmarks/general_mcq/general_mcq_adapter.py' 2025-03-10T13:36:06,893 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-03-10T13:36:06,895 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-03-10T13:36:06,896 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-03-10T13:36:06,898 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-03-10T13:36:06,899 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-03-10T13:36:06,901 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-03-10T13:36:06,902 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-03-10T13:36:06,904 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-03-10T13:36:06,906 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-03-10T13:36:06,907 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-03-10T13:36:06,908 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-03-10T13:36:06,910 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-03-10T13:36:06,911 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-03-10T13:36:06,913 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-03-10T13:36:06,914 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-03-10T13:36:06,916 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-03-10T13:36:06,921 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-03-10T13:36:06,923 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-03-10T13:36:06,926 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-03-10T13:36:06,928 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-03-10T13:36:06,930 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-03-10T13:36:06,931 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-03-10T13:36:06,933 adding 'evalscope/benchmarks/math_500/__init__.py' 2025-03-10T13:36:06,935 adding 'evalscope/benchmarks/math_500/math_500_adapter.py' 2025-03-10T13:36:06,936 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-03-10T13:36:06,938 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-03-10T13:36:06,940 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-03-10T13:36:06,941 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-03-10T13:36:06,943 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-03-10T13:36:06,944 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-03-10T13:36:06,946 adding 'evalscope/benchmarks/musr/__init__.py' 2025-03-10T13:36:06,947 adding 'evalscope/benchmarks/musr/musr_adapter.py' 2025-03-10T13:36:06,949 adding 'evalscope/benchmarks/process_bench/__init__.py' 2025-03-10T13:36:06,950 adding 'evalscope/benchmarks/process_bench/critique_template.txt' 2025-03-10T13:36:06,952 adding 'evalscope/benchmarks/process_bench/process_bench_adapter.py' 2025-03-10T13:36:06,954 adding 'evalscope/benchmarks/race/__init__.py' 2025-03-10T13:36:06,955 adding 'evalscope/benchmarks/race/race.py' 2025-03-10T13:36:06,957 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-03-10T13:36:06,958 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-03-10T13:36:06,960 adding 'evalscope/benchmarks/simple_qa/__init__.py' 2025-03-10T13:36:06,961 adding 'evalscope/benchmarks/simple_qa/simple_qa_adapter.py' 2025-03-10T13:36:06,963 adding 'evalscope/benchmarks/super_gpqa/__init__.py' 2025-03-10T13:36:06,965 adding 'evalscope/benchmarks/super_gpqa/five_shot_prompt.txt' 2025-03-10T13:36:06,966 adding 'evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py' 2025-03-10T13:36:06,968 adding 'evalscope/benchmarks/super_gpqa/utils.py' 2025-03-10T13:36:06,969 adding 'evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt' 2025-03-10T13:36:06,971 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-03-10T13:36:06,972 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-03-10T13:36:06,974 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-03-10T13:36:06,976 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-03-10T13:36:06,978 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-03-10T13:36:06,980 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-03-10T13:36:06,982 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-03-10T13:36:06,984 adding 'evalscope/cli/__init__.py' 2025-03-10T13:36:06,985 adding 'evalscope/cli/base.py' 2025-03-10T13:36:06,986 adding 'evalscope/cli/cli.py' 2025-03-10T13:36:06,987 adding 'evalscope/cli/start_app.py' 2025-03-10T13:36:06,989 adding 'evalscope/cli/start_eval.py' 2025-03-10T13:36:06,990 adding 'evalscope/cli/start_perf.py' 2025-03-10T13:36:06,991 adding 'evalscope/cli/start_server.py' 2025-03-10T13:36:06,992 adding 'evalscope/collections/__init__.py' 2025-03-10T13:36:06,994 adding 'evalscope/collections/evaluator.py' 2025-03-10T13:36:06,996 adding 'evalscope/collections/sampler.py' 2025-03-10T13:36:06,997 adding 'evalscope/collections/schema.py' 2025-03-10T13:36:06,999 adding 'evalscope/evaluator/__init__.py' 2025-03-10T13:36:07,001 adding 'evalscope/evaluator/evaluator.py' 2025-03-10T13:36:07,003 adding 'evalscope/evaluator/rating_eval.py' 2025-03-10T13:36:07,004 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-03-10T13:36:07,007 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-03-10T13:36:07,008 adding 'evalscope/metrics/__init__.py' 2025-03-10T13:36:07,010 adding 'evalscope/metrics/code_metric.py' 2025-03-10T13:36:07,012 adding 'evalscope/metrics/math_parser.py' 2025-03-10T13:36:07,015 adding 'evalscope/metrics/metrics.py' 2025-03-10T13:36:07,016 adding 'evalscope/metrics/named_metrics.py' 2025-03-10T13:36:07,018 adding 'evalscope/metrics/rouge_metric.py' 2025-03-10T13:36:07,020 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-03-10T13:36:07,022 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-03-10T13:36:07,179 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-03-10T13:36:07,423 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-03-10T13:36:07,433 adding 'evalscope/models/__init__.py' 2025-03-10T13:36:07,435 adding 'evalscope/models/base_adapter.py' 2025-03-10T13:36:07,436 adding 'evalscope/models/chat_adapter.py' 2025-03-10T13:36:07,438 adding 'evalscope/models/choice_adapter.py' 2025-03-10T13:36:07,440 adding 'evalscope/models/custom_adapter.py' 2025-03-10T13:36:07,442 adding 'evalscope/models/local_model.py' 2025-03-10T13:36:07,443 adding 'evalscope/models/model.py' 2025-03-10T13:36:07,444 adding 'evalscope/models/register.py' 2025-03-10T13:36:07,446 adding 'evalscope/models/server_adapter.py' 2025-03-10T13:36:07,448 adding 'evalscope/models/custom/__init__.py' 2025-03-10T13:36:07,449 adding 'evalscope/models/custom/custom_model.py' 2025-03-10T13:36:07,450 adding 'evalscope/models/custom/dummy_model.py' 2025-03-10T13:36:07,452 adding 'evalscope/perf/__init__.py' 2025-03-10T13:36:07,454 adding 'evalscope/perf/arguments.py' 2025-03-10T13:36:07,456 adding 'evalscope/perf/benchmark.py' 2025-03-10T13:36:07,457 adding 'evalscope/perf/http_client.py' 2025-03-10T13:36:07,458 adding 'evalscope/perf/main.py' 2025-03-10T13:36:07,460 adding 'evalscope/perf/plugin/__init__.py' 2025-03-10T13:36:07,462 adding 'evalscope/perf/plugin/registry.py' 2025-03-10T13:36:07,463 adding 'evalscope/perf/plugin/api/__init__.py' 2025-03-10T13:36:07,465 adding 'evalscope/perf/plugin/api/base.py' 2025-03-10T13:36:07,466 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-03-10T13:36:07,467 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-03-10T13:36:07,469 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-03-10T13:36:07,471 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-03-10T13:36:07,472 adding 'evalscope/perf/plugin/datasets/base.py' 2025-03-10T13:36:07,474 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-03-10T13:36:07,475 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-03-10T13:36:07,476 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-03-10T13:36:07,478 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-03-10T13:36:07,479 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-03-10T13:36:07,480 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-03-10T13:36:07,482 adding 'evalscope/perf/utils/__init__.py' 2025-03-10T13:36:07,483 adding 'evalscope/perf/utils/analysis_result.py' 2025-03-10T13:36:07,484 adding 'evalscope/perf/utils/benchmark_util.py' 2025-03-10T13:36:07,486 adding 'evalscope/perf/utils/db_util.py' 2025-03-10T13:36:07,487 adding 'evalscope/perf/utils/handler.py' 2025-03-10T13:36:07,489 adding 'evalscope/perf/utils/local_server.py' 2025-03-10T13:36:07,490 adding 'evalscope/registry/__init__.py' 2025-03-10T13:36:07,492 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-03-10T13:36:07,494 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-03-10T13:36:07,495 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-03-10T13:36:07,496 adding 'evalscope/registry/config/cfg_single.yaml' 2025-03-10T13:36:07,499 adding 'evalscope/registry/data/question.jsonl' 2025-03-10T13:36:07,501 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-03-10T13:36:07,502 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-03-10T13:36:07,665 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-03-10T13:36:07,674 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-03-10T13:36:07,676 adding 'evalscope/registry/tasks/arc.yaml' 2025-03-10T13:36:07,677 adding 'evalscope/registry/tasks/bbh.yaml' 2025-03-10T13:36:07,678 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-03-10T13:36:07,679 adding 'evalscope/registry/tasks/ceval.yaml' 2025-03-10T13:36:07,680 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-03-10T13:36:07,682 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-03-10T13:36:07,683 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-03-10T13:36:07,684 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-03-10T13:36:07,685 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-03-10T13:36:07,687 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-03-10T13:36:07,688 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-03-10T13:36:07,690 adding 'evalscope/report/__init__.py' 2025-03-10T13:36:07,693 adding 'evalscope/report/app.py' 2025-03-10T13:36:07,694 adding 'evalscope/report/combinator.py' 2025-03-10T13:36:07,696 adding 'evalscope/report/generator.py' 2025-03-10T13:36:07,697 adding 'evalscope/report/utils.py' 2025-03-10T13:36:07,699 adding 'evalscope/third_party/__init__.py' 2025-03-10T13:36:07,701 adding 'evalscope/third_party/longbench_write/README.md' 2025-03-10T13:36:07,702 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-03-10T13:36:07,703 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-03-10T13:36:07,704 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-03-10T13:36:07,706 adding 'evalscope/third_party/longbench_write/eval.py' 2025-03-10T13:36:07,708 adding 'evalscope/third_party/longbench_write/infer.py' 2025-03-10T13:36:07,709 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-03-10T13:36:07,711 adding 'evalscope/third_party/longbench_write/utils.py' 2025-03-10T13:36:07,712 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-03-10T13:36:07,714 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-03-10T13:36:07,721 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-03-10T13:36:07,725 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-03-10T13:36:07,726 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-03-10T13:36:07,728 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-03-10T13:36:07,730 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-03-10T13:36:07,731 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-03-10T13:36:07,733 adding 'evalscope/third_party/thinkbench/__init__.py' 2025-03-10T13:36:07,736 adding 'evalscope/third_party/thinkbench/eval.py' 2025-03-10T13:36:07,737 adding 'evalscope/third_party/thinkbench/infer.py' 2025-03-10T13:36:07,739 adding 'evalscope/third_party/thinkbench/resources/critique_template.txt' 2025-03-10T13:36:07,740 adding 'evalscope/third_party/thinkbench/resources/reformat_template.txt' 2025-03-10T13:36:07,742 adding 'evalscope/third_party/thinkbench/tools/__init__.py' 2025-03-10T13:36:07,743 adding 'evalscope/third_party/thinkbench/tools/llm.py' 2025-03-10T13:36:07,744 adding 'evalscope/third_party/thinkbench/tools/utils.py' 2025-03-10T13:36:07,746 adding 'evalscope/third_party/toolbench_static/README.md' 2025-03-10T13:36:07,747 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-03-10T13:36:07,748 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-03-10T13:36:07,750 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-03-10T13:36:07,751 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-03-10T13:36:07,753 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-03-10T13:36:07,754 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-03-10T13:36:07,756 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-03-10T13:36:07,757 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-03-10T13:36:07,759 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-03-10T13:36:07,760 adding 'evalscope/utils/__init__.py' 2025-03-10T13:36:07,762 adding 'evalscope/utils/arena_utils.py' 2025-03-10T13:36:07,764 adding 'evalscope/utils/chat_service.py' 2025-03-10T13:36:07,765 adding 'evalscope/utils/completion_parsers.py' 2025-03-10T13:36:07,766 adding 'evalscope/utils/filters.py' 2025-03-10T13:36:07,767 adding 'evalscope/utils/io_utils.py' 2025-03-10T13:36:07,769 adding 'evalscope/utils/logger.py' 2025-03-10T13:36:07,770 adding 'evalscope/utils/model_utils.py' 2025-03-10T13:36:07,772 adding 'evalscope/utils/utils.py' 2025-03-10T13:36:07,775 adding 'tests/__init__.py' 2025-03-10T13:36:07,776 adding 'tests/test_run_all.py' 2025-03-10T13:36:07,777 adding 'tests/cli/__init__.py' 2025-03-10T13:36:07,779 adding 'tests/cli/test_collection.py' 2025-03-10T13:36:07,780 adding 'tests/cli/test_run.py' 2025-03-10T13:36:07,782 adding 'tests/perf/__init__.py' 2025-03-10T13:36:07,783 adding 'tests/perf/test_perf.py' 2025-03-10T13:36:07,785 adding 'tests/rag/__init__.py' 2025-03-10T13:36:07,787 adding 'tests/rag/test_clip_benchmark.py' 2025-03-10T13:36:07,788 adding 'tests/rag/test_mteb.py' 2025-03-10T13:36:07,790 adding 'tests/rag/test_ragas.py' 2025-03-10T13:36:07,792 adding 'tests/swift/__init__.py' 2025-03-10T13:36:07,793 adding 'tests/swift/test_run_swift_eval.py' 2025-03-10T13:36:07,795 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-03-10T13:36:07,796 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-03-10T13:36:07,798 adding 'tests/vlm/__init__.py' 2025-03-10T13:36:07,799 adding 'tests/vlm/test_vlmeval.py' 2025-03-10T13:36:07,801 adding 'evalscope-0.12.1.dist-info/LICENSE' 2025-03-10T13:36:07,805 adding 'evalscope-0.12.1.dist-info/METADATA' 2025-03-10T13:36:07,806 adding 'evalscope-0.12.1.dist-info/WHEEL' 2025-03-10T13:36:07,807 adding 'evalscope-0.12.1.dist-info/entry_points.txt' 2025-03-10T13:36:07,808 adding 'evalscope-0.12.1.dist-info/top_level.txt' 2025-03-10T13:36:07,813 adding 'evalscope-0.12.1.dist-info/RECORD' 2025-03-10T13:36:07,850 removing build/bdist.linux-armv7l/wheel 2025-03-10T13:36:08,065 Building wheel for evalscope (setup.py): finished with status 'done' 2025-03-10T13:36:08,082 Created wheel for evalscope: filename=evalscope-0.12.1-py3-none-any.whl size=1466208 sha256=72e5815923789c6cab6c32425477393bf645f670edcc493f8e4dec6e93f3da23 2025-03-10T13:36:08,084 Stored in directory: /tmp/pip-ephem-wheel-cache-1scw3w3r/wheels/91/15/5a/38682559268e2862b4aab63b98840dcfc02b5186059f8c1ec4 2025-03-10T13:36:08,115 Successfully built evalscope 2025-03-10T13:36:08,153 Removed build tracker: '/tmp/pip-build-tracker-fzl8vsqs'