2025-03-14T04:43:45,321 Created temporary directory: /tmp/pip-build-tracker-oslgugu9 2025-03-14T04:43:45,322 Initialized build tracking at /tmp/pip-build-tracker-oslgugu9 2025-03-14T04:43:45,323 Created build tracker: /tmp/pip-build-tracker-oslgugu9 2025-03-14T04:43:45,323 Entered build tracker: /tmp/pip-build-tracker-oslgugu9 2025-03-14T04:43:45,324 Created temporary directory: /tmp/pip-wheel-g4mp2wsn 2025-03-14T04:43:45,328 Created temporary directory: /tmp/pip-ephem-wheel-cache-yddiw49_ 2025-03-14T04:43:45,372 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-03-14T04:43:45,375 2 location(s) to search for versions of evalscope: 2025-03-14T04:43:45,375 * https://pypi.org/simple/evalscope/ 2025-03-14T04:43:45,375 * https://www.piwheels.org/simple/evalscope/ 2025-03-14T04:43:45,376 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-03-14T04:43:45,377 Getting page https://pypi.org/simple/evalscope/ 2025-03-14T04:43:45,378 Found index url https://pypi.org/simple/ 2025-03-14T04:43:45,521 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-03-14T04:43:45,530 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,532 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-03-14T04:43:45,532 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,533 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-03-14T04:43:45,534 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,535 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-03-14T04:43:45,536 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,536 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-03-14T04:43:45,537 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,538 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-03-14T04:43:45,539 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,539 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,540 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-03-14T04:43:45,541 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,542 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-03-14T04:43:45,542 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,543 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-03-14T04:43:45,544 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,545 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-03-14T04:43:45,546 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,546 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-03-14T04:43:45,547 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,548 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-03-14T04:43:45,549 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,550 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-03-14T04:43:45,550 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,551 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-03-14T04:43:45,552 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,553 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-03-14T04:43:45,554 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,554 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-03-14T04:43:45,555 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,556 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-03-14T04:43:45,556 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,557 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-03-14T04:43:45,558 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,559 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-03-14T04:43:45,559 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,560 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-03-14T04:43:45,561 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d6/e5/852326943d86c85b5ca6b548a5f3753c217b771d93968c61ec2ca46ee0b1/evalscope-0.11.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,562 Found link https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.11.0 2025-03-14T04:43:45,562 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7d/8e/f9eceecf8bc7d740603f915eef7fab3e9d657a01f5de2c523e531445299c/evalscope-0.12.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,563 Found link https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.0 2025-03-14T04:43:45,564 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ee/4c/84a5e18985e149eb4283fef2b58a81ff2cec2d099c017684938ec3a3935f/evalscope-0.12.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,565 Found link https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.1 2025-03-14T04:43:45,566 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/a5/65faf0660cd8ae2660354b002b2b3a586b9419bc894120fea97efd506cb6/evalscope-0.13.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,566 Found link https://files.pythonhosted.org/packages/d0/39/d5eb469a94191760c61d1bfcb235e28be1d2a080d88b44792f53d76c45d1/evalscope-0.13.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.13.0 2025-03-14T04:43:45,567 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-03-14T04:43:45,568 Getting page https://www.piwheels.org/simple/evalscope/ 2025-03-14T04:43:45,569 Found index url https://www.piwheels.org/simple/ 2025-03-14T04:43:45,734 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-03-14T04:43:45,739 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.12.1-py3-none-any.whl#sha256=72e5815923789c6cab6c32425477393bf645f670edcc493f8e4dec6e93f3da23 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,740 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.12.0-py3-none-any.whl#sha256=f26c7317a5bacac8527806723d45bac74563a2608ed761d822ace03be3a5e45f (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,740 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.11.0-py3-none-any.whl#sha256=6e7d3242c5bf97b54d24644a1300575fdf41c1d90eef7c1344c20bf0d1518671 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,741 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.1-py3-none-any.whl#sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,741 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,742 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,742 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,743 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,743 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,744 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,745 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,745 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-03-14T04:43:45,746 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-03-14T04:43:45,746 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-03-14T04:43:45,768 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-03-14T04:43:45,770 Collecting evalscope==0.13.0 2025-03-14T04:43:45,772 Created temporary directory: /tmp/pip-unpack-dxdnduo8 2025-03-14T04:43:46,242 Downloading evalscope-0.13.0.tar.gz (1.4 MB) 2025-03-14T04:43:47,259 Added evalscope==0.13.0 from https://files.pythonhosted.org/packages/d0/39/d5eb469a94191760c61d1bfcb235e28be1d2a080d88b44792f53d76c45d1/evalscope-0.13.0.tar.gz to build tracker '/tmp/pip-build-tracker-oslgugu9' 2025-03-14T04:43:47,261 Running setup.py (path:/tmp/pip-wheel-g4mp2wsn/evalscope_75fa88a6e23246dda7ce86f796176e3d/setup.py) egg_info for package evalscope 2025-03-14T04:43:47,261 Created temporary directory: /tmp/pip-pip-egg-info-_2zk37qw 2025-03-14T04:43:47,262 Preparing metadata (setup.py): started 2025-03-14T04:43:47,263 Running command python setup.py egg_info 2025-03-14T04:43:47,859 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-14T04:43:47,859 !! 2025-03-14T04:43:47,861 ******************************************************************************** 2025-03-14T04:43:47,861 Usage of dash-separated 'index-url' will not be supported in future 2025-03-14T04:43:47,862 versions. Please use the underscore name 'index_url' instead. 2025-03-14T04:43:47,863 This deprecation is overdue, please update your project and remove deprecated 2025-03-14T04:43:47,863 calls to avoid build errors in the future. 2025-03-14T04:43:47,864 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-14T04:43:47,865 ******************************************************************************** 2025-03-14T04:43:47,866 !! 2025-03-14T04:43:47,867 opt = self.warn_dash_deprecation(opt, section) 2025-03-14T04:43:48,449 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-14T04:43:48,449 !! 2025-03-14T04:43:48,450 ******************************************************************************** 2025-03-14T04:43:48,451 Usage of dash-separated 'index-url' will not be supported in future 2025-03-14T04:43:48,452 versions. Please use the underscore name 'index_url' instead. 2025-03-14T04:43:48,453 This deprecation is overdue, please update your project and remove deprecated 2025-03-14T04:43:48,453 calls to avoid build errors in the future. 2025-03-14T04:43:48,455 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-14T04:43:48,455 ******************************************************************************** 2025-03-14T04:43:48,457 !! 2025-03-14T04:43:48,457 opt = self.warn_dash_deprecation(opt, section) 2025-03-14T04:43:48,485 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-03-14T04:43:48,485 running egg_info 2025-03-14T04:43:48,513 creating /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info 2025-03-14T04:43:48,514 writing /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/PKG-INFO 2025-03-14T04:43:48,545 writing dependency_links to /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/dependency_links.txt 2025-03-14T04:43:48,547 writing entry points to /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/entry_points.txt 2025-03-14T04:43:48,562 writing requirements to /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/requires.txt 2025-03-14T04:43:48,563 writing top-level names to /tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/top_level.txt 2025-03-14T04:43:48,565 writing manifest file '/tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/SOURCES.txt' 2025-03-14T04:43:48,733 reading manifest file '/tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/SOURCES.txt' 2025-03-14T04:43:48,734 reading manifest template 'MANIFEST.in' 2025-03-14T04:43:48,886 adding license file 'LICENSE' 2025-03-14T04:43:48,902 writing manifest file '/tmp/pip-pip-egg-info-_2zk37qw/evalscope.egg-info/SOURCES.txt' 2025-03-14T04:43:49,015 Preparing metadata (setup.py): finished with status 'done' 2025-03-14T04:43:49,022 Source in /tmp/pip-wheel-g4mp2wsn/evalscope_75fa88a6e23246dda7ce86f796176e3d has version 0.13.0, which satisfies requirement evalscope==0.13.0 from https://files.pythonhosted.org/packages/d0/39/d5eb469a94191760c61d1bfcb235e28be1d2a080d88b44792f53d76c45d1/evalscope-0.13.0.tar.gz 2025-03-14T04:43:49,023 Removed evalscope==0.13.0 from https://files.pythonhosted.org/packages/d0/39/d5eb469a94191760c61d1bfcb235e28be1d2a080d88b44792f53d76c45d1/evalscope-0.13.0.tar.gz from build tracker '/tmp/pip-build-tracker-oslgugu9' 2025-03-14T04:43:49,087 Created temporary directory: /tmp/pip-unpack-41vxxgkq 2025-03-14T04:43:49,088 Created temporary directory: /tmp/pip-unpack-3hj5u9ni 2025-03-14T04:43:49,089 Building wheels for collected packages: evalscope 2025-03-14T04:43:49,093 Created temporary directory: /tmp/pip-wheel-39y19j61 2025-03-14T04:43:49,093 Building wheel for evalscope (setup.py): started 2025-03-14T04:43:49,095 Destination directory: /tmp/pip-wheel-39y19j61 2025-03-14T04:43:49,095 Running command python setup.py bdist_wheel 2025-03-14T04:43:49,553 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-03-14T04:43:49,660 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-14T04:43:49,661 !! 2025-03-14T04:43:49,662 ******************************************************************************** 2025-03-14T04:43:49,662 Usage of dash-separated 'index-url' will not be supported in future 2025-03-14T04:43:49,663 versions. Please use the underscore name 'index_url' instead. 2025-03-14T04:43:49,664 This deprecation is overdue, please update your project and remove deprecated 2025-03-14T04:43:49,665 calls to avoid build errors in the future. 2025-03-14T04:43:49,666 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-14T04:43:49,666 ******************************************************************************** 2025-03-14T04:43:49,667 !! 2025-03-14T04:43:49,668 opt = self.warn_dash_deprecation(opt, section) 2025-03-14T04:43:50,240 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-03-14T04:43:50,241 !! 2025-03-14T04:43:50,242 ******************************************************************************** 2025-03-14T04:43:50,243 Usage of dash-separated 'index-url' will not be supported in future 2025-03-14T04:43:50,244 versions. Please use the underscore name 'index_url' instead. 2025-03-14T04:43:50,245 This deprecation is overdue, please update your project and remove deprecated 2025-03-14T04:43:50,245 calls to avoid build errors in the future. 2025-03-14T04:43:50,246 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-03-14T04:43:50,246 ******************************************************************************** 2025-03-14T04:43:50,247 !! 2025-03-14T04:43:50,248 opt = self.warn_dash_deprecation(opt, section) 2025-03-14T04:43:50,250 running bdist_wheel 2025-03-14T04:43:50,380 running build 2025-03-14T04:43:50,381 running build_py 2025-03-14T04:43:50,411 creating build/lib/tests 2025-03-14T04:43:50,413 copying tests/__init__.py -> build/lib/tests 2025-03-14T04:43:50,415 copying tests/test_run_all.py -> build/lib/tests 2025-03-14T04:43:50,417 creating build/lib/evalscope 2025-03-14T04:43:50,418 copying evalscope/__init__.py -> build/lib/evalscope 2025-03-14T04:43:50,420 copying evalscope/arguments.py -> build/lib/evalscope 2025-03-14T04:43:50,422 copying evalscope/run.py -> build/lib/evalscope 2025-03-14T04:43:50,425 copying evalscope/version.py -> build/lib/evalscope 2025-03-14T04:43:50,426 copying evalscope/summarizer.py -> build/lib/evalscope 2025-03-14T04:43:50,429 copying evalscope/constants.py -> build/lib/evalscope 2025-03-14T04:43:50,431 copying evalscope/config.py -> build/lib/evalscope 2025-03-14T04:43:50,433 copying evalscope/run_arena.py -> build/lib/evalscope 2025-03-14T04:43:50,436 creating build/lib/tests/swift 2025-03-14T04:43:50,437 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-03-14T04:43:50,439 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-03-14T04:43:50,443 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-03-14T04:43:50,445 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-03-14T04:43:50,447 creating build/lib/tests/perf 2025-03-14T04:43:50,448 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-03-14T04:43:50,450 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-03-14T04:43:50,452 creating build/lib/tests/vlm 2025-03-14T04:43:50,453 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-03-14T04:43:50,455 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-03-14T04:43:50,458 creating build/lib/tests/rag 2025-03-14T04:43:50,459 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-03-14T04:43:50,461 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-03-14T04:43:50,462 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-03-14T04:43:50,464 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-03-14T04:43:50,467 creating build/lib/tests/cli 2025-03-14T04:43:50,468 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-03-14T04:43:50,470 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-03-14T04:43:50,472 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-03-14T04:43:50,475 copying tests/cli/test_all.py -> build/lib/tests/cli 2025-03-14T04:43:50,478 creating build/lib/evalscope/models 2025-03-14T04:43:50,479 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-03-14T04:43:50,482 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-03-14T04:43:50,484 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-03-14T04:43:50,486 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-03-14T04:43:50,488 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-03-14T04:43:50,490 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-03-14T04:43:50,492 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-03-14T04:43:50,494 copying evalscope/models/register.py -> build/lib/evalscope/models 2025-03-14T04:43:50,496 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-03-14T04:43:50,499 creating build/lib/evalscope/third_party 2025-03-14T04:43:50,500 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-03-14T04:43:50,502 creating build/lib/evalscope/report 2025-03-14T04:43:50,503 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-03-14T04:43:50,505 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-03-14T04:43:50,507 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-03-14T04:43:50,509 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-03-14T04:43:50,511 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-03-14T04:43:50,514 creating build/lib/evalscope/evaluator 2025-03-14T04:43:50,515 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-03-14T04:43:50,518 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-03-14T04:43:50,520 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-03-14T04:43:50,522 creating build/lib/evalscope/perf 2025-03-14T04:43:50,523 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-03-14T04:43:50,525 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-03-14T04:43:50,528 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-03-14T04:43:50,530 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-03-14T04:43:50,532 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-03-14T04:43:50,535 creating build/lib/evalscope/registry 2025-03-14T04:43:50,536 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-03-14T04:43:50,539 creating build/lib/evalscope/utils 2025-03-14T04:43:50,540 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,542 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,544 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,546 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,549 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,551 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,553 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,555 copying evalscope/utils/filters.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,557 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-03-14T04:43:50,560 creating build/lib/evalscope/benchmarks 2025-03-14T04:43:50,561 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-03-14T04:43:50,563 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-03-14T04:43:50,566 copying evalscope/benchmarks/utils.py -> build/lib/evalscope/benchmarks 2025-03-14T04:43:50,568 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-03-14T04:43:50,570 creating build/lib/evalscope/metrics 2025-03-14T04:43:50,571 copying evalscope/metrics/llm_judge.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,573 copying evalscope/metrics/math_parser.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,576 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,578 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,580 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,582 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,584 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-03-14T04:43:50,587 creating build/lib/evalscope/collections 2025-03-14T04:43:50,588 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-03-14T04:43:50,591 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-03-14T04:43:50,592 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-03-14T04:43:50,595 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-03-14T04:43:50,597 creating build/lib/evalscope/cli 2025-03-14T04:43:50,598 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,600 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,602 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,604 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,606 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,608 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,610 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-03-14T04:43:50,612 creating build/lib/evalscope/backend 2025-03-14T04:43:50,613 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-03-14T04:43:50,614 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-03-14T04:43:50,617 creating build/lib/evalscope/models/custom 2025-03-14T04:43:50,618 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-03-14T04:43:50,620 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-03-14T04:43:50,622 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-03-14T04:43:50,624 creating build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,625 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,627 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,629 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,632 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,634 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:50,637 creating build/lib/evalscope/third_party/thinkbench 2025-03-14T04:43:50,638 copying evalscope/third_party/thinkbench/__init__.py -> build/lib/evalscope/third_party/thinkbench 2025-03-14T04:43:50,640 copying evalscope/third_party/thinkbench/eval.py -> build/lib/evalscope/third_party/thinkbench 2025-03-14T04:43:50,643 copying evalscope/third_party/thinkbench/infer.py -> build/lib/evalscope/third_party/thinkbench 2025-03-14T04:43:50,645 creating build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:50,646 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:50,648 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:50,650 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:50,653 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:50,656 creating build/lib/evalscope/third_party/longbench_write/tools 2025-03-14T04:43:50,657 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-14T04:43:50,660 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-14T04:43:50,661 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-03-14T04:43:50,664 creating build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:50,665 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:50,668 creating build/lib/evalscope/third_party/thinkbench/tools 2025-03-14T04:43:50,669 copying evalscope/third_party/thinkbench/tools/llm.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-14T04:43:50,671 copying evalscope/third_party/thinkbench/tools/__init__.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-14T04:43:50,672 copying evalscope/third_party/thinkbench/tools/utils.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-03-14T04:43:50,674 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:50,675 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:50,677 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:50,680 creating build/lib/evalscope/evaluator/reviewer 2025-03-14T04:43:50,681 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-03-14T04:43:50,683 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-03-14T04:43:50,686 creating build/lib/evalscope/perf/plugin 2025-03-14T04:43:50,687 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-03-14T04:43:50,689 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-03-14T04:43:50,691 creating build/lib/evalscope/perf/utils 2025-03-14T04:43:50,692 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,694 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,696 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,698 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,700 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,702 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-03-14T04:43:50,705 creating build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,706 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,708 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,710 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,712 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,714 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,716 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,718 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,720 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-03-14T04:43:50,722 creating build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,724 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,726 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,728 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,730 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,732 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-03-14T04:43:50,735 creating build/lib/evalscope/benchmarks/bbh 2025-03-14T04:43:50,736 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-03-14T04:43:50,738 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-03-14T04:43:50,741 creating build/lib/evalscope/benchmarks/musr 2025-03-14T04:43:50,742 copying evalscope/benchmarks/musr/__init__.py -> build/lib/evalscope/benchmarks/musr 2025-03-14T04:43:50,744 copying evalscope/benchmarks/musr/musr_adapter.py -> build/lib/evalscope/benchmarks/musr 2025-03-14T04:43:50,746 creating build/lib/evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:50,748 copying evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py -> build/lib/evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:50,750 copying evalscope/benchmarks/chinese_simple_qa/__init__.py -> build/lib/evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:50,752 creating build/lib/evalscope/benchmarks/general_qa 2025-03-14T04:43:50,753 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-03-14T04:43:50,755 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-03-14T04:43:50,758 creating build/lib/evalscope/benchmarks/gsm8k 2025-03-14T04:43:50,759 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-14T04:43:50,761 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-14T04:43:50,763 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-03-14T04:43:50,766 creating build/lib/evalscope/benchmarks/hellaswag 2025-03-14T04:43:50,767 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-14T04:43:50,769 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-14T04:43:50,772 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-03-14T04:43:50,774 creating build/lib/evalscope/benchmarks/process_bench 2025-03-14T04:43:50,776 copying evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/lib/evalscope/benchmarks/process_bench 2025-03-14T04:43:50,778 copying evalscope/benchmarks/process_bench/__init__.py -> build/lib/evalscope/benchmarks/process_bench 2025-03-14T04:43:50,780 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:50,781 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:50,783 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:50,786 creating build/lib/evalscope/benchmarks/humaneval 2025-03-14T04:43:50,787 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-14T04:43:50,790 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-14T04:43:50,792 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-03-14T04:43:50,794 creating build/lib/evalscope/benchmarks/competition_math 2025-03-14T04:43:50,796 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-14T04:43:50,798 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-14T04:43:50,800 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-03-14T04:43:50,803 creating build/lib/evalscope/benchmarks/truthful_qa 2025-03-14T04:43:50,804 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-14T04:43:50,806 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-14T04:43:50,808 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-03-14T04:43:50,811 creating build/lib/evalscope/benchmarks/iquiz 2025-03-14T04:43:50,812 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-03-14T04:43:50,814 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-03-14T04:43:50,816 creating build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,817 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,820 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,821 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,825 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,827 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,830 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-03-14T04:43:50,832 creating build/lib/evalscope/benchmarks/data_collection 2025-03-14T04:43:50,833 copying evalscope/benchmarks/data_collection/__init__.py -> build/lib/evalscope/benchmarks/data_collection 2025-03-14T04:43:50,835 copying evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/lib/evalscope/benchmarks/data_collection 2025-03-14T04:43:50,838 creating build/lib/evalscope/benchmarks/aime 2025-03-14T04:43:50,839 copying evalscope/benchmarks/aime/__init__.py -> build/lib/evalscope/benchmarks/aime 2025-03-14T04:43:50,841 copying evalscope/benchmarks/aime/aime25_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-03-14T04:43:50,842 copying evalscope/benchmarks/aime/aime24_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-03-14T04:43:50,845 creating build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,846 copying evalscope/benchmarks/live_code_bench/load_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,848 copying evalscope/benchmarks/live_code_bench/pass_k_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,850 copying evalscope/benchmarks/live_code_bench/__init__.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,852 copying evalscope/benchmarks/live_code_bench/execute_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,854 copying evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,856 copying evalscope/benchmarks/live_code_bench/evaluate_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,858 copying evalscope/benchmarks/live_code_bench/testing_util.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,861 copying evalscope/benchmarks/live_code_bench/extract_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,863 copying evalscope/benchmarks/live_code_bench/prompts.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:50,866 creating build/lib/evalscope/benchmarks/ceval 2025-03-14T04:43:50,867 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-03-14T04:43:50,869 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-03-14T04:43:50,872 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-03-14T04:43:50,875 creating build/lib/evalscope/benchmarks/gpqa 2025-03-14T04:43:50,876 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-03-14T04:43:50,878 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-03-14T04:43:50,881 creating build/lib/evalscope/benchmarks/simple_qa 2025-03-14T04:43:50,882 copying evalscope/benchmarks/simple_qa/__init__.py -> build/lib/evalscope/benchmarks/simple_qa 2025-03-14T04:43:50,883 copying evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/lib/evalscope/benchmarks/simple_qa 2025-03-14T04:43:50,886 creating build/lib/evalscope/benchmarks/cmmlu 2025-03-14T04:43:50,888 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-14T04:43:50,890 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-14T04:43:50,892 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-03-14T04:43:50,895 creating build/lib/evalscope/benchmarks/mmlu 2025-03-14T04:43:50,896 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-14T04:43:50,898 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-14T04:43:50,900 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-03-14T04:43:50,903 creating build/lib/evalscope/benchmarks/math_500 2025-03-14T04:43:50,904 copying evalscope/benchmarks/math_500/__init__.py -> build/lib/evalscope/benchmarks/math_500 2025-03-14T04:43:50,906 copying evalscope/benchmarks/math_500/math_500_adapter.py -> build/lib/evalscope/benchmarks/math_500 2025-03-14T04:43:50,908 creating build/lib/evalscope/benchmarks/arc 2025-03-14T04:43:50,909 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-03-14T04:43:50,911 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-03-14T04:43:50,913 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-03-14T04:43:50,916 creating build/lib/evalscope/benchmarks/race 2025-03-14T04:43:50,917 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-03-14T04:43:50,919 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-03-14T04:43:50,922 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-03-14T04:43:50,924 creating build/lib/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:50,925 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:50,927 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:50,929 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:50,931 creating build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:50,933 copying evalscope/benchmarks/super_gpqa/__init__.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:50,934 copying evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:50,937 copying evalscope/benchmarks/super_gpqa/utils.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:50,939 creating build/lib/evalscope/benchmarks/general_mcq 2025-03-14T04:43:50,940 copying evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/lib/evalscope/benchmarks/general_mcq 2025-03-14T04:43:50,943 copying evalscope/benchmarks/general_mcq/__init__.py -> build/lib/evalscope/benchmarks/general_mcq 2025-03-14T04:43:50,945 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:50,946 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:50,948 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:50,951 creating build/lib/evalscope/backend/rag_eval 2025-03-14T04:43:50,952 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-03-14T04:43:50,954 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-03-14T04:43:50,957 creating build/lib/evalscope/backend/vlm_eval_kit 2025-03-14T04:43:50,958 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-14T04:43:50,960 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-14T04:43:50,962 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-03-14T04:43:50,964 creating build/lib/evalscope/backend/opencompass 2025-03-14T04:43:50,965 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-03-14T04:43:50,967 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-03-14T04:43:50,969 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-03-14T04:43:50,972 creating build/lib/evalscope/backend/rag_eval/ragas 2025-03-14T04:43:50,973 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-14T04:43:50,975 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-14T04:43:50,977 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-03-14T04:43:50,979 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:50,980 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:50,982 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:50,984 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:50,986 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:50,989 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:50,990 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:50,992 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:50,994 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:50,996 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:50,999 creating build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,000 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,002 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,004 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,006 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,008 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-03-14T04:43:51,011 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,012 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,014 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,016 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,018 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,020 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:51,023 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,024 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,026 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,028 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,030 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,032 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,035 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,037 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,039 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:51,041 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:51,042 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:51,044 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:51,046 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:51,048 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:51,051 creating build/lib/evalscope/backend/opencompass/tasks 2025-03-14T04:43:51,052 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-14T04:43:51,055 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-14T04:43:51,056 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-03-14T04:43:51,059 running egg_info 2025-03-14T04:43:51,087 writing evalscope.egg-info/PKG-INFO 2025-03-14T04:43:51,117 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-03-14T04:43:51,119 writing entry points to evalscope.egg-info/entry_points.txt 2025-03-14T04:43:51,134 writing requirements to evalscope.egg-info/requires.txt 2025-03-14T04:43:51,135 writing top-level names to evalscope.egg-info/top_level.txt 2025-03-14T04:43:51,227 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-03-14T04:43:51,249 reading manifest template 'MANIFEST.in' 2025-03-14T04:43:51,380 adding license file 'LICENSE' 2025-03-14T04:43:51,402 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-03-14T04:43:51,404 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-03-14T04:43:51,405 !! 2025-03-14T04:43:51,406 ******************************************************************************** 2025-03-14T04:43:51,407 ############################ 2025-03-14T04:43:51,407 # Package would be ignored # 2025-03-14T04:43:51,408 ############################ 2025-03-14T04:43:51,409 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-03-14T04:43:51,409 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,410 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,411 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-03-14T04:43:51,412 to the `packages` configuration field. 2025-03-14T04:43:51,413 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,414 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,414 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,415 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,416 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,416 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-03-14T04:43:51,417 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-03-14T04:43:51,417 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,418 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,418 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,419 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,420 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,421 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,421 even if it does not contain any `.py` files. 2025-03-14T04:43:51,422 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,422 directory, all directories are treated like packages. 2025-03-14T04:43:51,423 ******************************************************************************** 2025-03-14T04:43:51,424 !! 2025-03-14T04:43:51,425 check.warn(importable) 2025-03-14T04:43:51,425 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-03-14T04:43:51,426 !! 2025-03-14T04:43:51,427 ******************************************************************************** 2025-03-14T04:43:51,427 ############################ 2025-03-14T04:43:51,428 # Package would be ignored # 2025-03-14T04:43:51,428 ############################ 2025-03-14T04:43:51,429 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-03-14T04:43:51,429 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,430 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,431 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-03-14T04:43:51,431 to the `packages` configuration field. 2025-03-14T04:43:51,432 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,433 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,433 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,434 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,436 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,437 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-03-14T04:43:51,437 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-03-14T04:43:51,438 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,438 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,439 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,440 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,441 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,442 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,443 even if it does not contain any `.py` files. 2025-03-14T04:43:51,443 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,443 directory, all directories are treated like packages. 2025-03-14T04:43:51,444 ******************************************************************************** 2025-03-14T04:43:51,445 !! 2025-03-14T04:43:51,445 check.warn(importable) 2025-03-14T04:43:51,446 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-03-14T04:43:51,446 !! 2025-03-14T04:43:51,447 ******************************************************************************** 2025-03-14T04:43:51,447 ############################ 2025-03-14T04:43:51,448 # Package would be ignored # 2025-03-14T04:43:51,448 ############################ 2025-03-14T04:43:51,449 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-03-14T04:43:51,449 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,450 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,451 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-03-14T04:43:51,451 to the `packages` configuration field. 2025-03-14T04:43:51,452 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,453 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,453 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,454 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,455 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,456 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-03-14T04:43:51,457 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-03-14T04:43:51,457 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,458 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,458 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,459 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,461 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,462 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,463 even if it does not contain any `.py` files. 2025-03-14T04:43:51,464 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,464 directory, all directories are treated like packages. 2025-03-14T04:43:51,465 ******************************************************************************** 2025-03-14T04:43:51,466 !! 2025-03-14T04:43:51,467 check.warn(importable) 2025-03-14T04:43:51,467 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-03-14T04:43:51,468 !! 2025-03-14T04:43:51,469 ******************************************************************************** 2025-03-14T04:43:51,469 ############################ 2025-03-14T04:43:51,470 # Package would be ignored # 2025-03-14T04:43:51,470 ############################ 2025-03-14T04:43:51,471 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-03-14T04:43:51,471 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,472 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,473 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-03-14T04:43:51,473 to the `packages` configuration field. 2025-03-14T04:43:51,474 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,474 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,475 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,476 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,477 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,477 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-03-14T04:43:51,478 already explicitly excluding 'evalscope.metrics.resources' via 2025-03-14T04:43:51,478 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,479 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,479 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,480 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,481 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,483 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,483 even if it does not contain any `.py` files. 2025-03-14T04:43:51,484 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,484 directory, all directories are treated like packages. 2025-03-14T04:43:51,485 ******************************************************************************** 2025-03-14T04:43:51,486 !! 2025-03-14T04:43:51,486 check.warn(importable) 2025-03-14T04:43:51,487 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-03-14T04:43:51,487 !! 2025-03-14T04:43:51,488 ******************************************************************************** 2025-03-14T04:43:51,489 ############################ 2025-03-14T04:43:51,489 # Package would be ignored # 2025-03-14T04:43:51,490 ############################ 2025-03-14T04:43:51,490 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-03-14T04:43:51,491 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,492 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,492 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-03-14T04:43:51,493 to the `packages` configuration field. 2025-03-14T04:43:51,494 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,494 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,495 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,496 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,497 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,498 If you don't want 'evalscope.registry.config' to be distributed and are 2025-03-14T04:43:51,499 already explicitly excluding 'evalscope.registry.config' via 2025-03-14T04:43:51,499 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,499 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,500 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,501 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,501 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,503 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,503 even if it does not contain any `.py` files. 2025-03-14T04:43:51,504 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,504 directory, all directories are treated like packages. 2025-03-14T04:43:51,505 ******************************************************************************** 2025-03-14T04:43:51,506 !! 2025-03-14T04:43:51,506 check.warn(importable) 2025-03-14T04:43:51,507 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-03-14T04:43:51,507 !! 2025-03-14T04:43:51,508 ******************************************************************************** 2025-03-14T04:43:51,509 ############################ 2025-03-14T04:43:51,509 # Package would be ignored # 2025-03-14T04:43:51,510 ############################ 2025-03-14T04:43:51,510 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-03-14T04:43:51,510 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,511 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,512 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-03-14T04:43:51,513 to the `packages` configuration field. 2025-03-14T04:43:51,514 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,514 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,515 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,516 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,517 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,518 If you don't want 'evalscope.registry.data' to be distributed and are 2025-03-14T04:43:51,518 already explicitly excluding 'evalscope.registry.data' via 2025-03-14T04:43:51,519 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,519 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,520 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,521 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,522 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,524 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,524 even if it does not contain any `.py` files. 2025-03-14T04:43:51,525 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,525 directory, all directories are treated like packages. 2025-03-14T04:43:51,526 ******************************************************************************** 2025-03-14T04:43:51,527 !! 2025-03-14T04:43:51,528 check.warn(importable) 2025-03-14T04:43:51,528 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-03-14T04:43:51,529 !! 2025-03-14T04:43:51,530 ******************************************************************************** 2025-03-14T04:43:51,530 ############################ 2025-03-14T04:43:51,530 # Package would be ignored # 2025-03-14T04:43:51,531 ############################ 2025-03-14T04:43:51,531 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-03-14T04:43:51,532 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,533 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,533 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-03-14T04:43:51,534 to the `packages` configuration field. 2025-03-14T04:43:51,534 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,535 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,535 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,536 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,537 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,538 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-03-14T04:43:51,539 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-03-14T04:43:51,539 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,540 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,540 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,541 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,543 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,544 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,545 even if it does not contain any `.py` files. 2025-03-14T04:43:51,545 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,546 directory, all directories are treated like packages. 2025-03-14T04:43:51,546 ******************************************************************************** 2025-03-14T04:43:51,547 !! 2025-03-14T04:43:51,548 check.warn(importable) 2025-03-14T04:43:51,549 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-03-14T04:43:51,549 !! 2025-03-14T04:43:51,550 ******************************************************************************** 2025-03-14T04:43:51,551 ############################ 2025-03-14T04:43:51,551 # Package would be ignored # 2025-03-14T04:43:51,552 ############################ 2025-03-14T04:43:51,553 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-03-14T04:43:51,553 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,555 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,555 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-03-14T04:43:51,556 to the `packages` configuration field. 2025-03-14T04:43:51,557 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,558 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,558 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,559 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,560 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,561 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-03-14T04:43:51,562 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-03-14T04:43:51,562 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,562 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,563 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,564 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,565 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,566 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,567 even if it does not contain any `.py` files. 2025-03-14T04:43:51,567 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,567 directory, all directories are treated like packages. 2025-03-14T04:43:51,568 ******************************************************************************** 2025-03-14T04:43:51,569 !! 2025-03-14T04:43:51,570 check.warn(importable) 2025-03-14T04:43:51,570 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-03-14T04:43:51,571 !! 2025-03-14T04:43:51,572 ******************************************************************************** 2025-03-14T04:43:51,573 ############################ 2025-03-14T04:43:51,573 # Package would be ignored # 2025-03-14T04:43:51,574 ############################ 2025-03-14T04:43:51,574 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-03-14T04:43:51,575 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,576 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,576 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-03-14T04:43:51,577 to the `packages` configuration field. 2025-03-14T04:43:51,578 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,578 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,579 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,580 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,581 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,582 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-03-14T04:43:51,583 already explicitly excluding 'evalscope.registry.tasks' via 2025-03-14T04:43:51,584 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,584 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,585 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,586 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,587 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,589 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,589 even if it does not contain any `.py` files. 2025-03-14T04:43:51,590 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,590 directory, all directories are treated like packages. 2025-03-14T04:43:51,591 ******************************************************************************** 2025-03-14T04:43:51,592 !! 2025-03-14T04:43:51,592 check.warn(importable) 2025-03-14T04:43:51,593 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.third_party.thinkbench.resources' is absent from the `packages` configuration. 2025-03-14T04:43:51,593 !! 2025-03-14T04:43:51,594 ******************************************************************************** 2025-03-14T04:43:51,595 ############################ 2025-03-14T04:43:51,595 # Package would be ignored # 2025-03-14T04:43:51,596 ############################ 2025-03-14T04:43:51,596 Python recognizes 'evalscope.third_party.thinkbench.resources' as an importable package[^1], 2025-03-14T04:43:51,597 but it is absent from setuptools' `packages` configuration. 2025-03-14T04:43:51,598 This leads to an ambiguous overall configuration. If you want to distribute this 2025-03-14T04:43:51,598 package, please make sure that 'evalscope.third_party.thinkbench.resources' is explicitly added 2025-03-14T04:43:51,599 to the `packages` configuration field. 2025-03-14T04:43:51,600 Alternatively, you can also rely on setuptools' discovery methods 2025-03-14T04:43:51,601 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-03-14T04:43:51,601 instead of `find_packages(...)`/`find:`). 2025-03-14T04:43:51,602 You can read more about "package discovery" on setuptools documentation page: 2025-03-14T04:43:51,603 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-03-14T04:43:51,604 If you don't want 'evalscope.third_party.thinkbench.resources' to be distributed and are 2025-03-14T04:43:51,605 already explicitly excluding 'evalscope.third_party.thinkbench.resources' via 2025-03-14T04:43:51,606 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-03-14T04:43:51,606 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-03-14T04:43:51,607 combination with a more fine grained `package-data` configuration. 2025-03-14T04:43:51,608 You can read more about "package data files" on setuptools documentation page: 2025-03-14T04:43:51,609 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-03-14T04:43:51,610 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-03-14T04:43:51,611 even if it does not contain any `.py` files. 2025-03-14T04:43:51,611 On the other hand, currently there is no concept of package data 2025-03-14T04:43:51,612 directory, all directories are treated like packages. 2025-03-14T04:43:51,613 ******************************************************************************** 2025-03-14T04:43:51,617 !! 2025-03-14T04:43:51,622 check.warn(importable) 2025-03-14T04:43:51,625 creating build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,626 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,626 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,627 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,628 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,628 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,629 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,629 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,630 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,630 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,631 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,632 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-03-14T04:43:51,632 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,633 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,634 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,634 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,635 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,636 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,636 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,637 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,638 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,638 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,639 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,640 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,640 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,641 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,644 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,645 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,646 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,647 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,650 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,651 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,652 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,652 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,653 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,653 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,654 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,655 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,655 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,656 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:51,656 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:51,657 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:51,657 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:51,658 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:51,658 creating build/lib/evalscope/registry/config 2025-03-14T04:43:51,659 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-03-14T04:43:51,659 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-03-14T04:43:51,660 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-03-14T04:43:51,660 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-03-14T04:43:51,661 creating build/lib/evalscope/registry/data 2025-03-14T04:43:51,662 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-03-14T04:43:51,663 creating build/lib/evalscope/registry/data/prompt_template 2025-03-14T04:43:51,664 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-03-14T04:43:51,665 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-03-14T04:43:51,666 creating build/lib/evalscope/registry/data/qa_browser 2025-03-14T04:43:51,666 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-03-14T04:43:51,668 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-03-14T04:43:51,670 creating build/lib/evalscope/metrics/resources 2025-03-14T04:43:51,671 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-03-14T04:43:51,673 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-03-14T04:43:51,679 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:51,682 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:51,685 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-03-14T04:43:51,687 creating build/lib/evalscope/third_party/thinkbench/resources 2025-03-14T04:43:51,689 copying evalscope/third_party/thinkbench/resources/critique_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-03-14T04:43:51,691 copying evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-03-14T04:43:51,694 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:51,697 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:51,699 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:51,702 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-03-14T04:43:51,717 copying evalscope/benchmarks/process_bench/critique_template.txt -> build/lib/evalscope/benchmarks/process_bench 2025-03-14T04:43:51,720 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-03-14T04:43:51,723 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-03-14T04:43:51,725 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-03-14T04:43:51,728 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-03-14T04:43:51,731 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:51,733 copying evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:51,736 copying evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:51,739 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-03-14T04:43:51,740 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-03-14T04:43:51,743 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:51,744 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:51,747 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:51,804 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-14T04:43:51,805 !! 2025-03-14T04:43:51,806 ******************************************************************************** 2025-03-14T04:43:51,807 Please avoid running ``setup.py`` directly. 2025-03-14T04:43:51,807 Instead, use pypa/build, pypa/installer or other 2025-03-14T04:43:51,808 standards-based tools. 2025-03-14T04:43:51,809 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-14T04:43:51,810 ******************************************************************************** 2025-03-14T04:43:51,811 !! 2025-03-14T04:43:51,812 self.initialize_options() 2025-03-14T04:43:51,836 installing to build/bdist.linux-armv7l/wheel 2025-03-14T04:43:51,837 running install 2025-03-14T04:43:51,861 running install_lib 2025-03-14T04:43:51,890 creating build/bdist.linux-armv7l/wheel 2025-03-14T04:43:51,892 creating build/bdist.linux-armv7l/wheel/tests 2025-03-14T04:43:51,894 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-03-14T04:43:51,897 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-03-14T04:43:51,898 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-14T04:43:51,901 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-14T04:43:51,904 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-14T04:43:51,906 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-03-14T04:43:51,909 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-03-14T04:43:51,911 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-03-14T04:43:51,913 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-03-14T04:43:51,916 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-03-14T04:43:51,918 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-03-14T04:43:51,920 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-03-14T04:43:51,923 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-03-14T04:43:51,924 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-14T04:43:51,927 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-14T04:43:51,929 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-14T04:43:51,931 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-03-14T04:43:51,933 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-03-14T04:43:51,936 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-03-14T04:43:51,938 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-14T04:43:51,940 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-14T04:43:51,942 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-14T04:43:51,945 copying build/lib/tests/cli/test_all.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-03-14T04:43:51,948 creating build/bdist.linux-armv7l/wheel/evalscope 2025-03-14T04:43:51,950 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-03-14T04:43:51,952 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,955 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,957 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,960 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,962 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,965 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,967 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,970 copying build/lib/evalscope/models/register.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,972 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-03-14T04:43:51,975 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-03-14T04:43:51,977 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-14T04:43:51,980 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-14T04:43:51,982 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-03-14T04:43:51,984 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:51,987 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-03-14T04:43:51,989 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-03-14T04:43:51,991 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:51,994 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-03-14T04:43:51,995 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-14T04:43:51,998 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-14T04:43:52,001 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-03-14T04:43:52,003 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,006 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,008 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,011 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,012 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,014 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,018 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,020 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,022 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-03-14T04:43:52,024 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,026 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,029 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,031 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-03-14T04:43:52,034 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench 2025-03-14T04:43:52,036 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/tools 2025-03-14T04:43:52,037 copying build/lib/evalscope/third_party/thinkbench/tools/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-14T04:43:52,039 copying build/lib/evalscope/third_party/thinkbench/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-14T04:43:52,041 copying build/lib/evalscope/third_party/thinkbench/tools/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-03-14T04:43:52,043 copying build/lib/evalscope/third_party/thinkbench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-14T04:43:52,046 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/resources 2025-03-14T04:43:52,047 copying build/lib/evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-03-14T04:43:52,049 copying build/lib/evalscope/third_party/thinkbench/resources/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-03-14T04:43:52,051 copying build/lib/evalscope/third_party/thinkbench/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-14T04:43:52,054 copying build/lib/evalscope/third_party/thinkbench/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-03-14T04:43:52,055 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-03-14T04:43:52,058 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-03-14T04:43:52,059 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,061 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,063 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,065 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,067 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,070 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:52,071 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:52,073 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-03-14T04:43:52,075 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,077 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,080 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-03-14T04:43:52,083 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-03-14T04:43:52,084 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-14T04:43:52,086 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-14T04:43:52,088 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-14T04:43:52,090 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-14T04:43:52,093 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-03-14T04:43:52,096 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-03-14T04:43:52,097 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-14T04:43:52,100 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-14T04:43:52,101 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-03-14T04:43:52,104 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-03-14T04:43:52,105 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-03-14T04:43:52,108 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-03-14T04:43:52,111 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-03-14T04:43:52,112 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-03-14T04:43:52,114 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-03-14T04:43:52,116 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-03-14T04:43:52,119 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-03-14T04:43:52,120 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,123 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,125 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,127 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,130 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,132 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,133 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,135 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-03-14T04:43:52,138 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-03-14T04:43:52,139 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-14T04:43:52,141 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-14T04:43:52,143 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-14T04:43:52,145 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-14T04:43:52,147 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-03-14T04:43:52,150 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-14T04:43:52,151 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-14T04:43:52,154 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-03-14T04:43:52,155 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,157 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,160 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,161 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,164 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,166 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-03-14T04:43:52,169 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-14T04:43:52,171 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-14T04:43:52,174 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-03-14T04:43:52,176 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,179 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-03-14T04:43:52,181 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-03-14T04:43:52,182 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-14T04:43:52,184 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-14T04:43:52,186 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-14T04:43:52,188 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-03-14T04:43:52,191 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-03-14T04:43:52,192 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,194 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,195 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,197 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,199 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,201 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,202 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,204 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,206 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,208 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,210 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-03-14T04:43:52,211 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-03-14T04:43:52,214 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-03-14T04:43:52,215 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-03-14T04:43:52,218 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-03-14T04:43:52,219 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-03-14T04:43:52,222 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-03-14T04:43:52,245 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-03-14T04:43:52,246 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-03-14T04:43:52,248 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-03-14T04:43:52,251 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-03-14T04:43:52,252 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,255 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,257 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,259 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,261 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,263 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,265 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,266 copying build/lib/evalscope/utils/filters.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,268 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-03-14T04:43:52,271 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,274 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-03-14T04:43:52,275 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-03-14T04:43:52,276 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-03-14T04:43:52,279 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,280 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,282 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,285 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,287 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,289 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,291 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,293 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,295 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,297 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,299 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,301 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,303 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,304 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,306 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,308 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,310 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,312 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,314 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,316 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,318 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,319 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,321 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,323 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,325 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,327 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,329 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,330 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-03-14T04:43:52,332 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-03-14T04:43:52,335 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/musr 2025-03-14T04:43:52,336 copying build/lib/evalscope/benchmarks/musr/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-03-14T04:43:52,338 copying build/lib/evalscope/benchmarks/musr/musr_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-03-14T04:43:52,341 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:52,342 copying build/lib/evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:52,344 copying build/lib/evalscope/benchmarks/chinese_simple_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/chinese_simple_qa 2025-03-14T04:43:52,346 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-03-14T04:43:52,348 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-03-14T04:43:52,350 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-03-14T04:43:52,352 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-03-14T04:43:52,354 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-14T04:43:52,355 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-14T04:43:52,358 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-03-14T04:43:52,360 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-14T04:43:52,363 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-03-14T04:43:52,364 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-14T04:43:52,366 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-14T04:43:52,368 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-03-14T04:43:52,371 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/process_bench 2025-03-14T04:43:52,372 copying build/lib/evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-14T04:43:52,374 copying build/lib/evalscope/benchmarks/process_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-14T04:43:52,375 copying build/lib/evalscope/benchmarks/process_bench/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-03-14T04:43:52,378 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:52,379 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:52,381 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-03-14T04:43:52,384 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-03-14T04:43:52,385 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-14T04:43:52,387 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-14T04:43:52,389 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-03-14T04:43:52,392 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-03-14T04:43:52,393 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-14T04:43:52,395 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-14T04:43:52,397 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-03-14T04:43:52,400 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-03-14T04:43:52,401 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-14T04:43:52,403 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-14T04:43:52,405 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-03-14T04:43:52,408 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-03-14T04:43:52,409 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-03-14T04:43:52,411 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-03-14T04:43:52,414 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-03-14T04:43:52,415 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,417 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,419 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,422 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,424 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,426 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-03-14T04:43:52,429 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/data_collection 2025-03-14T04:43:52,430 copying build/lib/evalscope/benchmarks/data_collection/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-03-14T04:43:52,431 copying build/lib/evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-03-14T04:43:52,434 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/aime 2025-03-14T04:43:52,435 copying build/lib/evalscope/benchmarks/aime/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-14T04:43:52,436 copying build/lib/evalscope/benchmarks/aime/aime25_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-14T04:43:52,438 copying build/lib/evalscope/benchmarks/aime/aime24_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-03-14T04:43:52,441 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,442 copying build/lib/evalscope/benchmarks/live_code_bench/load_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,444 copying build/lib/evalscope/benchmarks/live_code_bench/pass_k_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,446 copying build/lib/evalscope/benchmarks/live_code_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,447 copying build/lib/evalscope/benchmarks/live_code_bench/execute_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,449 copying build/lib/evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,451 copying build/lib/evalscope/benchmarks/live_code_bench/evaluate_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,454 copying build/lib/evalscope/benchmarks/live_code_bench/testing_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,456 copying build/lib/evalscope/benchmarks/live_code_bench/extract_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,458 copying build/lib/evalscope/benchmarks/live_code_bench/prompts.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-03-14T04:43:52,460 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-14T04:43:52,463 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-03-14T04:43:52,465 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-14T04:43:52,467 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-14T04:43:52,469 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-03-14T04:43:52,472 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-03-14T04:43:52,473 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-14T04:43:52,474 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-14T04:43:52,477 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-03-14T04:43:52,479 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/simple_qa 2025-03-14T04:43:52,480 copying build/lib/evalscope/benchmarks/simple_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-03-14T04:43:52,482 copying build/lib/evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-03-14T04:43:52,485 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-03-14T04:43:52,486 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-14T04:43:52,488 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-14T04:43:52,490 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-14T04:43:52,492 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-03-14T04:43:52,494 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-03-14T04:43:52,495 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-14T04:43:52,498 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-14T04:43:52,500 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-14T04:43:52,501 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-03-14T04:43:52,504 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/math_500 2025-03-14T04:43:52,505 copying build/lib/evalscope/benchmarks/math_500/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-03-14T04:43:52,507 copying build/lib/evalscope/benchmarks/math_500/math_500_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-03-14T04:43:52,510 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-03-14T04:43:52,511 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-14T04:43:52,514 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-14T04:43:52,515 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-03-14T04:43:52,518 copying build/lib/evalscope/benchmarks/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-14T04:43:52,520 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-03-14T04:43:52,521 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-14T04:43:52,523 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-14T04:43:52,525 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-14T04:43:52,527 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-03-14T04:43:52,529 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-03-14T04:43:52,531 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-14T04:43:52,533 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-14T04:43:52,534 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-14T04:43:52,537 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-03-14T04:43:52,539 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,540 copying build/lib/evalscope/benchmarks/super_gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,542 copying build/lib/evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,543 copying build/lib/evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,546 copying build/lib/evalscope/benchmarks/super_gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,547 copying build/lib/evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-03-14T04:43:52,550 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_mcq 2025-03-14T04:43:52,551 copying build/lib/evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-03-14T04:43:52,554 copying build/lib/evalscope/benchmarks/general_mcq/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-03-14T04:43:52,555 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-03-14T04:43:52,557 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,560 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-03-14T04:43:52,561 copying build/lib/evalscope/metrics/llm_judge.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,563 copying build/lib/evalscope/metrics/math_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,566 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,568 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,571 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-03-14T04:43:52,572 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-03-14T04:43:52,593 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-03-14T04:43:52,603 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,606 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,608 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:52,610 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:52,612 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-03-14T04:43:52,615 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-03-14T04:43:52,618 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,620 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-03-14T04:43:52,621 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-14T04:43:52,624 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-14T04:43:52,626 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-14T04:43:52,628 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-03-14T04:43:52,631 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-03-14T04:43:52,632 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,634 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,635 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,638 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,639 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,641 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,643 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-03-14T04:43:52,645 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,647 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,650 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-03-14T04:43:52,652 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-03-14T04:43:52,653 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-03-14T04:43:52,655 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-03-14T04:43:52,657 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,659 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,661 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,663 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,665 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,667 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-03-14T04:43:52,669 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-14T04:43:52,671 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-14T04:43:52,673 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-03-14T04:43:52,675 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-03-14T04:43:52,677 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-03-14T04:43:52,679 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:52,681 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,683 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,685 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,686 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,688 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,691 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,693 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,695 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,697 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-03-14T04:43:52,699 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:52,701 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:52,703 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:52,705 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-03-14T04:43:52,707 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:52,709 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:52,710 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:52,712 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:52,714 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:52,716 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-03-14T04:43:52,718 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:52,720 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:52,722 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:52,724 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:52,726 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:52,727 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-03-14T04:43:52,730 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-03-14T04:43:52,734 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,735 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,737 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,739 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,741 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,742 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-03-14T04:43:52,745 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-03-14T04:43:52,746 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-03-14T04:43:52,749 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-03-14T04:43:52,750 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-14T04:43:52,751 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-14T04:43:52,754 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-03-14T04:43:52,758 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-03-14T04:43:52,760 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-03-14T04:43:52,762 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-14T04:43:52,766 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-14T04:43:52,768 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-03-14T04:43:52,771 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-14T04:43:52,774 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-14T04:43:52,776 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-03-14T04:43:52,780 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-03-14T04:43:52,782 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-03-14T04:43:52,785 running install_egg_info 2025-03-14T04:43:52,833 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.13.0-py3.11.egg-info 2025-03-14T04:43:52,852 running install_scripts 2025-03-14T04:43:52,908 creating build/bdist.linux-armv7l/wheel/evalscope-0.13.0.dist-info/WHEEL 2025-03-14T04:43:52,911 creating '/tmp/pip-wheel-39y19j61/evalscope-0.13.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-03-14T04:43:52,914 adding 'evalscope/__init__.py' 2025-03-14T04:43:52,915 adding 'evalscope/arguments.py' 2025-03-14T04:43:52,917 adding 'evalscope/config.py' 2025-03-14T04:43:52,919 adding 'evalscope/constants.py' 2025-03-14T04:43:52,920 adding 'evalscope/run.py' 2025-03-14T04:43:52,922 adding 'evalscope/run_arena.py' 2025-03-14T04:43:52,924 adding 'evalscope/summarizer.py' 2025-03-14T04:43:52,925 adding 'evalscope/version.py' 2025-03-14T04:43:52,927 adding 'evalscope/backend/__init__.py' 2025-03-14T04:43:52,928 adding 'evalscope/backend/base.py' 2025-03-14T04:43:52,930 adding 'evalscope/backend/opencompass/__init__.py' 2025-03-14T04:43:52,931 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-03-14T04:43:52,933 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-03-14T04:43:52,934 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-03-14T04:43:52,935 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-03-14T04:43:52,936 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-03-14T04:43:52,938 adding 'evalscope/backend/rag_eval/__init__.py' 2025-03-14T04:43:52,939 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-03-14T04:43:52,941 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-03-14T04:43:52,942 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-03-14T04:43:52,944 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-03-14T04:43:52,945 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-03-14T04:43:52,947 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-03-14T04:43:52,948 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-03-14T04:43:52,950 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-03-14T04:43:52,951 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-03-14T04:43:52,954 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-03-14T04:43:52,955 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-03-14T04:43:52,956 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-03-14T04:43:52,958 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-03-14T04:43:52,959 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-03-14T04:43:52,960 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-03-14T04:43:52,962 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-03-14T04:43:52,964 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-03-14T04:43:52,965 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-03-14T04:43:52,967 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-03-14T04:43:52,968 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-03-14T04:43:52,970 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-03-14T04:43:52,971 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-03-14T04:43:52,973 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-03-14T04:43:52,974 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-03-14T04:43:52,976 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-03-14T04:43:52,977 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-03-14T04:43:52,979 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-03-14T04:43:52,980 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-03-14T04:43:52,982 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-03-14T04:43:52,983 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-03-14T04:43:52,985 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-03-14T04:43:52,986 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-03-14T04:43:52,987 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-03-14T04:43:52,989 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-03-14T04:43:52,991 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-03-14T04:43:52,992 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-03-14T04:43:52,993 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-03-14T04:43:52,995 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-03-14T04:43:52,996 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-03-14T04:43:52,998 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-03-14T04:43:53,000 adding 'evalscope/benchmarks/__init__.py' 2025-03-14T04:43:53,001 adding 'evalscope/benchmarks/benchmark.py' 2025-03-14T04:43:53,003 adding 'evalscope/benchmarks/data_adapter.py' 2025-03-14T04:43:53,005 adding 'evalscope/benchmarks/utils.py' 2025-03-14T04:43:53,006 adding 'evalscope/benchmarks/aime/__init__.py' 2025-03-14T04:43:53,007 adding 'evalscope/benchmarks/aime/aime24_adapter.py' 2025-03-14T04:43:53,008 adding 'evalscope/benchmarks/aime/aime25_adapter.py' 2025-03-14T04:43:53,010 adding 'evalscope/benchmarks/arc/__init__.py' 2025-03-14T04:43:53,011 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-03-14T04:43:53,013 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-03-14T04:43:53,014 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-03-14T04:43:53,016 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-03-14T04:43:53,018 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-03-14T04:43:53,020 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-03-14T04:43:53,021 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-03-14T04:43:53,022 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-03-14T04:43:53,024 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-03-14T04:43:53,025 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-03-14T04:43:53,027 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-03-14T04:43:53,028 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-03-14T04:43:53,029 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-03-14T04:43:53,030 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-03-14T04:43:53,032 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-03-14T04:43:53,033 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-03-14T04:43:53,034 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-03-14T04:43:53,036 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-03-14T04:43:53,037 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-03-14T04:43:53,038 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-03-14T04:43:53,039 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-03-14T04:43:53,041 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-03-14T04:43:53,042 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-03-14T04:43:53,044 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-03-14T04:43:53,045 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-03-14T04:43:53,046 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-03-14T04:43:53,047 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-03-14T04:43:53,048 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-03-14T04:43:53,050 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-03-14T04:43:53,051 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-03-14T04:43:53,052 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-03-14T04:43:53,054 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-03-14T04:43:53,056 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-03-14T04:43:53,058 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-03-14T04:43:53,059 adding 'evalscope/benchmarks/chinese_simple_qa/__init__.py' 2025-03-14T04:43:53,061 adding 'evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py' 2025-03-14T04:43:53,062 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-03-14T04:43:53,064 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-03-14T04:43:53,066 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-03-14T04:43:53,067 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-03-14T04:43:53,069 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-03-14T04:43:53,070 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-03-14T04:43:53,072 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-03-14T04:43:53,074 adding 'evalscope/benchmarks/data_collection/__init__.py' 2025-03-14T04:43:53,075 adding 'evalscope/benchmarks/data_collection/data_collection_adapter.py' 2025-03-14T04:43:53,076 adding 'evalscope/benchmarks/general_mcq/__init__.py' 2025-03-14T04:43:53,078 adding 'evalscope/benchmarks/general_mcq/general_mcq_adapter.py' 2025-03-14T04:43:53,079 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-03-14T04:43:53,081 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-03-14T04:43:53,082 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-03-14T04:43:53,084 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-03-14T04:43:53,085 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-03-14T04:43:53,087 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-03-14T04:43:53,088 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-03-14T04:43:53,090 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-03-14T04:43:53,092 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-03-14T04:43:53,093 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-03-14T04:43:53,095 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-03-14T04:43:53,096 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-03-14T04:43:53,098 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-03-14T04:43:53,099 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-03-14T04:43:53,101 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-03-14T04:43:53,103 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-03-14T04:43:53,108 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-03-14T04:43:53,110 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-03-14T04:43:53,113 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-03-14T04:43:53,115 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-03-14T04:43:53,116 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-03-14T04:43:53,118 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-03-14T04:43:53,119 adding 'evalscope/benchmarks/live_code_bench/__init__.py' 2025-03-14T04:43:53,121 adding 'evalscope/benchmarks/live_code_bench/evaluate_utils.py' 2025-03-14T04:43:53,123 adding 'evalscope/benchmarks/live_code_bench/execute_utils.py' 2025-03-14T04:43:53,124 adding 'evalscope/benchmarks/live_code_bench/extract_utils.py' 2025-03-14T04:43:53,125 adding 'evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py' 2025-03-14T04:43:53,127 adding 'evalscope/benchmarks/live_code_bench/load_utils.py' 2025-03-14T04:43:53,128 adding 'evalscope/benchmarks/live_code_bench/pass_k_utils.py' 2025-03-14T04:43:53,130 adding 'evalscope/benchmarks/live_code_bench/prompts.py' 2025-03-14T04:43:53,133 adding 'evalscope/benchmarks/live_code_bench/testing_util.py' 2025-03-14T04:43:53,135 adding 'evalscope/benchmarks/math_500/__init__.py' 2025-03-14T04:43:53,136 adding 'evalscope/benchmarks/math_500/math_500_adapter.py' 2025-03-14T04:43:53,138 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-03-14T04:43:53,140 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-03-14T04:43:53,142 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-03-14T04:43:53,143 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-03-14T04:43:53,145 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-03-14T04:43:53,146 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-03-14T04:43:53,148 adding 'evalscope/benchmarks/musr/__init__.py' 2025-03-14T04:43:53,150 adding 'evalscope/benchmarks/musr/musr_adapter.py' 2025-03-14T04:43:53,151 adding 'evalscope/benchmarks/process_bench/__init__.py' 2025-03-14T04:43:53,152 adding 'evalscope/benchmarks/process_bench/critique_template.txt' 2025-03-14T04:43:53,154 adding 'evalscope/benchmarks/process_bench/process_bench_adapter.py' 2025-03-14T04:43:53,155 adding 'evalscope/benchmarks/race/__init__.py' 2025-03-14T04:43:53,157 adding 'evalscope/benchmarks/race/race.py' 2025-03-14T04:43:53,158 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-03-14T04:43:53,159 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-03-14T04:43:53,161 adding 'evalscope/benchmarks/simple_qa/__init__.py' 2025-03-14T04:43:53,163 adding 'evalscope/benchmarks/simple_qa/simple_qa_adapter.py' 2025-03-14T04:43:53,164 adding 'evalscope/benchmarks/super_gpqa/__init__.py' 2025-03-14T04:43:53,166 adding 'evalscope/benchmarks/super_gpqa/five_shot_prompt.txt' 2025-03-14T04:43:53,167 adding 'evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py' 2025-03-14T04:43:53,169 adding 'evalscope/benchmarks/super_gpqa/utils.py' 2025-03-14T04:43:53,170 adding 'evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt' 2025-03-14T04:43:53,172 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-03-14T04:43:53,173 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-03-14T04:43:53,174 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-03-14T04:43:53,176 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-03-14T04:43:53,177 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-03-14T04:43:53,179 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-03-14T04:43:53,181 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-03-14T04:43:53,182 adding 'evalscope/cli/__init__.py' 2025-03-14T04:43:53,183 adding 'evalscope/cli/base.py' 2025-03-14T04:43:53,185 adding 'evalscope/cli/cli.py' 2025-03-14T04:43:53,186 adding 'evalscope/cli/start_app.py' 2025-03-14T04:43:53,187 adding 'evalscope/cli/start_eval.py' 2025-03-14T04:43:53,188 adding 'evalscope/cli/start_perf.py' 2025-03-14T04:43:53,190 adding 'evalscope/cli/start_server.py' 2025-03-14T04:43:53,191 adding 'evalscope/collections/__init__.py' 2025-03-14T04:43:53,193 adding 'evalscope/collections/evaluator.py' 2025-03-14T04:43:53,195 adding 'evalscope/collections/sampler.py' 2025-03-14T04:43:53,196 adding 'evalscope/collections/schema.py' 2025-03-14T04:43:53,198 adding 'evalscope/evaluator/__init__.py' 2025-03-14T04:43:53,200 adding 'evalscope/evaluator/evaluator.py' 2025-03-14T04:43:53,202 adding 'evalscope/evaluator/rating_eval.py' 2025-03-14T04:43:53,203 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-03-14T04:43:53,206 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-03-14T04:43:53,208 adding 'evalscope/metrics/__init__.py' 2025-03-14T04:43:53,209 adding 'evalscope/metrics/code_metric.py' 2025-03-14T04:43:53,210 adding 'evalscope/metrics/llm_judge.py' 2025-03-14T04:43:53,213 adding 'evalscope/metrics/math_parser.py' 2025-03-14T04:43:53,215 adding 'evalscope/metrics/metrics.py' 2025-03-14T04:43:53,216 adding 'evalscope/metrics/named_metrics.py' 2025-03-14T04:43:53,218 adding 'evalscope/metrics/rouge_metric.py' 2025-03-14T04:43:53,220 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-03-14T04:43:53,222 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-03-14T04:43:53,380 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-03-14T04:43:53,625 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-03-14T04:43:53,635 adding 'evalscope/models/__init__.py' 2025-03-14T04:43:53,636 adding 'evalscope/models/base_adapter.py' 2025-03-14T04:43:53,638 adding 'evalscope/models/chat_adapter.py' 2025-03-14T04:43:53,639 adding 'evalscope/models/choice_adapter.py' 2025-03-14T04:43:53,641 adding 'evalscope/models/custom_adapter.py' 2025-03-14T04:43:53,642 adding 'evalscope/models/local_model.py' 2025-03-14T04:43:53,643 adding 'evalscope/models/model.py' 2025-03-14T04:43:53,644 adding 'evalscope/models/register.py' 2025-03-14T04:43:53,646 adding 'evalscope/models/server_adapter.py' 2025-03-14T04:43:53,647 adding 'evalscope/models/custom/__init__.py' 2025-03-14T04:43:53,648 adding 'evalscope/models/custom/custom_model.py' 2025-03-14T04:43:53,650 adding 'evalscope/models/custom/dummy_model.py' 2025-03-14T04:43:53,651 adding 'evalscope/perf/__init__.py' 2025-03-14T04:43:53,653 adding 'evalscope/perf/arguments.py' 2025-03-14T04:43:53,655 adding 'evalscope/perf/benchmark.py' 2025-03-14T04:43:53,656 adding 'evalscope/perf/http_client.py' 2025-03-14T04:43:53,657 adding 'evalscope/perf/main.py' 2025-03-14T04:43:53,659 adding 'evalscope/perf/plugin/__init__.py' 2025-03-14T04:43:53,660 adding 'evalscope/perf/plugin/registry.py' 2025-03-14T04:43:53,662 adding 'evalscope/perf/plugin/api/__init__.py' 2025-03-14T04:43:53,663 adding 'evalscope/perf/plugin/api/base.py' 2025-03-14T04:43:53,665 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-03-14T04:43:53,666 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-03-14T04:43:53,667 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-03-14T04:43:53,669 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-03-14T04:43:53,670 adding 'evalscope/perf/plugin/datasets/base.py' 2025-03-14T04:43:53,672 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-03-14T04:43:53,673 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-03-14T04:43:53,674 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-03-14T04:43:53,675 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-03-14T04:43:53,676 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-03-14T04:43:53,678 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-03-14T04:43:53,679 adding 'evalscope/perf/utils/__init__.py' 2025-03-14T04:43:53,681 adding 'evalscope/perf/utils/analysis_result.py' 2025-03-14T04:43:53,682 adding 'evalscope/perf/utils/benchmark_util.py' 2025-03-14T04:43:53,684 adding 'evalscope/perf/utils/db_util.py' 2025-03-14T04:43:53,685 adding 'evalscope/perf/utils/handler.py' 2025-03-14T04:43:53,687 adding 'evalscope/perf/utils/local_server.py' 2025-03-14T04:43:53,688 adding 'evalscope/registry/__init__.py' 2025-03-14T04:43:53,690 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-03-14T04:43:53,691 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-03-14T04:43:53,693 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-03-14T04:43:53,694 adding 'evalscope/registry/config/cfg_single.yaml' 2025-03-14T04:43:53,697 adding 'evalscope/registry/data/question.jsonl' 2025-03-14T04:43:53,699 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-03-14T04:43:53,700 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-03-14T04:43:53,864 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-03-14T04:43:53,872 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-03-14T04:43:53,874 adding 'evalscope/registry/tasks/arc.yaml' 2025-03-14T04:43:53,875 adding 'evalscope/registry/tasks/bbh.yaml' 2025-03-14T04:43:53,876 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-03-14T04:43:53,878 adding 'evalscope/registry/tasks/ceval.yaml' 2025-03-14T04:43:53,879 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-03-14T04:43:53,880 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-03-14T04:43:53,881 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-03-14T04:43:53,883 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-03-14T04:43:53,884 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-03-14T04:43:53,885 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-03-14T04:43:53,886 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-03-14T04:43:53,888 adding 'evalscope/report/__init__.py' 2025-03-14T04:43:53,891 adding 'evalscope/report/app.py' 2025-03-14T04:43:53,893 adding 'evalscope/report/combinator.py' 2025-03-14T04:43:53,894 adding 'evalscope/report/generator.py' 2025-03-14T04:43:53,895 adding 'evalscope/report/utils.py' 2025-03-14T04:43:53,897 adding 'evalscope/third_party/__init__.py' 2025-03-14T04:43:53,899 adding 'evalscope/third_party/longbench_write/README.md' 2025-03-14T04:43:53,900 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-03-14T04:43:53,901 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-03-14T04:43:53,902 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-03-14T04:43:53,904 adding 'evalscope/third_party/longbench_write/eval.py' 2025-03-14T04:43:53,905 adding 'evalscope/third_party/longbench_write/infer.py' 2025-03-14T04:43:53,906 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-03-14T04:43:53,908 adding 'evalscope/third_party/longbench_write/utils.py' 2025-03-14T04:43:53,909 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-03-14T04:43:53,910 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-03-14T04:43:53,918 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-03-14T04:43:53,922 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-03-14T04:43:53,924 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-03-14T04:43:53,925 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-03-14T04:43:53,927 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-03-14T04:43:53,928 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-03-14T04:43:53,930 adding 'evalscope/third_party/thinkbench/__init__.py' 2025-03-14T04:43:53,932 adding 'evalscope/third_party/thinkbench/eval.py' 2025-03-14T04:43:53,934 adding 'evalscope/third_party/thinkbench/infer.py' 2025-03-14T04:43:53,935 adding 'evalscope/third_party/thinkbench/resources/critique_template.txt' 2025-03-14T04:43:53,937 adding 'evalscope/third_party/thinkbench/resources/reformat_template.txt' 2025-03-14T04:43:53,938 adding 'evalscope/third_party/thinkbench/tools/__init__.py' 2025-03-14T04:43:53,940 adding 'evalscope/third_party/thinkbench/tools/llm.py' 2025-03-14T04:43:53,941 adding 'evalscope/third_party/thinkbench/tools/utils.py' 2025-03-14T04:43:53,943 adding 'evalscope/third_party/toolbench_static/README.md' 2025-03-14T04:43:53,944 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-03-14T04:43:53,945 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-03-14T04:43:53,946 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-03-14T04:43:53,948 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-03-14T04:43:53,950 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-03-14T04:43:53,951 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-03-14T04:43:53,952 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-03-14T04:43:53,954 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-03-14T04:43:53,955 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-03-14T04:43:53,957 adding 'evalscope/utils/__init__.py' 2025-03-14T04:43:53,959 adding 'evalscope/utils/arena_utils.py' 2025-03-14T04:43:53,960 adding 'evalscope/utils/chat_service.py' 2025-03-14T04:43:53,962 adding 'evalscope/utils/completion_parsers.py' 2025-03-14T04:43:53,964 adding 'evalscope/utils/filters.py' 2025-03-14T04:43:53,965 adding 'evalscope/utils/io_utils.py' 2025-03-14T04:43:53,966 adding 'evalscope/utils/logger.py' 2025-03-14T04:43:53,967 adding 'evalscope/utils/model_utils.py' 2025-03-14T04:43:53,969 adding 'evalscope/utils/utils.py' 2025-03-14T04:43:53,972 adding 'tests/__init__.py' 2025-03-14T04:43:53,973 adding 'tests/test_run_all.py' 2025-03-14T04:43:53,974 adding 'tests/cli/__init__.py' 2025-03-14T04:43:53,976 adding 'tests/cli/test_all.py' 2025-03-14T04:43:53,977 adding 'tests/cli/test_collection.py' 2025-03-14T04:43:53,979 adding 'tests/cli/test_run.py' 2025-03-14T04:43:53,980 adding 'tests/perf/__init__.py' 2025-03-14T04:43:53,982 adding 'tests/perf/test_perf.py' 2025-03-14T04:43:53,983 adding 'tests/rag/__init__.py' 2025-03-14T04:43:53,984 adding 'tests/rag/test_clip_benchmark.py' 2025-03-14T04:43:53,986 adding 'tests/rag/test_mteb.py' 2025-03-14T04:43:53,987 adding 'tests/rag/test_ragas.py' 2025-03-14T04:43:53,988 adding 'tests/swift/__init__.py' 2025-03-14T04:43:53,990 adding 'tests/swift/test_run_swift_eval.py' 2025-03-14T04:43:53,991 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-03-14T04:43:53,992 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-03-14T04:43:53,994 adding 'tests/vlm/__init__.py' 2025-03-14T04:43:53,995 adding 'tests/vlm/test_vlmeval.py' 2025-03-14T04:43:53,997 adding 'evalscope-0.13.0.dist-info/LICENSE' 2025-03-14T04:43:54,001 adding 'evalscope-0.13.0.dist-info/METADATA' 2025-03-14T04:43:54,002 adding 'evalscope-0.13.0.dist-info/WHEEL' 2025-03-14T04:43:54,003 adding 'evalscope-0.13.0.dist-info/entry_points.txt' 2025-03-14T04:43:54,004 adding 'evalscope-0.13.0.dist-info/top_level.txt' 2025-03-14T04:43:54,009 adding 'evalscope-0.13.0.dist-info/RECORD' 2025-03-14T04:43:54,028 removing build/bdist.linux-armv7l/wheel 2025-03-14T04:43:54,239 Building wheel for evalscope (setup.py): finished with status 'done' 2025-03-14T04:43:54,256 Created wheel for evalscope: filename=evalscope-0.13.0-py3-none-any.whl size=1496943 sha256=8ca93c4011f04e35df239b5486248e03100a9c9e265664e01330ef4b1cc691f7 2025-03-14T04:43:54,257 Stored in directory: /tmp/pip-ephem-wheel-cache-yddiw49_/wheels/ee/cd/5a/74892abcc65ac86bf2b7cd3caa10c5061abfb6ba6dfe1b950a 2025-03-14T04:43:54,287 Successfully built evalscope 2025-03-14T04:43:54,330 Removed build tracker: '/tmp/pip-build-tracker-oslgugu9'