2025-04-01T13:23:06,792 Created temporary directory: /tmp/pip-build-tracker-14ddgcd6 2025-04-01T13:23:06,793 Initialized build tracking at /tmp/pip-build-tracker-14ddgcd6 2025-04-01T13:23:06,793 Created build tracker: /tmp/pip-build-tracker-14ddgcd6 2025-04-01T13:23:06,794 Entered build tracker: /tmp/pip-build-tracker-14ddgcd6 2025-04-01T13:23:06,795 Created temporary directory: /tmp/pip-wheel-uxa9rl15 2025-04-01T13:23:06,799 Created temporary directory: /tmp/pip-ephem-wheel-cache-9hg0_ymj 2025-04-01T13:23:06,843 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-04-01T13:23:06,846 2 location(s) to search for versions of evalscope: 2025-04-01T13:23:06,846 * https://pypi.org/simple/evalscope/ 2025-04-01T13:23:06,846 * https://www.piwheels.org/simple/evalscope/ 2025-04-01T13:23:06,847 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/ 2025-04-01T13:23:06,848 Getting page https://pypi.org/simple/evalscope/ 2025-04-01T13:23:06,849 Found index url https://pypi.org/simple/ 2025-04-01T13:23:07,070 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json 2025-04-01T13:23:07,080 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,081 Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0 2025-04-01T13:23:07,082 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,083 Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0 2025-04-01T13:23:07,083 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,084 Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2 2025-04-01T13:23:07,085 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,086 Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3 2025-04-01T13:23:07,087 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,088 Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4 2025-04-01T13:23:07,089 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,089 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,091 Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1 2025-04-01T13:23:07,091 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,092 Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5 2025-04-01T13:23:07,093 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,093 Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0 2025-04-01T13:23:07,094 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,095 Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0 2025-04-01T13:23:07,095 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,096 Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1 2025-04-01T13:23:07,097 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,098 Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0 2025-04-01T13:23:07,099 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,100 Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1 2025-04-01T13:23:07,100 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/23/acbcbc2ed6f00d3bb81220054651e6a2b1b02714d42b1aeb018a2f5574c4/evalscope-0.7.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,101 Found link https://files.pythonhosted.org/packages/a4/38/9126b9329cd2ad6ccfd4a73f04402bf71b65921564c3c12cb0d62b3b421d/evalscope-0.7.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.2 2025-04-01T13:23:07,102 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/1f/9598183da3026696adc19a6727a19d57f9abbf4fd7aeb20cdf12faee7693/evalscope-0.8.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,103 Found link https://files.pythonhosted.org/packages/63/7e/fc44d30e3a83dbc3070396d78279c9e3e8716cbc4cc05811a70f1b463bfb/evalscope-0.8.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.0 2025-04-01T13:23:07,104 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/37/a9/a9c6cda95a6b837c9303e9a1598999f2c4e605abb507365c6ff70b372a5a/evalscope-0.8.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,105 Found link https://files.pythonhosted.org/packages/63/5a/bbc230bb06a7bc40dd3985dde4615a8a71f111bf95761e40f6f0f8a7e1a6/evalscope-0.8.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.1 2025-04-01T13:23:07,105 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/07/39/a1eb2efed77d21e8253daa37f082669a004c4d288813a2ee9e15398f2e80/evalscope-0.8.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,106 Found link https://files.pythonhosted.org/packages/57/bc/5ff6d538e459d8b3c567577c991eec72ab6adbc19497dc164d96cd634d2f/evalscope-0.8.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.8.2 2025-04-01T13:23:07,107 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f6/29/81a188c03b272bf7def0c9bb556b9e9465adbc68ecb18907b636f1e8cbd7/evalscope-0.9.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,108 Found link https://files.pythonhosted.org/packages/c0/c2/19da3be1fbd6b548ecdc877d47269e92503518de53acbbfe96120c5c9753/evalscope-0.9.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.9.0 2025-04-01T13:23:07,108 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d9/6d/45d7407f31d6878494c3b493d7e49a8318b1839161839293c1a2e66aadcf/evalscope-0.10.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,109 Found link https://files.pythonhosted.org/packages/16/b1/b6cef37a0dd0acfa5873ca4763ac6b4ac4b19a0b15ca6bdc8f30d4443682/evalscope-0.10.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.0 2025-04-01T13:23:07,110 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a7/8f/907045290d359b4e07e7acc96ec60173380748b49e9f3c91b7ddd8e8342d/evalscope-0.10.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,111 Found link https://files.pythonhosted.org/packages/e3/d3/dda2ac0513904bff8aa0c2efe77bc851d3acc6d514707db36648e4a903d2/evalscope-0.10.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.10.1 2025-04-01T13:23:07,112 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/d6/e5/852326943d86c85b5ca6b548a5f3753c217b771d93968c61ec2ca46ee0b1/evalscope-0.11.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,113 Found link https://files.pythonhosted.org/packages/5f/3f/e2816b99487b4ead257453a242b5282a85881f9d26fbb5efb21cc5cf88fa/evalscope-0.11.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.11.0 2025-04-01T13:23:07,113 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7d/8e/f9eceecf8bc7d740603f915eef7fab3e9d657a01f5de2c523e531445299c/evalscope-0.12.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,114 Found link https://files.pythonhosted.org/packages/33/82/7765517ff80a73eac7465369767aa45a5be3d5e0fb7c4f4a3ff743811f8c/evalscope-0.12.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.0 2025-04-01T13:23:07,115 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ee/4c/84a5e18985e149eb4283fef2b58a81ff2cec2d099c017684938ec3a3935f/evalscope-0.12.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,116 Found link https://files.pythonhosted.org/packages/b2/24/83b5530319bdb02142289e04640c6008dda1b988043c42feb7f0a5eab3b7/evalscope-0.12.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.12.1 2025-04-01T13:23:07,116 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/a5/65faf0660cd8ae2660354b002b2b3a586b9419bc894120fea97efd506cb6/evalscope-0.13.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,117 Found link https://files.pythonhosted.org/packages/d0/39/d5eb469a94191760c61d1bfcb235e28be1d2a080d88b44792f53d76c45d1/evalscope-0.13.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.13.0 2025-04-01T13:23:07,118 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/f7/fc/91b7b4379131d2e15ca1f575f533daea589357293e492ef2c93e0aac6b55/evalscope-0.13.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,119 Found link https://files.pythonhosted.org/packages/9e/a3/33b4ce270d5500fe7c8f32fa2160749b607f248141328d4785b6032c8f2a/evalscope-0.13.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.13.1 2025-04-01T13:23:07,119 Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/e6/66/83752c305879cf3dea54170398839ab08a046485bc18c41a34f41aca11ab/evalscope-0.13.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,120 Found link https://files.pythonhosted.org/packages/b7/8d/711ae30b80329e2dd7da760c001d9a5b45e4d8e5292f317f1ea10c744c29/evalscope-0.13.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.13.2 2025-04-01T13:23:07,121 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/ 2025-04-01T13:23:07,122 Getting page https://www.piwheels.org/simple/evalscope/ 2025-04-01T13:23:07,123 Found index url https://www.piwheels.org/simple/ 2025-04-01T13:23:07,311 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html 2025-04-01T13:23:07,316 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.13.1-py3-none-any.whl#sha256=6b26f11daca05d6b56da3cb1b78ea0a8f28de94901b7520171c66e2a16b1c638 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,317 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.13.0-py3-none-any.whl#sha256=8ca93c4011f04e35df239b5486248e03100a9c9e265664e01330ef4b1cc691f7 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,317 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.12.1-py3-none-any.whl#sha256=72e5815923789c6cab6c32425477393bf645f670edcc493f8e4dec6e93f3da23 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,318 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.12.0-py3-none-any.whl#sha256=f26c7317a5bacac8527806723d45bac74563a2608ed761d822ace03be3a5e45f (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,318 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.11.0-py3-none-any.whl#sha256=6e7d3242c5bf97b54d24644a1300575fdf41c1d90eef7c1344c20bf0d1518671 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,319 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.1-py3-none-any.whl#sha256=a7e645410333c1aaec5a024be4c02166dfb0d6b4635b020c181ce672d31102d2 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,320 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.10.0-py3-none-any.whl#sha256=494f1742178def5f86e552c004562c877cd8b8b6f5d4267d29f961f20e8bf569 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,321 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.9.0-py3-none-any.whl#sha256=26fd59fd387850f3e84f995fd38357994460e71d0124bc09954ca8837027ec52 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,321 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.2-py3-none-any.whl#sha256=3c4ed25b5c39d7a706927607e552e6ced6d50532bc442bba74979f70720f4894 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,322 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.1-py3-none-any.whl#sha256=64e9306453082a95b0c0507d6fd1dbf50ed0ab210ebcfebdcb52c534769d1856 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,322 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.8.0-py3-none-any.whl#sha256=7758550ef3406d9c6096de05909cc1c97ed0c2f7be6edaf3fe5344244e34f233 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,323 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.2-py3-none-any.whl#sha256=21a1f4448ffca926853b7516b6375f801ef6a8067501dde546e7d794fb759f20 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,323 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.1-py3-none-any.whl#sha256=b959f2d9850544f2d96ac765b06ed112cf579a11899618fcc5245407f4e33843 (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,324 Skipping link: No binaries permitted for evalscope: https://www.piwheels.org/simple/evalscope/evalscope-0.7.0-py3-none-any.whl#sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc (from https://www.piwheels.org/simple/evalscope/) (requires-python:>=3.8) 2025-04-01T13:23:07,325 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/ 2025-04-01T13:23:07,326 Skipping link: not a file: https://pypi.org/simple/evalscope/ 2025-04-01T13:23:07,348 Given no hashes to check 1 links for project 'evalscope': discarding no candidates 2025-04-01T13:23:07,350 Collecting evalscope==0.13.2 2025-04-01T13:23:07,352 Created temporary directory: /tmp/pip-unpack-1nw5nm6o 2025-04-01T13:23:07,573 Downloading evalscope-0.13.2.tar.gz (1.4 MB) 2025-04-01T13:23:08,754 Added evalscope==0.13.2 from https://files.pythonhosted.org/packages/b7/8d/711ae30b80329e2dd7da760c001d9a5b45e4d8e5292f317f1ea10c744c29/evalscope-0.13.2.tar.gz to build tracker '/tmp/pip-build-tracker-14ddgcd6' 2025-04-01T13:23:08,755 Running setup.py (path:/tmp/pip-wheel-uxa9rl15/evalscope_0dbb2ee5788b4f5daa35c37260127ba3/setup.py) egg_info for package evalscope 2025-04-01T13:23:08,756 Created temporary directory: /tmp/pip-pip-egg-info-ge_lwbnq 2025-04-01T13:23:08,757 Preparing metadata (setup.py): started 2025-04-01T13:23:08,758 Running command python setup.py egg_info 2025-04-01T13:23:09,381 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-04-01T13:23:09,381 !! 2025-04-01T13:23:09,382 ******************************************************************************** 2025-04-01T13:23:09,383 Usage of dash-separated 'index-url' will not be supported in future 2025-04-01T13:23:09,383 versions. Please use the underscore name 'index_url' instead. 2025-04-01T13:23:09,384 This deprecation is overdue, please update your project and remove deprecated 2025-04-01T13:23:09,385 calls to avoid build errors in the future. 2025-04-01T13:23:09,385 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-04-01T13:23:09,386 ******************************************************************************** 2025-04-01T13:23:09,387 !! 2025-04-01T13:23:09,387 opt = self.warn_dash_deprecation(opt, section) 2025-04-01T13:23:09,965 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-04-01T13:23:09,966 !! 2025-04-01T13:23:09,967 ******************************************************************************** 2025-04-01T13:23:09,967 Usage of dash-separated 'index-url' will not be supported in future 2025-04-01T13:23:09,968 versions. Please use the underscore name 'index_url' instead. 2025-04-01T13:23:09,969 This deprecation is overdue, please update your project and remove deprecated 2025-04-01T13:23:09,969 calls to avoid build errors in the future. 2025-04-01T13:23:09,970 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-04-01T13:23:09,971 ******************************************************************************** 2025-04-01T13:23:09,972 !! 2025-04-01T13:23:09,973 opt = self.warn_dash_deprecation(opt, section) 2025-04-01T13:23:10,000 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-04-01T13:23:10,001 running egg_info 2025-04-01T13:23:10,029 creating /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info 2025-04-01T13:23:10,030 writing /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/PKG-INFO 2025-04-01T13:23:10,054 writing dependency_links to /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/dependency_links.txt 2025-04-01T13:23:10,056 writing entry points to /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/entry_points.txt 2025-04-01T13:23:10,068 writing requirements to /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/requires.txt 2025-04-01T13:23:10,069 writing top-level names to /tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/top_level.txt 2025-04-01T13:23:10,071 writing manifest file '/tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/SOURCES.txt' 2025-04-01T13:23:10,465 reading manifest file '/tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/SOURCES.txt' 2025-04-01T13:23:10,467 reading manifest template 'MANIFEST.in' 2025-04-01T13:23:10,636 adding license file 'LICENSE' 2025-04-01T13:23:10,661 writing manifest file '/tmp/pip-pip-egg-info-ge_lwbnq/evalscope.egg-info/SOURCES.txt' 2025-04-01T13:23:10,787 Preparing metadata (setup.py): finished with status 'done' 2025-04-01T13:23:10,794 Source in /tmp/pip-wheel-uxa9rl15/evalscope_0dbb2ee5788b4f5daa35c37260127ba3 has version 0.13.2, which satisfies requirement evalscope==0.13.2 from https://files.pythonhosted.org/packages/b7/8d/711ae30b80329e2dd7da760c001d9a5b45e4d8e5292f317f1ea10c744c29/evalscope-0.13.2.tar.gz 2025-04-01T13:23:10,795 Removed evalscope==0.13.2 from https://files.pythonhosted.org/packages/b7/8d/711ae30b80329e2dd7da760c001d9a5b45e4d8e5292f317f1ea10c744c29/evalscope-0.13.2.tar.gz from build tracker '/tmp/pip-build-tracker-14ddgcd6' 2025-04-01T13:23:10,840 Created temporary directory: /tmp/pip-unpack-x4szuqv7 2025-04-01T13:23:10,841 Created temporary directory: /tmp/pip-unpack-et3cy_ju 2025-04-01T13:23:10,841 Building wheels for collected packages: evalscope 2025-04-01T13:23:10,845 Created temporary directory: /tmp/pip-wheel-8to7gfe8 2025-04-01T13:23:10,846 Building wheel for evalscope (setup.py): started 2025-04-01T13:23:10,847 Destination directory: /tmp/pip-wheel-8to7gfe8 2025-04-01T13:23:10,848 Running command python setup.py bdist_wheel 2025-04-01T13:23:11,312 Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test 2025-04-01T13:23:11,419 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-04-01T13:23:11,420 !! 2025-04-01T13:23:11,421 ******************************************************************************** 2025-04-01T13:23:11,421 Usage of dash-separated 'index-url' will not be supported in future 2025-04-01T13:23:11,421 versions. Please use the underscore name 'index_url' instead. 2025-04-01T13:23:11,422 This deprecation is overdue, please update your project and remove deprecated 2025-04-01T13:23:11,423 calls to avoid build errors in the future. 2025-04-01T13:23:11,424 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-04-01T13:23:11,424 ******************************************************************************** 2025-04-01T13:23:11,426 !! 2025-04-01T13:23:11,427 opt = self.warn_dash_deprecation(opt, section) 2025-04-01T13:23:12,003 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options 2025-04-01T13:23:12,004 !! 2025-04-01T13:23:12,005 ******************************************************************************** 2025-04-01T13:23:12,005 Usage of dash-separated 'index-url' will not be supported in future 2025-04-01T13:23:12,006 versions. Please use the underscore name 'index_url' instead. 2025-04-01T13:23:12,007 This deprecation is overdue, please update your project and remove deprecated 2025-04-01T13:23:12,008 calls to avoid build errors in the future. 2025-04-01T13:23:12,009 See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details. 2025-04-01T13:23:12,009 ******************************************************************************** 2025-04-01T13:23:12,010 !! 2025-04-01T13:23:12,011 opt = self.warn_dash_deprecation(opt, section) 2025-04-01T13:23:12,013 running bdist_wheel 2025-04-01T13:23:12,160 running build 2025-04-01T13:23:12,161 running build_py 2025-04-01T13:23:12,191 creating build/lib/evalscope 2025-04-01T13:23:12,194 copying evalscope/summarizer.py -> build/lib/evalscope 2025-04-01T13:23:12,196 copying evalscope/run_arena.py -> build/lib/evalscope 2025-04-01T13:23:12,199 copying evalscope/arguments.py -> build/lib/evalscope 2025-04-01T13:23:12,201 copying evalscope/version.py -> build/lib/evalscope 2025-04-01T13:23:12,203 copying evalscope/constants.py -> build/lib/evalscope 2025-04-01T13:23:12,205 copying evalscope/config.py -> build/lib/evalscope 2025-04-01T13:23:12,207 copying evalscope/__init__.py -> build/lib/evalscope 2025-04-01T13:23:12,209 copying evalscope/run.py -> build/lib/evalscope 2025-04-01T13:23:12,211 creating build/lib/tests 2025-04-01T13:23:12,212 copying tests/__init__.py -> build/lib/tests 2025-04-01T13:23:12,214 copying tests/test_run_all.py -> build/lib/tests 2025-04-01T13:23:12,217 creating build/lib/evalscope/metrics 2025-04-01T13:23:12,218 copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,220 copying evalscope/metrics/math_parser.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,223 copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,225 copying evalscope/metrics/named_metrics.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,227 copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,230 copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,232 copying evalscope/metrics/llm_judge.py -> build/lib/evalscope/metrics 2025-04-01T13:23:12,234 creating build/lib/evalscope/report 2025-04-01T13:23:12,235 copying evalscope/report/app.py -> build/lib/evalscope/report 2025-04-01T13:23:12,238 copying evalscope/report/utils.py -> build/lib/evalscope/report 2025-04-01T13:23:12,240 copying evalscope/report/__init__.py -> build/lib/evalscope/report 2025-04-01T13:23:12,242 copying evalscope/report/combinator.py -> build/lib/evalscope/report 2025-04-01T13:23:12,244 copying evalscope/report/generator.py -> build/lib/evalscope/report 2025-04-01T13:23:12,246 creating build/lib/evalscope/third_party 2025-04-01T13:23:12,247 copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party 2025-04-01T13:23:12,249 creating build/lib/evalscope/benchmarks 2025-04-01T13:23:12,250 copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks 2025-04-01T13:23:12,253 copying evalscope/benchmarks/utils.py -> build/lib/evalscope/benchmarks 2025-04-01T13:23:12,255 copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks 2025-04-01T13:23:12,257 copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks 2025-04-01T13:23:12,259 creating build/lib/evalscope/collections 2025-04-01T13:23:12,260 copying evalscope/collections/evaluator.py -> build/lib/evalscope/collections 2025-04-01T13:23:12,263 copying evalscope/collections/sampler.py -> build/lib/evalscope/collections 2025-04-01T13:23:12,265 copying evalscope/collections/schema.py -> build/lib/evalscope/collections 2025-04-01T13:23:12,267 copying evalscope/collections/__init__.py -> build/lib/evalscope/collections 2025-04-01T13:23:12,270 creating build/lib/evalscope/cli 2025-04-01T13:23:12,271 copying evalscope/cli/cli.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,273 copying evalscope/cli/base.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,275 copying evalscope/cli/start_eval.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,277 copying evalscope/cli/start_server.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,279 copying evalscope/cli/__init__.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,280 copying evalscope/cli/start_app.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,282 copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli 2025-04-01T13:23:12,284 creating build/lib/evalscope/perf 2025-04-01T13:23:12,286 copying evalscope/perf/arguments.py -> build/lib/evalscope/perf 2025-04-01T13:23:12,288 copying evalscope/perf/http_client.py -> build/lib/evalscope/perf 2025-04-01T13:23:12,290 copying evalscope/perf/main.py -> build/lib/evalscope/perf 2025-04-01T13:23:12,292 copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf 2025-04-01T13:23:12,294 copying evalscope/perf/__init__.py -> build/lib/evalscope/perf 2025-04-01T13:23:12,296 creating build/lib/evalscope/evaluator 2025-04-01T13:23:12,297 copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator 2025-04-01T13:23:12,300 copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator 2025-04-01T13:23:12,302 copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator 2025-04-01T13:23:12,305 creating build/lib/evalscope/utils 2025-04-01T13:23:12,307 copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,309 copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,311 copying evalscope/utils/model_utils.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,313 copying evalscope/utils/io_utils.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,316 copying evalscope/utils/chat_service.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,319 copying evalscope/utils/utils.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,322 copying evalscope/utils/__init__.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,324 copying evalscope/utils/filters.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,326 copying evalscope/utils/logger.py -> build/lib/evalscope/utils 2025-04-01T13:23:12,328 creating build/lib/evalscope/registry 2025-04-01T13:23:12,329 copying evalscope/registry/__init__.py -> build/lib/evalscope/registry 2025-04-01T13:23:12,332 creating build/lib/evalscope/models 2025-04-01T13:23:12,333 copying evalscope/models/server_adapter.py -> build/lib/evalscope/models 2025-04-01T13:23:12,335 copying evalscope/models/custom_adapter.py -> build/lib/evalscope/models 2025-04-01T13:23:12,337 copying evalscope/models/model.py -> build/lib/evalscope/models 2025-04-01T13:23:12,339 copying evalscope/models/base_adapter.py -> build/lib/evalscope/models 2025-04-01T13:23:12,341 copying evalscope/models/chat_adapter.py -> build/lib/evalscope/models 2025-04-01T13:23:12,343 copying evalscope/models/local_model.py -> build/lib/evalscope/models 2025-04-01T13:23:12,345 copying evalscope/models/register.py -> build/lib/evalscope/models 2025-04-01T13:23:12,346 copying evalscope/models/choice_adapter.py -> build/lib/evalscope/models 2025-04-01T13:23:12,349 copying evalscope/models/__init__.py -> build/lib/evalscope/models 2025-04-01T13:23:12,351 creating build/lib/evalscope/backend 2025-04-01T13:23:12,353 copying evalscope/backend/base.py -> build/lib/evalscope/backend 2025-04-01T13:23:12,355 copying evalscope/backend/__init__.py -> build/lib/evalscope/backend 2025-04-01T13:23:12,356 creating build/lib/evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:12,358 copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:12,361 copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:12,364 creating build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,365 copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,367 copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,370 copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,372 copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,374 copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:12,377 creating build/lib/evalscope/third_party/thinkbench 2025-04-01T13:23:12,378 copying evalscope/third_party/thinkbench/eval.py -> build/lib/evalscope/third_party/thinkbench 2025-04-01T13:23:12,381 copying evalscope/third_party/thinkbench/infer.py -> build/lib/evalscope/third_party/thinkbench 2025-04-01T13:23:12,383 copying evalscope/third_party/thinkbench/__init__.py -> build/lib/evalscope/third_party/thinkbench 2025-04-01T13:23:12,385 creating build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:12,386 copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:12,388 copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:12,391 copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:12,393 copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:12,395 creating build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:12,396 copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:12,399 creating build/lib/evalscope/third_party/longbench_write/tools 2025-04-01T13:23:12,400 copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-04-01T13:23:12,402 copying evalscope/third_party/longbench_write/tools/openai_api.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-04-01T13:23:12,405 copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools 2025-04-01T13:23:12,407 creating build/lib/evalscope/third_party/thinkbench/tools 2025-04-01T13:23:12,408 copying evalscope/third_party/thinkbench/tools/llm.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-04-01T13:23:12,410 copying evalscope/third_party/thinkbench/tools/utils.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-04-01T13:23:12,412 copying evalscope/third_party/thinkbench/tools/__init__.py -> build/lib/evalscope/third_party/thinkbench/tools 2025-04-01T13:23:12,414 creating build/lib/evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:12,415 copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:12,417 copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:12,419 creating build/lib/evalscope/benchmarks/humaneval 2025-04-01T13:23:12,420 copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval 2025-04-01T13:23:12,423 copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval 2025-04-01T13:23:12,425 copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval 2025-04-01T13:23:12,427 creating build/lib/evalscope/benchmarks/general_qa 2025-04-01T13:23:12,428 copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa 2025-04-01T13:23:12,430 copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa 2025-04-01T13:23:12,433 creating build/lib/evalscope/benchmarks/iquiz 2025-04-01T13:23:12,434 copying evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/lib/evalscope/benchmarks/iquiz 2025-04-01T13:23:12,436 copying evalscope/benchmarks/iquiz/__init__.py -> build/lib/evalscope/benchmarks/iquiz 2025-04-01T13:23:12,438 creating build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:12,439 copying evalscope/benchmarks/super_gpqa/utils.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:12,441 copying evalscope/benchmarks/super_gpqa/__init__.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:12,443 copying evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:12,445 creating build/lib/evalscope/benchmarks/process_bench 2025-04-01T13:23:12,447 copying evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/lib/evalscope/benchmarks/process_bench 2025-04-01T13:23:12,449 copying evalscope/benchmarks/process_bench/__init__.py -> build/lib/evalscope/benchmarks/process_bench 2025-04-01T13:23:12,451 creating build/lib/evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:12,452 copying evalscope/benchmarks/mmlu_redux/mmlu_redux_adapter.py -> build/lib/evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:12,454 copying evalscope/benchmarks/mmlu_redux/__init__.py -> build/lib/evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:12,456 creating build/lib/evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:12,457 copying evalscope/benchmarks/alpaca_eval/__init__.py -> build/lib/evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:12,459 copying evalscope/benchmarks/alpaca_eval/alpaca_eval_adapter.py -> build/lib/evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:12,462 creating build/lib/evalscope/benchmarks/race 2025-04-01T13:23:12,463 copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race 2025-04-01T13:23:12,465 copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race 2025-04-01T13:23:12,467 copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race 2025-04-01T13:23:12,470 creating build/lib/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:12,471 copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:12,473 copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:12,476 copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:12,478 creating build/lib/evalscope/benchmarks/bbh 2025-04-01T13:23:12,479 copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh 2025-04-01T13:23:12,481 copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh 2025-04-01T13:23:12,484 creating build/lib/evalscope/benchmarks/musr 2025-04-01T13:23:12,485 copying evalscope/benchmarks/musr/musr_adapter.py -> build/lib/evalscope/benchmarks/musr 2025-04-01T13:23:12,487 copying evalscope/benchmarks/musr/__init__.py -> build/lib/evalscope/benchmarks/musr 2025-04-01T13:23:12,489 creating build/lib/evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:12,490 copying evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py -> build/lib/evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:12,492 copying evalscope/benchmarks/chinese_simple_qa/__init__.py -> build/lib/evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:12,494 creating build/lib/evalscope/benchmarks/competition_math 2025-04-01T13:23:12,495 copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math 2025-04-01T13:23:12,497 copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math 2025-04-01T13:23:12,500 copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math 2025-04-01T13:23:12,502 creating build/lib/evalscope/benchmarks/arc 2025-04-01T13:23:12,503 copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc 2025-04-01T13:23:12,505 copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc 2025-04-01T13:23:12,508 copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc 2025-04-01T13:23:12,510 creating build/lib/evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:12,512 copying evalscope/benchmarks/mmlu_pro/__init__.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:12,513 copying evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/lib/evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:12,516 creating build/lib/evalscope/benchmarks/aime 2025-04-01T13:23:12,517 copying evalscope/benchmarks/aime/aime25_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-04-01T13:23:12,519 copying evalscope/benchmarks/aime/aime24_adapter.py -> build/lib/evalscope/benchmarks/aime 2025-04-01T13:23:12,521 copying evalscope/benchmarks/aime/__init__.py -> build/lib/evalscope/benchmarks/aime 2025-04-01T13:23:12,523 creating build/lib/evalscope/benchmarks/cmmlu 2025-04-01T13:23:12,524 copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu 2025-04-01T13:23:12,527 copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu 2025-04-01T13:23:12,529 copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu 2025-04-01T13:23:12,532 creating build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,533 copying evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,535 copying evalscope/benchmarks/ifeval/utils.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,537 copying evalscope/benchmarks/ifeval/instructions_util.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,540 copying evalscope/benchmarks/ifeval/__init__.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,542 copying evalscope/benchmarks/ifeval/instructions.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,545 copying evalscope/benchmarks/ifeval/instructions_registry.py -> build/lib/evalscope/benchmarks/ifeval 2025-04-01T13:23:12,548 creating build/lib/evalscope/benchmarks/ceval 2025-04-01T13:23:12,549 copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval 2025-04-01T13:23:12,552 copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval 2025-04-01T13:23:12,554 copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval 2025-04-01T13:23:12,556 creating build/lib/evalscope/benchmarks/arena_hard 2025-04-01T13:23:12,557 copying evalscope/benchmarks/arena_hard/utils.py -> build/lib/evalscope/benchmarks/arena_hard 2025-04-01T13:23:12,559 copying evalscope/benchmarks/arena_hard/__init__.py -> build/lib/evalscope/benchmarks/arena_hard 2025-04-01T13:23:12,561 copying evalscope/benchmarks/arena_hard/arena_hard_adapter.py -> build/lib/evalscope/benchmarks/arena_hard 2025-04-01T13:23:12,563 creating build/lib/evalscope/benchmarks/gsm8k 2025-04-01T13:23:12,564 copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k 2025-04-01T13:23:12,567 copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k 2025-04-01T13:23:12,569 copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k 2025-04-01T13:23:12,571 creating build/lib/evalscope/benchmarks/simple_qa 2025-04-01T13:23:12,572 copying evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/lib/evalscope/benchmarks/simple_qa 2025-04-01T13:23:12,575 copying evalscope/benchmarks/simple_qa/__init__.py -> build/lib/evalscope/benchmarks/simple_qa 2025-04-01T13:23:12,577 creating build/lib/evalscope/benchmarks/data_collection 2025-04-01T13:23:12,578 copying evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/lib/evalscope/benchmarks/data_collection 2025-04-01T13:23:12,580 copying evalscope/benchmarks/data_collection/__init__.py -> build/lib/evalscope/benchmarks/data_collection 2025-04-01T13:23:12,582 creating build/lib/evalscope/benchmarks/gpqa 2025-04-01T13:23:12,583 copying evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/lib/evalscope/benchmarks/gpqa 2025-04-01T13:23:12,585 copying evalscope/benchmarks/gpqa/__init__.py -> build/lib/evalscope/benchmarks/gpqa 2025-04-01T13:23:12,587 creating build/lib/evalscope/benchmarks/math_500 2025-04-01T13:23:12,589 copying evalscope/benchmarks/math_500/math_500_adapter.py -> build/lib/evalscope/benchmarks/math_500 2025-04-01T13:23:12,591 copying evalscope/benchmarks/math_500/__init__.py -> build/lib/evalscope/benchmarks/math_500 2025-04-01T13:23:12,593 creating build/lib/evalscope/benchmarks/general_mcq 2025-04-01T13:23:12,594 copying evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/lib/evalscope/benchmarks/general_mcq 2025-04-01T13:23:12,596 copying evalscope/benchmarks/general_mcq/__init__.py -> build/lib/evalscope/benchmarks/general_mcq 2025-04-01T13:23:12,599 creating build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,600 copying evalscope/benchmarks/live_code_bench/extract_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,602 copying evalscope/benchmarks/live_code_bench/testing_util.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,604 copying evalscope/benchmarks/live_code_bench/pass_k_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,607 copying evalscope/benchmarks/live_code_bench/execute_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,609 copying evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,611 copying evalscope/benchmarks/live_code_bench/load_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,613 copying evalscope/benchmarks/live_code_bench/evaluate_utils.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,615 copying evalscope/benchmarks/live_code_bench/__init__.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,617 copying evalscope/benchmarks/live_code_bench/prompts.py -> build/lib/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:12,620 creating build/lib/evalscope/benchmarks/truthful_qa 2025-04-01T13:23:12,621 copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-04-01T13:23:12,623 copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-04-01T13:23:12,625 copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa 2025-04-01T13:23:12,627 creating build/lib/evalscope/benchmarks/mmlu 2025-04-01T13:23:12,628 copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu 2025-04-01T13:23:12,631 copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu 2025-04-01T13:23:12,633 copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu 2025-04-01T13:23:12,635 creating build/lib/evalscope/benchmarks/hellaswag 2025-04-01T13:23:12,636 copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag 2025-04-01T13:23:12,639 copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag 2025-04-01T13:23:12,641 copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag 2025-04-01T13:23:12,643 creating build/lib/evalscope/perf/utils 2025-04-01T13:23:12,644 copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,647 copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,649 copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,651 copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,654 copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,655 copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils 2025-04-01T13:23:12,657 creating build/lib/evalscope/perf/plugin 2025-04-01T13:23:12,659 copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin 2025-04-01T13:23:12,660 copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin 2025-04-01T13:23:12,663 creating build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,664 copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,666 copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,668 copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,670 copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,672 copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api 2025-04-01T13:23:12,675 creating build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,676 copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,678 copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,680 copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,682 copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,684 copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,686 copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,687 copying evalscope/perf/plugin/datasets/random_dataset.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,689 copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,691 copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets 2025-04-01T13:23:12,693 creating build/lib/evalscope/evaluator/reviewer 2025-04-01T13:23:12,694 copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer 2025-04-01T13:23:12,697 copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer 2025-04-01T13:23:12,699 creating build/lib/evalscope/models/custom 2025-04-01T13:23:12,700 copying evalscope/models/custom/dummy_model.py -> build/lib/evalscope/models/custom 2025-04-01T13:23:12,702 copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom 2025-04-01T13:23:12,704 copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom 2025-04-01T13:23:12,706 creating build/lib/evalscope/backend/vlm_eval_kit 2025-04-01T13:23:12,707 copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-04-01T13:23:12,709 copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-04-01T13:23:12,711 copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit 2025-04-01T13:23:12,713 creating build/lib/evalscope/backend/rag_eval 2025-04-01T13:23:12,714 copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval 2025-04-01T13:23:12,716 copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval 2025-04-01T13:23:12,719 creating build/lib/evalscope/backend/opencompass 2025-04-01T13:23:12,720 copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass 2025-04-01T13:23:12,723 copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass 2025-04-01T13:23:12,724 copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass 2025-04-01T13:23:12,727 creating build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:12,728 copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:12,730 copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:12,732 copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:12,734 copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:12,737 creating build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,738 copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,740 copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,742 copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,744 copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,746 copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils 2025-04-01T13:23:12,748 creating build/lib/evalscope/backend/rag_eval/ragas 2025-04-01T13:23:12,749 copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-04-01T13:23:12,751 copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-04-01T13:23:12,753 copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas 2025-04-01T13:23:12,756 creating build/lib/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:12,757 copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:12,759 copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:12,761 copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:12,763 copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:12,765 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:12,766 copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:12,768 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:12,770 copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:12,772 copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:12,775 creating build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,776 copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,778 copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,780 copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,782 copying evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,784 copying evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:12,787 creating build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,788 copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,790 copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,793 copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,795 copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,797 copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,799 copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,802 copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,803 copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:12,806 creating build/lib/evalscope/backend/opencompass/tasks 2025-04-01T13:23:12,807 copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks 2025-04-01T13:23:12,809 copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks 2025-04-01T13:23:12,811 copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks 2025-04-01T13:23:12,814 creating build/lib/tests/swift 2025-04-01T13:23:12,815 copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift 2025-04-01T13:23:12,817 copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift 2025-04-01T13:23:12,820 copying tests/swift/__init__.py -> build/lib/tests/swift 2025-04-01T13:23:12,822 copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift 2025-04-01T13:23:12,825 creating build/lib/tests/vlm 2025-04-01T13:23:12,826 copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm 2025-04-01T13:23:12,828 copying tests/vlm/__init__.py -> build/lib/tests/vlm 2025-04-01T13:23:12,830 creating build/lib/tests/cli 2025-04-01T13:23:12,832 copying tests/cli/test_all.py -> build/lib/tests/cli 2025-04-01T13:23:12,834 copying tests/cli/test_run.py -> build/lib/tests/cli 2025-04-01T13:23:12,836 copying tests/cli/__init__.py -> build/lib/tests/cli 2025-04-01T13:23:12,838 copying tests/cli/test_collection.py -> build/lib/tests/cli 2025-04-01T13:23:12,841 creating build/lib/tests/perf 2025-04-01T13:23:12,842 copying tests/perf/__init__.py -> build/lib/tests/perf 2025-04-01T13:23:12,844 copying tests/perf/test_perf.py -> build/lib/tests/perf 2025-04-01T13:23:12,847 creating build/lib/tests/rag 2025-04-01T13:23:12,848 copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag 2025-04-01T13:23:12,850 copying tests/rag/test_ragas.py -> build/lib/tests/rag 2025-04-01T13:23:12,852 copying tests/rag/test_mteb.py -> build/lib/tests/rag 2025-04-01T13:23:12,854 copying tests/rag/__init__.py -> build/lib/tests/rag 2025-04-01T13:23:12,856 running egg_info 2025-04-01T13:23:12,884 writing evalscope.egg-info/PKG-INFO 2025-04-01T13:23:12,908 writing dependency_links to evalscope.egg-info/dependency_links.txt 2025-04-01T13:23:12,909 writing entry points to evalscope.egg-info/entry_points.txt 2025-04-01T13:23:12,921 writing requirements to evalscope.egg-info/requires.txt 2025-04-01T13:23:12,923 writing top-level names to evalscope.egg-info/top_level.txt 2025-04-01T13:23:13,018 reading manifest file 'evalscope.egg-info/SOURCES.txt' 2025-04-01T13:23:13,039 reading manifest template 'MANIFEST.in' 2025-04-01T13:23:13,176 adding license file 'LICENSE' 2025-04-01T13:23:13,197 writing manifest file 'evalscope.egg-info/SOURCES.txt' 2025-04-01T13:23:13,200 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration. 2025-04-01T13:23:13,201 !! 2025-04-01T13:23:13,203 ******************************************************************************** 2025-04-01T13:23:13,203 ############################ 2025-04-01T13:23:13,204 # Package would be ignored # 2025-04-01T13:23:13,204 ############################ 2025-04-01T13:23:13,205 Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1], 2025-04-01T13:23:13,205 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,207 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,207 package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added 2025-04-01T13:23:13,208 to the `packages` configuration field. 2025-04-01T13:23:13,209 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,209 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,210 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,211 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,212 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,213 If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are 2025-04-01T13:23:13,214 already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via 2025-04-01T13:23:13,215 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,215 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,216 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,217 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,218 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,220 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,220 even if it does not contain any `.py` files. 2025-04-01T13:23:13,220 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,221 directory, all directories are treated like packages. 2025-04-01T13:23:13,221 ******************************************************************************** 2025-04-01T13:23:13,222 !! 2025-04-01T13:23:13,223 check.warn(importable) 2025-04-01T13:23:13,223 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration. 2025-04-01T13:23:13,224 !! 2025-04-01T13:23:13,224 ******************************************************************************** 2025-04-01T13:23:13,225 ############################ 2025-04-01T13:23:13,225 # Package would be ignored # 2025-04-01T13:23:13,226 ############################ 2025-04-01T13:23:13,226 Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1], 2025-04-01T13:23:13,227 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,228 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,228 package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added 2025-04-01T13:23:13,229 to the `packages` configuration field. 2025-04-01T13:23:13,229 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,230 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,230 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,232 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,233 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,234 If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are 2025-04-01T13:23:13,234 already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via 2025-04-01T13:23:13,235 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,235 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,236 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,237 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,238 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,239 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,240 even if it does not contain any `.py` files. 2025-04-01T13:23:13,241 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,241 directory, all directories are treated like packages. 2025-04-01T13:23:13,242 ******************************************************************************** 2025-04-01T13:23:13,243 !! 2025-04-01T13:23:13,243 check.warn(importable) 2025-04-01T13:23:13,244 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration. 2025-04-01T13:23:13,244 !! 2025-04-01T13:23:13,246 ******************************************************************************** 2025-04-01T13:23:13,246 ############################ 2025-04-01T13:23:13,247 # Package would be ignored # 2025-04-01T13:23:13,247 ############################ 2025-04-01T13:23:13,247 Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1], 2025-04-01T13:23:13,248 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,249 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,249 package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added 2025-04-01T13:23:13,250 to the `packages` configuration field. 2025-04-01T13:23:13,250 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,251 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,251 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,252 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,253 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,254 If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are 2025-04-01T13:23:13,254 already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via 2025-04-01T13:23:13,255 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,255 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,256 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,257 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,258 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,259 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,260 even if it does not contain any `.py` files. 2025-04-01T13:23:13,261 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,261 directory, all directories are treated like packages. 2025-04-01T13:23:13,262 ******************************************************************************** 2025-04-01T13:23:13,263 !! 2025-04-01T13:23:13,263 check.warn(importable) 2025-04-01T13:23:13,264 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration. 2025-04-01T13:23:13,264 !! 2025-04-01T13:23:13,265 ******************************************************************************** 2025-04-01T13:23:13,266 ############################ 2025-04-01T13:23:13,266 # Package would be ignored # 2025-04-01T13:23:13,267 ############################ 2025-04-01T13:23:13,267 Python recognizes 'evalscope.metrics.resources' as an importable package[^1], 2025-04-01T13:23:13,268 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,269 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,269 package, please make sure that 'evalscope.metrics.resources' is explicitly added 2025-04-01T13:23:13,270 to the `packages` configuration field. 2025-04-01T13:23:13,271 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,271 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,272 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,273 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,274 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,275 If you don't want 'evalscope.metrics.resources' to be distributed and are 2025-04-01T13:23:13,275 already explicitly excluding 'evalscope.metrics.resources' via 2025-04-01T13:23:13,275 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,276 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,276 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,277 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,278 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,279 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,279 even if it does not contain any `.py` files. 2025-04-01T13:23:13,280 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,280 directory, all directories are treated like packages. 2025-04-01T13:23:13,281 ******************************************************************************** 2025-04-01T13:23:13,282 !! 2025-04-01T13:23:13,282 check.warn(importable) 2025-04-01T13:23:13,283 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration. 2025-04-01T13:23:13,283 !! 2025-04-01T13:23:13,284 ******************************************************************************** 2025-04-01T13:23:13,285 ############################ 2025-04-01T13:23:13,285 # Package would be ignored # 2025-04-01T13:23:13,286 ############################ 2025-04-01T13:23:13,286 Python recognizes 'evalscope.registry.config' as an importable package[^1], 2025-04-01T13:23:13,286 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,287 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,288 package, please make sure that 'evalscope.registry.config' is explicitly added 2025-04-01T13:23:13,288 to the `packages` configuration field. 2025-04-01T13:23:13,289 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,290 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,290 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,291 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,292 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,293 If you don't want 'evalscope.registry.config' to be distributed and are 2025-04-01T13:23:13,294 already explicitly excluding 'evalscope.registry.config' via 2025-04-01T13:23:13,294 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,295 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,295 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,296 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,297 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,299 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,300 even if it does not contain any `.py` files. 2025-04-01T13:23:13,300 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,301 directory, all directories are treated like packages. 2025-04-01T13:23:13,301 ******************************************************************************** 2025-04-01T13:23:13,302 !! 2025-04-01T13:23:13,303 check.warn(importable) 2025-04-01T13:23:13,303 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration. 2025-04-01T13:23:13,304 !! 2025-04-01T13:23:13,305 ******************************************************************************** 2025-04-01T13:23:13,305 ############################ 2025-04-01T13:23:13,305 # Package would be ignored # 2025-04-01T13:23:13,306 ############################ 2025-04-01T13:23:13,306 Python recognizes 'evalscope.registry.data' as an importable package[^1], 2025-04-01T13:23:13,307 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,308 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,308 package, please make sure that 'evalscope.registry.data' is explicitly added 2025-04-01T13:23:13,308 to the `packages` configuration field. 2025-04-01T13:23:13,310 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,310 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,311 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,312 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,313 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,314 If you don't want 'evalscope.registry.data' to be distributed and are 2025-04-01T13:23:13,314 already explicitly excluding 'evalscope.registry.data' via 2025-04-01T13:23:13,315 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,315 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,316 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,317 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,318 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,320 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,321 even if it does not contain any `.py` files. 2025-04-01T13:23:13,321 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,322 directory, all directories are treated like packages. 2025-04-01T13:23:13,322 ******************************************************************************** 2025-04-01T13:23:13,323 !! 2025-04-01T13:23:13,324 check.warn(importable) 2025-04-01T13:23:13,324 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration. 2025-04-01T13:23:13,325 !! 2025-04-01T13:23:13,326 ******************************************************************************** 2025-04-01T13:23:13,326 ############################ 2025-04-01T13:23:13,327 # Package would be ignored # 2025-04-01T13:23:13,328 ############################ 2025-04-01T13:23:13,328 Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1], 2025-04-01T13:23:13,329 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,330 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,330 package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added 2025-04-01T13:23:13,331 to the `packages` configuration field. 2025-04-01T13:23:13,332 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,332 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,333 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,334 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,335 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,335 If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are 2025-04-01T13:23:13,336 already explicitly excluding 'evalscope.registry.data.prompt_template' via 2025-04-01T13:23:13,336 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,337 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,337 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,338 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,339 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,341 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,341 even if it does not contain any `.py` files. 2025-04-01T13:23:13,341 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,342 directory, all directories are treated like packages. 2025-04-01T13:23:13,342 ******************************************************************************** 2025-04-01T13:23:13,343 !! 2025-04-01T13:23:13,344 check.warn(importable) 2025-04-01T13:23:13,344 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration. 2025-04-01T13:23:13,345 !! 2025-04-01T13:23:13,346 ******************************************************************************** 2025-04-01T13:23:13,346 ############################ 2025-04-01T13:23:13,347 # Package would be ignored # 2025-04-01T13:23:13,347 ############################ 2025-04-01T13:23:13,348 Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1], 2025-04-01T13:23:13,348 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,349 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,350 package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added 2025-04-01T13:23:13,350 to the `packages` configuration field. 2025-04-01T13:23:13,351 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,352 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,352 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,353 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,354 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,355 If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are 2025-04-01T13:23:13,356 already explicitly excluding 'evalscope.registry.data.qa_browser' via 2025-04-01T13:23:13,356 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,357 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,358 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,359 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,360 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,362 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,362 even if it does not contain any `.py` files. 2025-04-01T13:23:13,363 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,363 directory, all directories are treated like packages. 2025-04-01T13:23:13,363 ******************************************************************************** 2025-04-01T13:23:13,364 !! 2025-04-01T13:23:13,365 check.warn(importable) 2025-04-01T13:23:13,365 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration. 2025-04-01T13:23:13,366 !! 2025-04-01T13:23:13,367 ******************************************************************************** 2025-04-01T13:23:13,367 ############################ 2025-04-01T13:23:13,368 # Package would be ignored # 2025-04-01T13:23:13,368 ############################ 2025-04-01T13:23:13,369 Python recognizes 'evalscope.registry.tasks' as an importable package[^1], 2025-04-01T13:23:13,369 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,370 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,370 package, please make sure that 'evalscope.registry.tasks' is explicitly added 2025-04-01T13:23:13,371 to the `packages` configuration field. 2025-04-01T13:23:13,373 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,373 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,374 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,375 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,377 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,378 If you don't want 'evalscope.registry.tasks' to be distributed and are 2025-04-01T13:23:13,379 already explicitly excluding 'evalscope.registry.tasks' via 2025-04-01T13:23:13,379 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,380 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,380 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,381 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,382 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,384 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,384 even if it does not contain any `.py` files. 2025-04-01T13:23:13,385 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,386 directory, all directories are treated like packages. 2025-04-01T13:23:13,386 ******************************************************************************** 2025-04-01T13:23:13,388 !! 2025-04-01T13:23:13,388 check.warn(importable) 2025-04-01T13:23:13,389 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.third_party.thinkbench.resources' is absent from the `packages` configuration. 2025-04-01T13:23:13,390 !! 2025-04-01T13:23:13,391 ******************************************************************************** 2025-04-01T13:23:13,392 ############################ 2025-04-01T13:23:13,392 # Package would be ignored # 2025-04-01T13:23:13,393 ############################ 2025-04-01T13:23:13,394 Python recognizes 'evalscope.third_party.thinkbench.resources' as an importable package[^1], 2025-04-01T13:23:13,395 but it is absent from setuptools' `packages` configuration. 2025-04-01T13:23:13,396 This leads to an ambiguous overall configuration. If you want to distribute this 2025-04-01T13:23:13,396 package, please make sure that 'evalscope.third_party.thinkbench.resources' is explicitly added 2025-04-01T13:23:13,397 to the `packages` configuration field. 2025-04-01T13:23:13,398 Alternatively, you can also rely on setuptools' discovery methods 2025-04-01T13:23:13,399 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-04-01T13:23:13,399 instead of `find_packages(...)`/`find:`). 2025-04-01T13:23:13,400 You can read more about "package discovery" on setuptools documentation page: 2025-04-01T13:23:13,402 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-04-01T13:23:13,403 If you don't want 'evalscope.third_party.thinkbench.resources' to be distributed and are 2025-04-01T13:23:13,403 already explicitly excluding 'evalscope.third_party.thinkbench.resources' via 2025-04-01T13:23:13,404 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-04-01T13:23:13,404 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-04-01T13:23:13,404 combination with a more fine grained `package-data` configuration. 2025-04-01T13:23:13,406 You can read more about "package data files" on setuptools documentation page: 2025-04-01T13:23:13,407 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-04-01T13:23:13,409 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-04-01T13:23:13,410 even if it does not contain any `.py` files. 2025-04-01T13:23:13,410 On the other hand, currently there is no concept of package data 2025-04-01T13:23:13,411 directory, all directories are treated like packages. 2025-04-01T13:23:13,412 ******************************************************************************** 2025-04-01T13:23:13,417 !! 2025-04-01T13:23:13,425 check.warn(importable) 2025-04-01T13:23:13,427 creating build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,428 copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,429 copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,429 copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,430 copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,431 copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,431 copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,432 copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,432 copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,433 copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,433 copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,434 copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks 2025-04-01T13:23:13,434 creating build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,435 copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,435 copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,436 copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,437 copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,437 copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,437 copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,438 copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,438 copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,439 copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,439 copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,440 copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,440 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,441 copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,441 copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,442 copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,442 copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,443 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,443 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,444 copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,444 copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,445 copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,445 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,446 copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,446 copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,447 copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,447 copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,448 copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,448 copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,449 copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,449 copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,450 copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,451 creating build/lib/evalscope/metrics/resources 2025-04-01T13:23:13,451 copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources 2025-04-01T13:23:13,451 copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources 2025-04-01T13:23:13,452 creating build/lib/evalscope/registry/config 2025-04-01T13:23:13,452 copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config 2025-04-01T13:23:13,453 copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config 2025-04-01T13:23:13,453 copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config 2025-04-01T13:23:13,454 copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config 2025-04-01T13:23:13,454 creating build/lib/evalscope/registry/data 2025-04-01T13:23:13,455 copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data 2025-04-01T13:23:13,455 creating build/lib/evalscope/registry/data/prompt_template 2025-04-01T13:23:13,456 copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-04-01T13:23:13,456 copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template 2025-04-01T13:23:13,456 creating build/lib/evalscope/registry/data/qa_browser 2025-04-01T13:23:13,457 copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser 2025-04-01T13:23:13,476 copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser 2025-04-01T13:23:13,482 copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:13,485 copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:13,487 copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write 2025-04-01T13:23:13,490 creating build/lib/evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,491 copying evalscope/third_party/thinkbench/resources/critique_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,493 copying evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/lib/evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,495 copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:13,497 copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:13,500 copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:13,502 copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static 2025-04-01T13:23:13,505 copying evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,508 copying evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/lib/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,510 copying evalscope/benchmarks/process_bench/critique_template.txt -> build/lib/evalscope/benchmarks/process_bench 2025-04-01T13:23:13,512 copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race 2025-04-01T13:23:13,514 copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,528 copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu 2025-04-01T13:23:13,530 copying evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/lib/evalscope/benchmarks/gpqa 2025-04-01T13:23:13,533 copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu 2025-04-01T13:23:13,535 creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:13,536 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:13,539 copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:13,541 creating build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-04-01T13:23:13,542 copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts 2025-04-01T13:23:13,600 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-04-01T13:23:13,601 !! 2025-04-01T13:23:13,602 ******************************************************************************** 2025-04-01T13:23:13,602 Please avoid running ``setup.py`` directly. 2025-04-01T13:23:13,603 Instead, use pypa/build, pypa/installer or other 2025-04-01T13:23:13,603 standards-based tools. 2025-04-01T13:23:13,604 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-04-01T13:23:13,605 ******************************************************************************** 2025-04-01T13:23:13,606 !! 2025-04-01T13:23:13,606 self.initialize_options() 2025-04-01T13:23:13,628 installing to build/bdist.linux-armv7l/wheel 2025-04-01T13:23:13,629 running install 2025-04-01T13:23:13,652 running install_lib 2025-04-01T13:23:13,679 creating build/bdist.linux-armv7l/wheel 2025-04-01T13:23:13,681 creating build/bdist.linux-armv7l/wheel/evalscope 2025-04-01T13:23:13,683 creating build/bdist.linux-armv7l/wheel/evalscope/metrics 2025-04-01T13:23:13,685 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:13,686 copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:13,689 copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score 2025-04-01T13:23:13,691 copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,693 creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources 2025-04-01T13:23:13,694 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-04-01T13:23:13,716 copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources 2025-04-01T13:23:13,726 copying build/lib/evalscope/metrics/math_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,729 copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,732 copying build/lib/evalscope/metrics/named_metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,733 copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,736 copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,737 copying build/lib/evalscope/metrics/llm_judge.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics 2025-04-01T13:23:13,740 copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:13,742 copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:13,745 creating build/bdist.linux-armv7l/wheel/evalscope/report 2025-04-01T13:23:13,746 copying build/lib/evalscope/report/app.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-04-01T13:23:13,748 copying build/lib/evalscope/report/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-04-01T13:23:13,750 copying build/lib/evalscope/report/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-04-01T13:23:13,752 copying build/lib/evalscope/report/combinator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-04-01T13:23:13,754 copying build/lib/evalscope/report/generator.py -> build/bdist.linux-armv7l/wheel/./evalscope/report 2025-04-01T13:23:13,756 creating build/bdist.linux-armv7l/wheel/evalscope/third_party 2025-04-01T13:23:13,758 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write 2025-04-01T13:23:13,759 copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,761 copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,764 copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,766 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,768 copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,769 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,772 copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,775 copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,777 copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources 2025-04-01T13:23:13,780 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools 2025-04-01T13:23:13,781 copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-04-01T13:23:13,783 copying build/lib/evalscope/third_party/longbench_write/tools/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-04-01T13:23:13,785 copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools 2025-04-01T13:23:13,787 copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,790 copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,791 copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,793 copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,795 copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write 2025-04-01T13:23:13,797 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench 2025-04-01T13:23:13,799 copying build/lib/evalscope/third_party/thinkbench/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-04-01T13:23:13,802 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,803 copying build/lib/evalscope/third_party/thinkbench/resources/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,805 copying build/lib/evalscope/third_party/thinkbench/resources/reformat_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/resources 2025-04-01T13:23:13,807 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/thinkbench/tools 2025-04-01T13:23:13,808 copying build/lib/evalscope/third_party/thinkbench/tools/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-04-01T13:23:13,810 copying build/lib/evalscope/third_party/thinkbench/tools/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-04-01T13:23:13,812 copying build/lib/evalscope/third_party/thinkbench/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench/tools 2025-04-01T13:23:13,813 copying build/lib/evalscope/third_party/thinkbench/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-04-01T13:23:13,815 copying build/lib/evalscope/third_party/thinkbench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/thinkbench 2025-04-01T13:23:13,817 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static 2025-04-01T13:23:13,818 copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,821 creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:13,822 copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:13,824 copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm 2025-04-01T13:23:13,826 copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,828 copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,830 copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,832 copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,835 copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,836 copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,838 copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static 2025-04-01T13:23:13,840 copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party 2025-04-01T13:23:13,842 copying build/lib/evalscope/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:13,845 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks 2025-04-01T13:23:13,847 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval 2025-04-01T13:23:13,848 copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-04-01T13:23:13,850 copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-04-01T13:23:13,852 copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval 2025-04-01T13:23:13,855 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa 2025-04-01T13:23:13,856 copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-04-01T13:23:13,858 copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa 2025-04-01T13:23:13,861 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/iquiz 2025-04-01T13:23:13,862 copying build/lib/evalscope/benchmarks/iquiz/iquiz_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-04-01T13:23:13,864 copying build/lib/evalscope/benchmarks/iquiz/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/iquiz 2025-04-01T13:23:13,866 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,867 copying build/lib/evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,869 copying build/lib/evalscope/benchmarks/super_gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,870 copying build/lib/evalscope/benchmarks/super_gpqa/five_shot_prompt.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,872 copying build/lib/evalscope/benchmarks/super_gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,874 copying build/lib/evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/super_gpqa 2025-04-01T13:23:13,877 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/process_bench 2025-04-01T13:23:13,878 copying build/lib/evalscope/benchmarks/process_bench/process_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-04-01T13:23:13,880 copying build/lib/evalscope/benchmarks/process_bench/critique_template.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-04-01T13:23:13,882 copying build/lib/evalscope/benchmarks/process_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/process_bench 2025-04-01T13:23:13,884 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:13,885 copying build/lib/evalscope/benchmarks/mmlu_redux/mmlu_redux_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:13,887 copying build/lib/evalscope/benchmarks/mmlu_redux/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_redux 2025-04-01T13:23:13,889 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:13,891 copying build/lib/evalscope/benchmarks/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:13,892 copying build/lib/evalscope/benchmarks/alpaca_eval/alpaca_eval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/alpaca_eval 2025-04-01T13:23:13,895 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race 2025-04-01T13:23:13,896 copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-04-01T13:23:13,898 copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-04-01T13:23:13,900 copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-04-01T13:23:13,902 copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race 2025-04-01T13:23:13,904 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,906 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,907 copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,909 copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,911 copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa 2025-04-01T13:23:13,913 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh 2025-04-01T13:23:13,914 copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-04-01T13:23:13,917 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,919 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,921 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,922 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,924 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,926 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,928 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,929 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,931 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,933 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,935 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,937 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,939 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,941 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,943 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,945 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,948 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,950 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,952 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,955 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,957 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,959 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,961 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,963 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,965 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,967 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,969 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,972 copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts 2025-04-01T13:23:13,974 copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh 2025-04-01T13:23:13,976 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/musr 2025-04-01T13:23:13,978 copying build/lib/evalscope/benchmarks/musr/musr_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-04-01T13:23:13,980 copying build/lib/evalscope/benchmarks/musr/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/musr 2025-04-01T13:23:13,983 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:13,984 copying build/lib/evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:13,987 copying build/lib/evalscope/benchmarks/chinese_simple_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/chinese_simple_qa 2025-04-01T13:23:13,989 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math 2025-04-01T13:23:13,991 copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-04-01T13:23:13,993 copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-04-01T13:23:13,996 copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math 2025-04-01T13:23:13,999 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc 2025-04-01T13:23:14,000 copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-04-01T13:23:14,002 copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-04-01T13:23:14,005 copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc 2025-04-01T13:23:14,009 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:14,011 copying build/lib/evalscope/benchmarks/mmlu_pro/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:14,013 copying build/lib/evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu_pro 2025-04-01T13:23:14,015 copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-04-01T13:23:14,019 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/aime 2025-04-01T13:23:14,020 copying build/lib/evalscope/benchmarks/aime/aime25_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-04-01T13:23:14,022 copying build/lib/evalscope/benchmarks/aime/aime24_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-04-01T13:23:14,024 copying build/lib/evalscope/benchmarks/aime/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/aime 2025-04-01T13:23:14,027 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu 2025-04-01T13:23:14,028 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-04-01T13:23:14,031 copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-04-01T13:23:14,033 copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-04-01T13:23:14,035 copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu 2025-04-01T13:23:14,038 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ifeval 2025-04-01T13:23:14,040 copying build/lib/evalscope/benchmarks/ifeval/ifeval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,042 copying build/lib/evalscope/benchmarks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,045 copying build/lib/evalscope/benchmarks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,048 copying build/lib/evalscope/benchmarks/ifeval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,049 copying build/lib/evalscope/benchmarks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,052 copying build/lib/evalscope/benchmarks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ifeval 2025-04-01T13:23:14,055 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval 2025-04-01T13:23:14,056 copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-04-01T13:23:14,058 copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-04-01T13:23:14,061 copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval 2025-04-01T13:23:14,063 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arena_hard 2025-04-01T13:23:14,064 copying build/lib/evalscope/benchmarks/arena_hard/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arena_hard 2025-04-01T13:23:14,066 copying build/lib/evalscope/benchmarks/arena_hard/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arena_hard 2025-04-01T13:23:14,068 copying build/lib/evalscope/benchmarks/arena_hard/arena_hard_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arena_hard 2025-04-01T13:23:14,071 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k 2025-04-01T13:23:14,072 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-04-01T13:23:14,075 copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-04-01T13:23:14,076 copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k 2025-04-01T13:23:14,079 copying build/lib/evalscope/benchmarks/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-04-01T13:23:14,081 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/simple_qa 2025-04-01T13:23:14,082 copying build/lib/evalscope/benchmarks/simple_qa/simple_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-04-01T13:23:14,084 copying build/lib/evalscope/benchmarks/simple_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/simple_qa 2025-04-01T13:23:14,086 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/data_collection 2025-04-01T13:23:14,087 copying build/lib/evalscope/benchmarks/data_collection/data_collection_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-04-01T13:23:14,089 copying build/lib/evalscope/benchmarks/data_collection/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/data_collection 2025-04-01T13:23:14,091 copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-04-01T13:23:14,093 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gpqa 2025-04-01T13:23:14,095 copying build/lib/evalscope/benchmarks/gpqa/gpqa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-04-01T13:23:14,097 copying build/lib/evalscope/benchmarks/gpqa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-04-01T13:23:14,098 copying build/lib/evalscope/benchmarks/gpqa/chain_of_thought.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gpqa 2025-04-01T13:23:14,101 copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks 2025-04-01T13:23:14,104 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/math_500 2025-04-01T13:23:14,105 copying build/lib/evalscope/benchmarks/math_500/math_500_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-04-01T13:23:14,107 copying build/lib/evalscope/benchmarks/math_500/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/math_500 2025-04-01T13:23:14,109 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_mcq 2025-04-01T13:23:14,110 copying build/lib/evalscope/benchmarks/general_mcq/general_mcq_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-04-01T13:23:14,113 copying build/lib/evalscope/benchmarks/general_mcq/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_mcq 2025-04-01T13:23:14,115 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,116 copying build/lib/evalscope/benchmarks/live_code_bench/extract_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,119 copying build/lib/evalscope/benchmarks/live_code_bench/testing_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,121 copying build/lib/evalscope/benchmarks/live_code_bench/pass_k_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,123 copying build/lib/evalscope/benchmarks/live_code_bench/execute_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,125 copying build/lib/evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,127 copying build/lib/evalscope/benchmarks/live_code_bench/load_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,129 copying build/lib/evalscope/benchmarks/live_code_bench/evaluate_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,132 copying build/lib/evalscope/benchmarks/live_code_bench/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,133 copying build/lib/evalscope/benchmarks/live_code_bench/prompts.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/live_code_bench 2025-04-01T13:23:14,136 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa 2025-04-01T13:23:14,137 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-04-01T13:23:14,139 copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-04-01T13:23:14,142 copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa 2025-04-01T13:23:14,144 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu 2025-04-01T13:23:14,145 copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-04-01T13:23:14,148 copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-04-01T13:23:14,150 copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-04-01T13:23:14,152 copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu 2025-04-01T13:23:14,154 creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag 2025-04-01T13:23:14,155 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-04-01T13:23:14,157 copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-04-01T13:23:14,160 copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag 2025-04-01T13:23:14,162 creating build/bdist.linux-armv7l/wheel/evalscope/collections 2025-04-01T13:23:14,163 copying build/lib/evalscope/collections/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-04-01T13:23:14,166 copying build/lib/evalscope/collections/sampler.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-04-01T13:23:14,168 copying build/lib/evalscope/collections/schema.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-04-01T13:23:14,170 copying build/lib/evalscope/collections/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/collections 2025-04-01T13:23:14,172 creating build/bdist.linux-armv7l/wheel/evalscope/cli 2025-04-01T13:23:14,173 copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,175 copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,177 copying build/lib/evalscope/cli/start_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,179 copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,181 copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,182 copying build/lib/evalscope/cli/start_app.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,184 copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli 2025-04-01T13:23:14,187 creating build/bdist.linux-armv7l/wheel/evalscope/perf 2025-04-01T13:23:14,188 copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-04-01T13:23:14,190 copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-04-01T13:23:14,193 creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils 2025-04-01T13:23:14,194 copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,196 copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,198 copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,200 copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,202 copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,204 copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils 2025-04-01T13:23:14,205 copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-04-01T13:23:14,207 copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-04-01T13:23:14,209 copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf 2025-04-01T13:23:14,211 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin 2025-04-01T13:23:14,213 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api 2025-04-01T13:23:14,214 copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-04-01T13:23:14,216 copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-04-01T13:23:14,218 copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-04-01T13:23:14,221 copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-04-01T13:23:14,222 copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api 2025-04-01T13:23:14,225 creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets 2025-04-01T13:23:14,226 copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,228 copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,230 copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,232 copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,234 copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,236 copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,237 copying build/lib/evalscope/perf/plugin/datasets/random_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,240 copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,241 copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets 2025-04-01T13:23:14,243 copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-04-01T13:23:14,245 copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin 2025-04-01T13:23:14,248 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator 2025-04-01T13:23:14,249 creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer 2025-04-01T13:23:14,251 copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-04-01T13:23:14,253 copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer 2025-04-01T13:23:14,255 copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-04-01T13:23:14,257 copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-04-01T13:23:14,259 copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator 2025-04-01T13:23:14,262 creating build/bdist.linux-armv7l/wheel/evalscope/utils 2025-04-01T13:23:14,263 copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,265 copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,267 copying build/lib/evalscope/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,269 copying build/lib/evalscope/utils/io_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,271 copying build/lib/evalscope/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,273 copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,275 copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,277 copying build/lib/evalscope/utils/filters.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,279 copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils 2025-04-01T13:23:14,281 copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:14,282 copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:14,285 creating build/bdist.linux-armv7l/wheel/evalscope/registry 2025-04-01T13:23:14,287 creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks 2025-04-01T13:23:14,288 copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,290 copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,292 copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,294 copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,295 copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,297 copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,299 copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,301 copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,303 copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,304 copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,306 copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks 2025-04-01T13:23:14,309 creating build/bdist.linux-armv7l/wheel/evalscope/registry/config 2025-04-01T13:23:14,310 copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-04-01T13:23:14,312 copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-04-01T13:23:14,314 copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-04-01T13:23:14,316 copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config 2025-04-01T13:23:14,318 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data 2025-04-01T13:23:14,319 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser 2025-04-01T13:23:14,321 copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-04-01T13:23:14,349 copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser 2025-04-01T13:23:14,351 creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template 2025-04-01T13:23:14,352 copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-04-01T13:23:14,355 copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template 2025-04-01T13:23:14,357 copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data 2025-04-01T13:23:14,359 copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry 2025-04-01T13:23:14,361 creating build/bdist.linux-armv7l/wheel/evalscope/models 2025-04-01T13:23:14,362 copying build/lib/evalscope/models/server_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,365 copying build/lib/evalscope/models/custom_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,367 copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,369 copying build/lib/evalscope/models/base_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,371 copying build/lib/evalscope/models/chat_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,372 copying build/lib/evalscope/models/local_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,375 copying build/lib/evalscope/models/register.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,376 copying build/lib/evalscope/models/choice_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,379 creating build/bdist.linux-armv7l/wheel/evalscope/models/custom 2025-04-01T13:23:14,380 copying build/lib/evalscope/models/custom/dummy_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-04-01T13:23:14,383 copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-04-01T13:23:14,384 copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom 2025-04-01T13:23:14,386 copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models 2025-04-01T13:23:14,388 copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:14,391 creating build/bdist.linux-armv7l/wheel/evalscope/backend 2025-04-01T13:23:14,392 creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit 2025-04-01T13:23:14,393 copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-04-01T13:23:14,396 copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-04-01T13:23:14,398 copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit 2025-04-01T13:23:14,400 copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-04-01T13:23:14,402 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval 2025-04-01T13:23:14,403 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:14,405 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:14,407 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:14,410 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:14,411 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:14,413 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:14,415 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:14,417 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks 2025-04-01T13:23:14,419 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:14,421 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:14,422 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:14,425 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils 2025-04-01T13:23:14,427 copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark 2025-04-01T13:23:14,429 copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-04-01T13:23:14,431 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,432 copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,435 copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,436 copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,439 copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,440 copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils 2025-04-01T13:23:14,443 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas 2025-04-01T13:23:14,444 copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-04-01T13:23:14,447 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,448 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,450 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,452 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,454 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_distribution.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,456 copying build/lib/evalscope/backend/rag_eval/ragas/tasks/build_transform.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks 2025-04-01T13:23:14,459 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts 2025-04-01T13:23:14,460 copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts 2025-04-01T13:23:14,462 copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-04-01T13:23:14,463 copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas 2025-04-01T13:23:14,466 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:14,467 copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:14,469 copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:14,472 creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,473 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,475 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,478 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,480 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,482 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,485 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,487 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,489 copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks 2025-04-01T13:23:14,491 copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:14,493 copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb 2025-04-01T13:23:14,495 copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval 2025-04-01T13:23:14,497 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass 2025-04-01T13:23:14,498 copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-04-01T13:23:14,501 copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-04-01T13:23:14,503 creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks 2025-04-01T13:23:14,505 copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-04-01T13:23:14,507 copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-04-01T13:23:14,508 copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks 2025-04-01T13:23:14,510 copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass 2025-04-01T13:23:14,512 copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend 2025-04-01T13:23:14,513 copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:14,515 copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope 2025-04-01T13:23:14,518 creating build/bdist.linux-armv7l/wheel/tests 2025-04-01T13:23:14,520 creating build/bdist.linux-armv7l/wheel/tests/swift 2025-04-01T13:23:14,521 copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-04-01T13:23:14,523 copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-04-01T13:23:14,526 copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-04-01T13:23:14,527 copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift 2025-04-01T13:23:14,530 creating build/bdist.linux-armv7l/wheel/tests/vlm 2025-04-01T13:23:14,531 copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-04-01T13:23:14,533 copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm 2025-04-01T13:23:14,535 creating build/bdist.linux-armv7l/wheel/tests/cli 2025-04-01T13:23:14,537 copying build/lib/tests/cli/test_all.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-04-01T13:23:14,539 copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-04-01T13:23:14,542 copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-04-01T13:23:14,544 copying build/lib/tests/cli/test_collection.py -> build/bdist.linux-armv7l/wheel/./tests/cli 2025-04-01T13:23:14,547 creating build/bdist.linux-armv7l/wheel/tests/perf 2025-04-01T13:23:14,548 copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-04-01T13:23:14,550 copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf 2025-04-01T13:23:14,552 creating build/bdist.linux-armv7l/wheel/tests/rag 2025-04-01T13:23:14,553 copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-04-01T13:23:14,555 copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-04-01T13:23:14,557 copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-04-01T13:23:14,559 copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag 2025-04-01T13:23:14,561 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-04-01T13:23:14,563 copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests 2025-04-01T13:23:14,564 running install_egg_info 2025-04-01T13:23:14,600 Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.13.2-py3.11.egg-info 2025-04-01T13:23:14,618 running install_scripts 2025-04-01T13:23:14,661 creating build/bdist.linux-armv7l/wheel/evalscope-0.13.2.dist-info/WHEEL 2025-04-01T13:23:14,664 creating '/tmp/pip-wheel-8to7gfe8/evalscope-0.13.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-04-01T13:23:14,666 adding 'evalscope/__init__.py' 2025-04-01T13:23:14,667 adding 'evalscope/arguments.py' 2025-04-01T13:23:14,669 adding 'evalscope/config.py' 2025-04-01T13:23:14,671 adding 'evalscope/constants.py' 2025-04-01T13:23:14,672 adding 'evalscope/run.py' 2025-04-01T13:23:14,674 adding 'evalscope/run_arena.py' 2025-04-01T13:23:14,675 adding 'evalscope/summarizer.py' 2025-04-01T13:23:14,676 adding 'evalscope/version.py' 2025-04-01T13:23:14,678 adding 'evalscope/backend/__init__.py' 2025-04-01T13:23:14,679 adding 'evalscope/backend/base.py' 2025-04-01T13:23:14,681 adding 'evalscope/backend/opencompass/__init__.py' 2025-04-01T13:23:14,682 adding 'evalscope/backend/opencompass/api_meta_template.py' 2025-04-01T13:23:14,684 adding 'evalscope/backend/opencompass/backend_manager.py' 2025-04-01T13:23:14,686 adding 'evalscope/backend/opencompass/tasks/__init__.py' 2025-04-01T13:23:14,687 adding 'evalscope/backend/opencompass/tasks/eval_api.py' 2025-04-01T13:23:14,688 adding 'evalscope/backend/opencompass/tasks/eval_datasets.py' 2025-04-01T13:23:14,690 adding 'evalscope/backend/rag_eval/__init__.py' 2025-04-01T13:23:14,692 adding 'evalscope/backend/rag_eval/backend_manager.py' 2025-04-01T13:23:14,693 adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py' 2025-04-01T13:23:14,695 adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py' 2025-04-01T13:23:14,696 adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py' 2025-04-01T13:23:14,698 adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py' 2025-04-01T13:23:14,699 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py' 2025-04-01T13:23:14,701 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py' 2025-04-01T13:23:14,702 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py' 2025-04-01T13:23:14,704 adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py' 2025-04-01T13:23:14,706 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py' 2025-04-01T13:23:14,707 adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt' 2025-04-01T13:23:14,709 adding 'evalscope/backend/rag_eval/cmteb/__init__.py' 2025-04-01T13:23:14,711 adding 'evalscope/backend/rag_eval/cmteb/arguments.py' 2025-04-01T13:23:14,712 adding 'evalscope/backend/rag_eval/cmteb/base.py' 2025-04-01T13:23:14,713 adding 'evalscope/backend/rag_eval/cmteb/task_template.py' 2025-04-01T13:23:14,715 adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py' 2025-04-01T13:23:14,717 adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py' 2025-04-01T13:23:14,719 adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py' 2025-04-01T13:23:14,720 adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py' 2025-04-01T13:23:14,722 adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py' 2025-04-01T13:23:14,723 adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py' 2025-04-01T13:23:14,725 adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py' 2025-04-01T13:23:14,727 adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py' 2025-04-01T13:23:14,728 adding 'evalscope/backend/rag_eval/ragas/__init__.py' 2025-04-01T13:23:14,730 adding 'evalscope/backend/rag_eval/ragas/arguments.py' 2025-04-01T13:23:14,731 adding 'evalscope/backend/rag_eval/ragas/task_template.py' 2025-04-01T13:23:14,733 adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py' 2025-04-01T13:23:14,735 adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py' 2025-04-01T13:23:14,736 adding 'evalscope/backend/rag_eval/ragas/tasks/build_distribution.py' 2025-04-01T13:23:14,738 adding 'evalscope/backend/rag_eval/ragas/tasks/build_transform.py' 2025-04-01T13:23:14,740 adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py' 2025-04-01T13:23:14,741 adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py' 2025-04-01T13:23:14,743 adding 'evalscope/backend/rag_eval/utils/__init__.py' 2025-04-01T13:23:14,744 adding 'evalscope/backend/rag_eval/utils/clip.py' 2025-04-01T13:23:14,746 adding 'evalscope/backend/rag_eval/utils/embedding.py' 2025-04-01T13:23:14,747 adding 'evalscope/backend/rag_eval/utils/llm.py' 2025-04-01T13:23:14,748 adding 'evalscope/backend/rag_eval/utils/tools.py' 2025-04-01T13:23:14,750 adding 'evalscope/backend/vlm_eval_kit/__init__.py' 2025-04-01T13:23:14,751 adding 'evalscope/backend/vlm_eval_kit/backend_manager.py' 2025-04-01T13:23:14,752 adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py' 2025-04-01T13:23:14,754 adding 'evalscope/benchmarks/__init__.py' 2025-04-01T13:23:14,756 adding 'evalscope/benchmarks/benchmark.py' 2025-04-01T13:23:14,758 adding 'evalscope/benchmarks/data_adapter.py' 2025-04-01T13:23:14,760 adding 'evalscope/benchmarks/utils.py' 2025-04-01T13:23:14,762 adding 'evalscope/benchmarks/aime/__init__.py' 2025-04-01T13:23:14,763 adding 'evalscope/benchmarks/aime/aime24_adapter.py' 2025-04-01T13:23:14,765 adding 'evalscope/benchmarks/aime/aime25_adapter.py' 2025-04-01T13:23:14,767 adding 'evalscope/benchmarks/alpaca_eval/__init__.py' 2025-04-01T13:23:14,768 adding 'evalscope/benchmarks/alpaca_eval/alpaca_eval_adapter.py' 2025-04-01T13:23:14,770 adding 'evalscope/benchmarks/arc/__init__.py' 2025-04-01T13:23:14,771 adding 'evalscope/benchmarks/arc/ai2_arc.py' 2025-04-01T13:23:14,773 adding 'evalscope/benchmarks/arc/arc_adapter.py' 2025-04-01T13:23:14,775 adding 'evalscope/benchmarks/arena_hard/__init__.py' 2025-04-01T13:23:14,777 adding 'evalscope/benchmarks/arena_hard/arena_hard_adapter.py' 2025-04-01T13:23:14,779 adding 'evalscope/benchmarks/arena_hard/utils.py' 2025-04-01T13:23:14,780 adding 'evalscope/benchmarks/bbh/__init__.py' 2025-04-01T13:23:14,782 adding 'evalscope/benchmarks/bbh/bbh_adapter.py' 2025-04-01T13:23:14,784 adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt' 2025-04-01T13:23:14,786 adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt' 2025-04-01T13:23:14,787 adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt' 2025-04-01T13:23:14,788 adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt' 2025-04-01T13:23:14,790 adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt' 2025-04-01T13:23:14,791 adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt' 2025-04-01T13:23:14,792 adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt' 2025-04-01T13:23:14,794 adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt' 2025-04-01T13:23:14,795 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt' 2025-04-01T13:23:14,796 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt' 2025-04-01T13:23:14,798 adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt' 2025-04-01T13:23:14,799 adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt' 2025-04-01T13:23:14,800 adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt' 2025-04-01T13:23:14,801 adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt' 2025-04-01T13:23:14,803 adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt' 2025-04-01T13:23:14,804 adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt' 2025-04-01T13:23:14,805 adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt' 2025-04-01T13:23:14,807 adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt' 2025-04-01T13:23:14,808 adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt' 2025-04-01T13:23:14,809 adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt' 2025-04-01T13:23:14,811 adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt' 2025-04-01T13:23:14,812 adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt' 2025-04-01T13:23:14,813 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt' 2025-04-01T13:23:14,814 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt' 2025-04-01T13:23:14,816 adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt' 2025-04-01T13:23:14,817 adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt' 2025-04-01T13:23:14,818 adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt' 2025-04-01T13:23:14,820 adding 'evalscope/benchmarks/ceval/__init__.py' 2025-04-01T13:23:14,821 adding 'evalscope/benchmarks/ceval/ceval_adapter.py' 2025-04-01T13:23:14,823 adding 'evalscope/benchmarks/ceval/ceval_exam.py' 2025-04-01T13:23:14,824 adding 'evalscope/benchmarks/chinese_simple_qa/__init__.py' 2025-04-01T13:23:14,826 adding 'evalscope/benchmarks/chinese_simple_qa/csimple_qa_adapter.py' 2025-04-01T13:23:14,827 adding 'evalscope/benchmarks/cmmlu/__init__.py' 2025-04-01T13:23:14,829 adding 'evalscope/benchmarks/cmmlu/cmmlu.py' 2025-04-01T13:23:14,831 adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py' 2025-04-01T13:23:14,832 adding 'evalscope/benchmarks/cmmlu/samples.jsonl' 2025-04-01T13:23:14,834 adding 'evalscope/benchmarks/competition_math/__init__.py' 2025-04-01T13:23:14,835 adding 'evalscope/benchmarks/competition_math/competition_math.py' 2025-04-01T13:23:14,837 adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py' 2025-04-01T13:23:14,839 adding 'evalscope/benchmarks/data_collection/__init__.py' 2025-04-01T13:23:14,840 adding 'evalscope/benchmarks/data_collection/data_collection_adapter.py' 2025-04-01T13:23:14,841 adding 'evalscope/benchmarks/general_mcq/__init__.py' 2025-04-01T13:23:14,843 adding 'evalscope/benchmarks/general_mcq/general_mcq_adapter.py' 2025-04-01T13:23:14,845 adding 'evalscope/benchmarks/general_qa/__init__.py' 2025-04-01T13:23:14,846 adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py' 2025-04-01T13:23:14,848 adding 'evalscope/benchmarks/gpqa/__init__.py' 2025-04-01T13:23:14,849 adding 'evalscope/benchmarks/gpqa/chain_of_thought.txt' 2025-04-01T13:23:14,851 adding 'evalscope/benchmarks/gpqa/gpqa_adapter.py' 2025-04-01T13:23:14,853 adding 'evalscope/benchmarks/gsm8k/__init__.py' 2025-04-01T13:23:14,854 adding 'evalscope/benchmarks/gsm8k/gsm8k.py' 2025-04-01T13:23:14,856 adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py' 2025-04-01T13:23:14,858 adding 'evalscope/benchmarks/hellaswag/__init__.py' 2025-04-01T13:23:14,859 adding 'evalscope/benchmarks/hellaswag/hellaswag.py' 2025-04-01T13:23:14,861 adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py' 2025-04-01T13:23:14,863 adding 'evalscope/benchmarks/humaneval/__init__.py' 2025-04-01T13:23:14,864 adding 'evalscope/benchmarks/humaneval/humaneval.py' 2025-04-01T13:23:14,866 adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py' 2025-04-01T13:23:14,867 adding 'evalscope/benchmarks/ifeval/__init__.py' 2025-04-01T13:23:14,869 adding 'evalscope/benchmarks/ifeval/ifeval_adapter.py' 2025-04-01T13:23:14,874 adding 'evalscope/benchmarks/ifeval/instructions.py' 2025-04-01T13:23:14,876 adding 'evalscope/benchmarks/ifeval/instructions_registry.py' 2025-04-01T13:23:14,879 adding 'evalscope/benchmarks/ifeval/instructions_util.py' 2025-04-01T13:23:14,881 adding 'evalscope/benchmarks/ifeval/utils.py' 2025-04-01T13:23:14,882 adding 'evalscope/benchmarks/iquiz/__init__.py' 2025-04-01T13:23:14,884 adding 'evalscope/benchmarks/iquiz/iquiz_adapter.py' 2025-04-01T13:23:14,885 adding 'evalscope/benchmarks/live_code_bench/__init__.py' 2025-04-01T13:23:14,887 adding 'evalscope/benchmarks/live_code_bench/evaluate_utils.py' 2025-04-01T13:23:14,889 adding 'evalscope/benchmarks/live_code_bench/execute_utils.py' 2025-04-01T13:23:14,890 adding 'evalscope/benchmarks/live_code_bench/extract_utils.py' 2025-04-01T13:23:14,892 adding 'evalscope/benchmarks/live_code_bench/live_code_bench_adapter.py' 2025-04-01T13:23:14,893 adding 'evalscope/benchmarks/live_code_bench/load_utils.py' 2025-04-01T13:23:14,895 adding 'evalscope/benchmarks/live_code_bench/pass_k_utils.py' 2025-04-01T13:23:14,896 adding 'evalscope/benchmarks/live_code_bench/prompts.py' 2025-04-01T13:23:14,899 adding 'evalscope/benchmarks/live_code_bench/testing_util.py' 2025-04-01T13:23:14,901 adding 'evalscope/benchmarks/math_500/__init__.py' 2025-04-01T13:23:14,903 adding 'evalscope/benchmarks/math_500/math_500_adapter.py' 2025-04-01T13:23:14,904 adding 'evalscope/benchmarks/mmlu/__init__.py' 2025-04-01T13:23:14,906 adding 'evalscope/benchmarks/mmlu/mmlu.py' 2025-04-01T13:23:14,907 adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py' 2025-04-01T13:23:14,909 adding 'evalscope/benchmarks/mmlu/samples.jsonl' 2025-04-01T13:23:14,910 adding 'evalscope/benchmarks/mmlu_pro/__init__.py' 2025-04-01T13:23:14,912 adding 'evalscope/benchmarks/mmlu_pro/mmlu_pro_adapter.py' 2025-04-01T13:23:14,913 adding 'evalscope/benchmarks/mmlu_redux/__init__.py' 2025-04-01T13:23:14,915 adding 'evalscope/benchmarks/mmlu_redux/mmlu_redux_adapter.py' 2025-04-01T13:23:14,916 adding 'evalscope/benchmarks/musr/__init__.py' 2025-04-01T13:23:14,918 adding 'evalscope/benchmarks/musr/musr_adapter.py' 2025-04-01T13:23:14,919 adding 'evalscope/benchmarks/process_bench/__init__.py' 2025-04-01T13:23:14,920 adding 'evalscope/benchmarks/process_bench/critique_template.txt' 2025-04-01T13:23:14,922 adding 'evalscope/benchmarks/process_bench/process_bench_adapter.py' 2025-04-01T13:23:14,924 adding 'evalscope/benchmarks/race/__init__.py' 2025-04-01T13:23:14,925 adding 'evalscope/benchmarks/race/race.py' 2025-04-01T13:23:14,927 adding 'evalscope/benchmarks/race/race_adapter.py' 2025-04-01T13:23:14,928 adding 'evalscope/benchmarks/race/samples.jsonl' 2025-04-01T13:23:14,930 adding 'evalscope/benchmarks/simple_qa/__init__.py' 2025-04-01T13:23:14,931 adding 'evalscope/benchmarks/simple_qa/simple_qa_adapter.py' 2025-04-01T13:23:14,933 adding 'evalscope/benchmarks/super_gpqa/__init__.py' 2025-04-01T13:23:14,935 adding 'evalscope/benchmarks/super_gpqa/five_shot_prompt.txt' 2025-04-01T13:23:14,936 adding 'evalscope/benchmarks/super_gpqa/super_gpqa_adapter.py' 2025-04-01T13:23:14,938 adding 'evalscope/benchmarks/super_gpqa/utils.py' 2025-04-01T13:23:14,939 adding 'evalscope/benchmarks/super_gpqa/zero_shot_prompt.txt' 2025-04-01T13:23:14,940 adding 'evalscope/benchmarks/trivia_qa/__init__.py' 2025-04-01T13:23:14,942 adding 'evalscope/benchmarks/trivia_qa/samples.jsonl' 2025-04-01T13:23:14,943 adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py' 2025-04-01T13:23:14,945 adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py' 2025-04-01T13:23:14,946 adding 'evalscope/benchmarks/truthful_qa/__init__.py' 2025-04-01T13:23:14,948 adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py' 2025-04-01T13:23:14,950 adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py' 2025-04-01T13:23:14,952 adding 'evalscope/cli/__init__.py' 2025-04-01T13:23:14,953 adding 'evalscope/cli/base.py' 2025-04-01T13:23:14,954 adding 'evalscope/cli/cli.py' 2025-04-01T13:23:14,955 adding 'evalscope/cli/start_app.py' 2025-04-01T13:23:14,956 adding 'evalscope/cli/start_eval.py' 2025-04-01T13:23:14,957 adding 'evalscope/cli/start_perf.py' 2025-04-01T13:23:14,959 adding 'evalscope/cli/start_server.py' 2025-04-01T13:23:14,961 adding 'evalscope/collections/__init__.py' 2025-04-01T13:23:14,963 adding 'evalscope/collections/evaluator.py' 2025-04-01T13:23:14,964 adding 'evalscope/collections/sampler.py' 2025-04-01T13:23:14,966 adding 'evalscope/collections/schema.py' 2025-04-01T13:23:14,967 adding 'evalscope/evaluator/__init__.py' 2025-04-01T13:23:14,970 adding 'evalscope/evaluator/evaluator.py' 2025-04-01T13:23:14,972 adding 'evalscope/evaluator/rating_eval.py' 2025-04-01T13:23:14,973 adding 'evalscope/evaluator/reviewer/__init__.py' 2025-04-01T13:23:14,975 adding 'evalscope/evaluator/reviewer/auto_reviewer.py' 2025-04-01T13:23:14,978 adding 'evalscope/metrics/__init__.py' 2025-04-01T13:23:14,979 adding 'evalscope/metrics/code_metric.py' 2025-04-01T13:23:14,980 adding 'evalscope/metrics/llm_judge.py' 2025-04-01T13:23:14,982 adding 'evalscope/metrics/math_parser.py' 2025-04-01T13:23:14,985 adding 'evalscope/metrics/metrics.py' 2025-04-01T13:23:14,986 adding 'evalscope/metrics/named_metrics.py' 2025-04-01T13:23:14,988 adding 'evalscope/metrics/rouge_metric.py' 2025-04-01T13:23:14,990 adding 'evalscope/metrics/bundled_rouge_score/__init__.py' 2025-04-01T13:23:14,991 adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py' 2025-04-01T13:23:15,149 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe' 2025-04-01T13:23:15,392 adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json' 2025-04-01T13:23:15,402 adding 'evalscope/models/__init__.py' 2025-04-01T13:23:15,403 adding 'evalscope/models/base_adapter.py' 2025-04-01T13:23:15,405 adding 'evalscope/models/chat_adapter.py' 2025-04-01T13:23:15,406 adding 'evalscope/models/choice_adapter.py' 2025-04-01T13:23:15,408 adding 'evalscope/models/custom_adapter.py' 2025-04-01T13:23:15,409 adding 'evalscope/models/local_model.py' 2025-04-01T13:23:15,411 adding 'evalscope/models/model.py' 2025-04-01T13:23:15,412 adding 'evalscope/models/register.py' 2025-04-01T13:23:15,414 adding 'evalscope/models/server_adapter.py' 2025-04-01T13:23:15,415 adding 'evalscope/models/custom/__init__.py' 2025-04-01T13:23:15,417 adding 'evalscope/models/custom/custom_model.py' 2025-04-01T13:23:15,418 adding 'evalscope/models/custom/dummy_model.py' 2025-04-01T13:23:15,420 adding 'evalscope/perf/__init__.py' 2025-04-01T13:23:15,421 adding 'evalscope/perf/arguments.py' 2025-04-01T13:23:15,423 adding 'evalscope/perf/benchmark.py' 2025-04-01T13:23:15,425 adding 'evalscope/perf/http_client.py' 2025-04-01T13:23:15,426 adding 'evalscope/perf/main.py' 2025-04-01T13:23:15,428 adding 'evalscope/perf/plugin/__init__.py' 2025-04-01T13:23:15,429 adding 'evalscope/perf/plugin/registry.py' 2025-04-01T13:23:15,431 adding 'evalscope/perf/plugin/api/__init__.py' 2025-04-01T13:23:15,432 adding 'evalscope/perf/plugin/api/base.py' 2025-04-01T13:23:15,433 adding 'evalscope/perf/plugin/api/custom_api.py' 2025-04-01T13:23:15,435 adding 'evalscope/perf/plugin/api/dashscope_api.py' 2025-04-01T13:23:15,436 adding 'evalscope/perf/plugin/api/openai_api.py' 2025-04-01T13:23:15,439 adding 'evalscope/perf/plugin/datasets/__init__.py' 2025-04-01T13:23:15,440 adding 'evalscope/perf/plugin/datasets/base.py' 2025-04-01T13:23:15,441 adding 'evalscope/perf/plugin/datasets/custom.py' 2025-04-01T13:23:15,442 adding 'evalscope/perf/plugin/datasets/flickr8k.py' 2025-04-01T13:23:15,444 adding 'evalscope/perf/plugin/datasets/line_by_line.py' 2025-04-01T13:23:15,445 adding 'evalscope/perf/plugin/datasets/longalpaca.py' 2025-04-01T13:23:15,446 adding 'evalscope/perf/plugin/datasets/openqa.py' 2025-04-01T13:23:15,448 adding 'evalscope/perf/plugin/datasets/random_dataset.py' 2025-04-01T13:23:15,449 adding 'evalscope/perf/plugin/datasets/speed_benchmark.py' 2025-04-01T13:23:15,451 adding 'evalscope/perf/utils/__init__.py' 2025-04-01T13:23:15,452 adding 'evalscope/perf/utils/analysis_result.py' 2025-04-01T13:23:15,453 adding 'evalscope/perf/utils/benchmark_util.py' 2025-04-01T13:23:15,455 adding 'evalscope/perf/utils/db_util.py' 2025-04-01T13:23:15,456 adding 'evalscope/perf/utils/handler.py' 2025-04-01T13:23:15,458 adding 'evalscope/perf/utils/local_server.py' 2025-04-01T13:23:15,459 adding 'evalscope/registry/__init__.py' 2025-04-01T13:23:15,461 adding 'evalscope/registry/config/cfg_arena.yaml' 2025-04-01T13:23:15,463 adding 'evalscope/registry/config/cfg_arena_zhihu.yaml' 2025-04-01T13:23:15,464 adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml' 2025-04-01T13:23:15,465 adding 'evalscope/registry/config/cfg_single.yaml' 2025-04-01T13:23:15,468 adding 'evalscope/registry/data/question.jsonl' 2025-04-01T13:23:15,470 adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl' 2025-04-01T13:23:15,472 adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl' 2025-04-01T13:23:15,634 adding 'evalscope/registry/data/qa_browser/battle.jsonl' 2025-04-01T13:23:15,643 adding 'evalscope/registry/data/qa_browser/category_mapping.yaml' 2025-04-01T13:23:15,644 adding 'evalscope/registry/tasks/arc.yaml' 2025-04-01T13:23:15,645 adding 'evalscope/registry/tasks/bbh.yaml' 2025-04-01T13:23:15,647 adding 'evalscope/registry/tasks/bbh_mini.yaml' 2025-04-01T13:23:15,648 adding 'evalscope/registry/tasks/ceval.yaml' 2025-04-01T13:23:15,649 adding 'evalscope/registry/tasks/ceval_mini.yaml' 2025-04-01T13:23:15,650 adding 'evalscope/registry/tasks/cmmlu.yaml' 2025-04-01T13:23:15,651 adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml' 2025-04-01T13:23:15,652 adding 'evalscope/registry/tasks/general_qa.yaml' 2025-04-01T13:23:15,653 adding 'evalscope/registry/tasks/gsm8k.yaml' 2025-04-01T13:23:15,655 adding 'evalscope/registry/tasks/mmlu.yaml' 2025-04-01T13:23:15,656 adding 'evalscope/registry/tasks/mmlu_mini.yaml' 2025-04-01T13:23:15,658 adding 'evalscope/report/__init__.py' 2025-04-01T13:23:15,661 adding 'evalscope/report/app.py' 2025-04-01T13:23:15,662 adding 'evalscope/report/combinator.py' 2025-04-01T13:23:15,664 adding 'evalscope/report/generator.py' 2025-04-01T13:23:15,665 adding 'evalscope/report/utils.py' 2025-04-01T13:23:15,667 adding 'evalscope/third_party/__init__.py' 2025-04-01T13:23:15,669 adding 'evalscope/third_party/longbench_write/README.md' 2025-04-01T13:23:15,670 adding 'evalscope/third_party/longbench_write/__init__.py' 2025-04-01T13:23:15,671 adding 'evalscope/third_party/longbench_write/default_task.json' 2025-04-01T13:23:15,673 adding 'evalscope/third_party/longbench_write/default_task.yaml' 2025-04-01T13:23:15,675 adding 'evalscope/third_party/longbench_write/eval.py' 2025-04-01T13:23:15,676 adding 'evalscope/third_party/longbench_write/infer.py' 2025-04-01T13:23:15,678 adding 'evalscope/third_party/longbench_write/longbench_write.py' 2025-04-01T13:23:15,679 adding 'evalscope/third_party/longbench_write/utils.py' 2025-04-01T13:23:15,680 adding 'evalscope/third_party/longbench_write/resources/__init__.py' 2025-04-01T13:23:15,682 adding 'evalscope/third_party/longbench_write/resources/judge.txt' 2025-04-01T13:23:15,689 adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl' 2025-04-01T13:23:15,693 adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl' 2025-04-01T13:23:15,694 adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl' 2025-04-01T13:23:15,696 adding 'evalscope/third_party/longbench_write/tools/__init__.py' 2025-04-01T13:23:15,698 adding 'evalscope/third_party/longbench_write/tools/data_etl.py' 2025-04-01T13:23:15,699 adding 'evalscope/third_party/longbench_write/tools/openai_api.py' 2025-04-01T13:23:15,701 adding 'evalscope/third_party/thinkbench/__init__.py' 2025-04-01T13:23:15,704 adding 'evalscope/third_party/thinkbench/eval.py' 2025-04-01T13:23:15,705 adding 'evalscope/third_party/thinkbench/infer.py' 2025-04-01T13:23:15,707 adding 'evalscope/third_party/thinkbench/resources/critique_template.txt' 2025-04-01T13:23:15,708 adding 'evalscope/third_party/thinkbench/resources/reformat_template.txt' 2025-04-01T13:23:15,710 adding 'evalscope/third_party/thinkbench/tools/__init__.py' 2025-04-01T13:23:15,711 adding 'evalscope/third_party/thinkbench/tools/llm.py' 2025-04-01T13:23:15,712 adding 'evalscope/third_party/thinkbench/tools/utils.py' 2025-04-01T13:23:15,714 adding 'evalscope/third_party/toolbench_static/README.md' 2025-04-01T13:23:15,716 adding 'evalscope/third_party/toolbench_static/__init__.py' 2025-04-01T13:23:15,717 adding 'evalscope/third_party/toolbench_static/config_default.json' 2025-04-01T13:23:15,718 adding 'evalscope/third_party/toolbench_static/config_default.yaml' 2025-04-01T13:23:15,720 adding 'evalscope/third_party/toolbench_static/eval.py' 2025-04-01T13:23:15,721 adding 'evalscope/third_party/toolbench_static/infer.py' 2025-04-01T13:23:15,723 adding 'evalscope/third_party/toolbench_static/requirements.txt' 2025-04-01T13:23:15,724 adding 'evalscope/third_party/toolbench_static/toolbench_static.py' 2025-04-01T13:23:15,725 adding 'evalscope/third_party/toolbench_static/llm/__init__.py' 2025-04-01T13:23:15,727 adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py' 2025-04-01T13:23:15,728 adding 'evalscope/utils/__init__.py' 2025-04-01T13:23:15,730 adding 'evalscope/utils/arena_utils.py' 2025-04-01T13:23:15,731 adding 'evalscope/utils/chat_service.py' 2025-04-01T13:23:15,733 adding 'evalscope/utils/completion_parsers.py' 2025-04-01T13:23:15,734 adding 'evalscope/utils/filters.py' 2025-04-01T13:23:15,735 adding 'evalscope/utils/io_utils.py' 2025-04-01T13:23:15,736 adding 'evalscope/utils/logger.py' 2025-04-01T13:23:15,737 adding 'evalscope/utils/model_utils.py' 2025-04-01T13:23:15,739 adding 'evalscope/utils/utils.py' 2025-04-01T13:23:15,742 adding 'tests/__init__.py' 2025-04-01T13:23:15,743 adding 'tests/test_run_all.py' 2025-04-01T13:23:15,744 adding 'tests/cli/__init__.py' 2025-04-01T13:23:15,746 adding 'tests/cli/test_all.py' 2025-04-01T13:23:15,747 adding 'tests/cli/test_collection.py' 2025-04-01T13:23:15,749 adding 'tests/cli/test_run.py' 2025-04-01T13:23:15,751 adding 'tests/perf/__init__.py' 2025-04-01T13:23:15,752 adding 'tests/perf/test_perf.py' 2025-04-01T13:23:15,754 adding 'tests/rag/__init__.py' 2025-04-01T13:23:15,755 adding 'tests/rag/test_clip_benchmark.py' 2025-04-01T13:23:15,756 adding 'tests/rag/test_mteb.py' 2025-04-01T13:23:15,758 adding 'tests/rag/test_ragas.py' 2025-04-01T13:23:15,760 adding 'tests/swift/__init__.py' 2025-04-01T13:23:15,761 adding 'tests/swift/test_run_swift_eval.py' 2025-04-01T13:23:15,763 adding 'tests/swift/test_run_swift_vlm_eval.py' 2025-04-01T13:23:15,764 adding 'tests/swift/test_run_swift_vlm_jugde_eval.py' 2025-04-01T13:23:15,766 adding 'tests/vlm/__init__.py' 2025-04-01T13:23:15,767 adding 'tests/vlm/test_vlmeval.py' 2025-04-01T13:23:15,769 adding 'evalscope-0.13.2.dist-info/LICENSE' 2025-04-01T13:23:15,773 adding 'evalscope-0.13.2.dist-info/METADATA' 2025-04-01T13:23:15,775 adding 'evalscope-0.13.2.dist-info/WHEEL' 2025-04-01T13:23:15,776 adding 'evalscope-0.13.2.dist-info/entry_points.txt' 2025-04-01T13:23:15,778 adding 'evalscope-0.13.2.dist-info/top_level.txt' 2025-04-01T13:23:15,782 adding 'evalscope-0.13.2.dist-info/RECORD' 2025-04-01T13:23:15,803 removing build/bdist.linux-armv7l/wheel 2025-04-01T13:23:16,022 Building wheel for evalscope (setup.py): finished with status 'done' 2025-04-01T13:23:16,040 Created wheel for evalscope: filename=evalscope-0.13.2-py3-none-any.whl size=1508678 sha256=7d360083cf9dd960996847cde2140085d0830ddc8b12aa8007b4f72d395c5211 2025-04-01T13:23:16,041 Stored in directory: /tmp/pip-ephem-wheel-cache-9hg0_ymj/wheels/de/4f/21/0dc09af005f1f3d42267de74dca2a90154c4af532aa55bf304 2025-04-01T13:23:16,070 Successfully built evalscope 2025-04-01T13:23:16,120 Removed build tracker: '/tmp/pip-build-tracker-14ddgcd6'