2024-11-29T15:04:22,415 Created temporary directory: /tmp/pip-build-tracker-h166ysxm
2024-11-29T15:04:22,416 Initialized build tracking at /tmp/pip-build-tracker-h166ysxm
2024-11-29T15:04:22,417 Created build tracker: /tmp/pip-build-tracker-h166ysxm
2024-11-29T15:04:22,417 Entered build tracker: /tmp/pip-build-tracker-h166ysxm
2024-11-29T15:04:22,418 Created temporary directory: /tmp/pip-wheel-o8ma09z_
2024-11-29T15:04:22,422 Created temporary directory: /tmp/pip-ephem-wheel-cache-dszp0at6
2024-11-29T15:04:22,466 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-11-29T15:04:22,469 2 location(s) to search for versions of evalscope:
2024-11-29T15:04:22,469 * https://pypi.org/simple/evalscope/
2024-11-29T15:04:22,469 * https://www.piwheels.org/simple/evalscope/
2024-11-29T15:04:22,469 Fetching project page and analyzing links: https://pypi.org/simple/evalscope/
2024-11-29T15:04:22,470 Getting page https://pypi.org/simple/evalscope/
2024-11-29T15:04:22,472 Found index url https://pypi.org/simple/
2024-11-29T15:04:22,696 Fetched page https://pypi.org/simple/evalscope/ as application/vnd.pypi.simple.v1+json
2024-11-29T15:04:22,702   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/94/d2/dc5e929802776bf4e662a46d794b765876bb93e2300189cafd113cac74d6/evalscope-0.5.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,703   Found link https://files.pythonhosted.org/packages/e5/70/45a5dad24b1fa535bff194b99a4668e7f5f328be972b51b3b91eafb4cdbb/evalscope-0.5.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0rc0
2024-11-29T15:04:22,704   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ac/eb/341fe367df2bc9a0ae7ef5eb2037a5d549d9bb8c0d7ad84844c9926e0947/evalscope-0.5.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,705   Found link https://files.pythonhosted.org/packages/3b/3f/585f7f1cf2ce90b234c1cfd654bb26977be4d889c0e5eed0122cb3024c45/evalscope-0.5.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.0
2024-11-29T15:04:22,706   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/ad/58/c0ce004159cfac6df9b5736c011576d52bdceb778943de8a022a419d86eb/evalscope-0.5.2-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,706   Found link https://files.pythonhosted.org/packages/94/33/7ad2f2285f5b68953ad4466d23dc5de1a2e57e7cc63d5924ab0e84d156ba/evalscope-0.5.2.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.2
2024-11-29T15:04:22,707   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4e/59/a9e1c4cf88018ece1fdd8d8b7fa976e28f9b4b181ef7ceb74a5e2db533ab/evalscope-0.5.3-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,708   Found link https://files.pythonhosted.org/packages/04/57/9ca7b1fd68f2acc32802b22236c83b597a5690a483d5938d38183b549d22/evalscope-0.5.3.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.3
2024-11-29T15:04:22,708   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/fa/c8/fcbaf01b7486c3b29b7790167c2cda560f00a04d100cec808ee9a3349ca0/evalscope-0.5.4-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,709   Found link https://files.pythonhosted.org/packages/8c/cc/abd412bad714c0266be1f0159b49a817d45db099c3bd031134d223589e93/evalscope-0.5.4.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.4
2024-11-29T15:04:22,710   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/4d/da/d705d457683223f289e8c5d6cadbaad15d15e098692c53ea7e6196a94373/evalscope-0.5.5rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,710   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7e/4c/414dd545a1833245a53797d70a35a78ae1b9cfbcc81b35a4e1763e678437/evalscope-0.5.5rc1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,712   Found link https://files.pythonhosted.org/packages/56/5f/aa7fcf62102694dd66b69e88cb2523094bf04b53f785854e17ee6b7234a7/evalscope-0.5.5rc1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5rc1
2024-11-29T15:04:22,712   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/3e/d0/91a7a1f95f3fa19dd8d4e434dc711768abe5c006f32a514a8602b429e049/evalscope-0.5.5-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,713   Found link https://files.pythonhosted.org/packages/04/7e/a7f065d6ebac15fe172d3b0906ff5b26a71df5a9975c0f14978044211cf1/evalscope-0.5.5.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.5.5
2024-11-29T15:04:22,714   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/11/89/b812b01a5ed91fc079dea052e1341860cd65d25d463c75c90e5a30ab6ae8/evalscope-0.6.0rc0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,714   Found link https://files.pythonhosted.org/packages/d5/ad/57a2d5f33c5b7d5066f8a5dcb1d34f14bf246112f7900228b9f2fb41b21b/evalscope-0.6.0rc0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0rc0
2024-11-29T15:04:22,715   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/c2/25/3f03d9d924f1b65610724c9f10727b48ef952afdfee8687a461949c88c78/evalscope-0.6.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,716   Found link https://files.pythonhosted.org/packages/9d/ac/1f432bcc46ccb8348b869b80d2aaabde5e583b370418ba48714083e31068/evalscope-0.6.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.0
2024-11-29T15:04:22,716   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/7b/e1/42c9e58b4690f23ef48bce841fc95cbf0744c1579cdc80fa6f33b0453344/evalscope-0.6.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,717   Found link https://files.pythonhosted.org/packages/cd/d6/1d9d2db9acda6e61d4210074f51e7e3dee4d0212fabdd94999105db23eed/evalscope-0.6.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.6.1
2024-11-29T15:04:22,718   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/20/92/6fff1dfd12a4f73489c451dab56351b6a3c1095a92bb55025c2934fc625d/evalscope-0.7.0-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,719   Found link https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.0
2024-11-29T15:04:22,720   Skipping link: No binaries permitted for evalscope: https://files.pythonhosted.org/packages/a5/3a/ae22d4d9a44ad37ac887da21b948bf6e784307001a09802d36c5bf04018d/evalscope-0.7.1-py3-none-any.whl (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8)
2024-11-29T15:04:22,721   Found link https://files.pythonhosted.org/packages/88/47/69d067f0d3d784a7975cc4ea067fdc55c8f785ece6fbe86e5e21edc8b36f/evalscope-0.7.1.tar.gz (from https://pypi.org/simple/evalscope/) (requires-python:>=3.8), version: 0.7.1
2024-11-29T15:04:22,722 Fetching project page and analyzing links: https://www.piwheels.org/simple/evalscope/
2024-11-29T15:04:22,722 Getting page https://www.piwheels.org/simple/evalscope/
2024-11-29T15:04:22,724 Found index url https://www.piwheels.org/simple/
2024-11-29T15:04:22,934 Fetched page https://www.piwheels.org/simple/evalscope/ as text/html
2024-11-29T15:04:22,935 Skipping link: not a file: https://www.piwheels.org/simple/evalscope/
2024-11-29T15:04:22,936 Skipping link: not a file: https://pypi.org/simple/evalscope/
2024-11-29T15:04:22,956 Given no hashes to check 1 links for project 'evalscope': discarding no candidates
2024-11-29T15:04:22,958 Collecting evalscope==0.7.0
2024-11-29T15:04:22,960   Created temporary directory: /tmp/pip-unpack-ej4yc83w
2024-11-29T15:04:23,282   Downloading evalscope-0.7.0.tar.gz (1.3 MB)
2024-11-29T15:04:24,266   Added evalscope==0.7.0 from https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz to build tracker '/tmp/pip-build-tracker-h166ysxm'
2024-11-29T15:04:24,267   Running setup.py (path:/tmp/pip-wheel-o8ma09z_/evalscope_ec8e1ec1f8d54d18bfed666bb52840cf/setup.py) egg_info for package evalscope
2024-11-29T15:04:24,268   Created temporary directory: /tmp/pip-pip-egg-info-g4hncpsr
2024-11-29T15:04:24,269   Preparing metadata (setup.py): started
2024-11-29T15:04:24,270   Running command python setup.py egg_info
2024-11-29T15:04:24,853   /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options
2024-11-29T15:04:24,854   !!

2024-11-29T15:04:24,855           ********************************************************************************
2024-11-29T15:04:24,855           Usage of dash-separated 'index-url' will not be supported in future
2024-11-29T15:04:24,856           versions. Please use the underscore name 'index_url' instead.

2024-11-29T15:04:24,857           By 2025-Mar-03, you need to update your project and remove deprecated calls
2024-11-29T15:04:24,857           or your builds will no longer be supported.

2024-11-29T15:04:24,859           See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
2024-11-29T15:04:24,859           ********************************************************************************

2024-11-29T15:04:24,860   !!
2024-11-29T15:04:24,861     opt = self.warn_dash_deprecation(opt, section)
2024-11-29T15:04:25,428   /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options
2024-11-29T15:04:25,429   !!

2024-11-29T15:04:25,430           ********************************************************************************
2024-11-29T15:04:25,430           Usage of dash-separated 'index-url' will not be supported in future
2024-11-29T15:04:25,431           versions. Please use the underscore name 'index_url' instead.

2024-11-29T15:04:25,432           By 2025-Mar-03, you need to update your project and remove deprecated calls
2024-11-29T15:04:25,432           or your builds will no longer be supported.

2024-11-29T15:04:25,433           See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
2024-11-29T15:04:25,434           ********************************************************************************

2024-11-29T15:04:25,435   !!
2024-11-29T15:04:25,436     opt = self.warn_dash_deprecation(opt, section)
2024-11-29T15:04:25,467   Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test
2024-11-29T15:04:25,467   running egg_info
2024-11-29T15:04:25,494   creating /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info
2024-11-29T15:04:25,496   writing /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/PKG-INFO
2024-11-29T15:04:25,526   writing dependency_links to /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/dependency_links.txt
2024-11-29T15:04:25,528   writing entry points to /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/entry_points.txt
2024-11-29T15:04:25,543   writing requirements to /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/requires.txt
2024-11-29T15:04:25,545   writing top-level names to /tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/top_level.txt
2024-11-29T15:04:25,549   writing manifest file '/tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/SOURCES.txt'
2024-11-29T15:04:25,758   reading manifest file '/tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/SOURCES.txt'
2024-11-29T15:04:25,760   reading manifest template 'MANIFEST.in'
2024-11-29T15:04:25,900   adding license file 'LICENSE'
2024-11-29T15:04:25,914   writing manifest file '/tmp/pip-pip-egg-info-g4hncpsr/evalscope.egg-info/SOURCES.txt'
2024-11-29T15:04:26,024   Preparing metadata (setup.py): finished with status 'done'
2024-11-29T15:04:26,030   Source in /tmp/pip-wheel-o8ma09z_/evalscope_ec8e1ec1f8d54d18bfed666bb52840cf has version 0.7.0, which satisfies requirement evalscope==0.7.0 from https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz
2024-11-29T15:04:26,031   Removed evalscope==0.7.0 from https://files.pythonhosted.org/packages/fe/3c/500d655a27ca80e1aba3fb2b1e8886951942732b869ad1516422d9e6ac97/evalscope-0.7.0.tar.gz from build tracker '/tmp/pip-build-tracker-h166ysxm'
2024-11-29T15:04:26,083 Created temporary directory: /tmp/pip-unpack-b1f12l8f
2024-11-29T15:04:26,084 Created temporary directory: /tmp/pip-unpack-x9xqro8y
2024-11-29T15:04:26,084 Building wheels for collected packages: evalscope
2024-11-29T15:04:26,089   Created temporary directory: /tmp/pip-wheel-31h9zes0
2024-11-29T15:04:26,089   Building wheel for evalscope (setup.py): started
2024-11-29T15:04:26,090   Destination directory: /tmp/pip-wheel-31h9zes0
2024-11-29T15:04:26,091   Running command python setup.py bdist_wheel
2024-11-29T15:04:26,546   Usage: python3 setup.py bdist_wheel or pip3 install .[opencompass] for test
2024-11-29T15:04:26,648   /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options
2024-11-29T15:04:26,649   !!

2024-11-29T15:04:26,650           ********************************************************************************
2024-11-29T15:04:26,650           Usage of dash-separated 'index-url' will not be supported in future
2024-11-29T15:04:26,651           versions. Please use the underscore name 'index_url' instead.

2024-11-29T15:04:26,652           By 2025-Mar-03, you need to update your project and remove deprecated calls
2024-11-29T15:04:26,652           or your builds will no longer be supported.

2024-11-29T15:04:26,653           See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
2024-11-29T15:04:26,654           ********************************************************************************

2024-11-29T15:04:26,655   !!
2024-11-29T15:04:26,655     opt = self.warn_dash_deprecation(opt, section)
2024-11-29T15:04:27,246   /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:495: SetuptoolsDeprecationWarning: Invalid dash-separated options
2024-11-29T15:04:27,247   !!

2024-11-29T15:04:27,248           ********************************************************************************
2024-11-29T15:04:27,248           Usage of dash-separated 'index-url' will not be supported in future
2024-11-29T15:04:27,249           versions. Please use the underscore name 'index_url' instead.

2024-11-29T15:04:27,250           By 2025-Mar-03, you need to update your project and remove deprecated calls
2024-11-29T15:04:27,250           or your builds will no longer be supported.

2024-11-29T15:04:27,251           See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
2024-11-29T15:04:27,252           ********************************************************************************

2024-11-29T15:04:27,253   !!
2024-11-29T15:04:27,254     opt = self.warn_dash_deprecation(opt, section)
2024-11-29T15:04:27,256   running bdist_wheel
2024-11-29T15:04:27,389   running build
2024-11-29T15:04:27,390   running build_py
2024-11-29T15:04:27,420   creating build/lib/evalscope
2024-11-29T15:04:27,422   copying evalscope/version.py -> build/lib/evalscope
2024-11-29T15:04:27,424   copying evalscope/run.py -> build/lib/evalscope
2024-11-29T15:04:27,427   copying evalscope/config.py -> build/lib/evalscope
2024-11-29T15:04:27,429   copying evalscope/run_ms.py -> build/lib/evalscope
2024-11-29T15:04:27,431   copying evalscope/run_arena.py -> build/lib/evalscope
2024-11-29T15:04:27,434   copying evalscope/__init__.py -> build/lib/evalscope
2024-11-29T15:04:27,435   copying evalscope/cache.py -> build/lib/evalscope
2024-11-29T15:04:27,437   copying evalscope/summarizer.py -> build/lib/evalscope
2024-11-29T15:04:27,440   copying evalscope/constants.py -> build/lib/evalscope
2024-11-29T15:04:27,442   creating build/lib/tests
2024-11-29T15:04:27,443   copying tests/__init__.py -> build/lib/tests
2024-11-29T15:04:27,445   copying tests/test_run_all.py -> build/lib/tests
2024-11-29T15:04:27,447   creating build/lib/evalscope/backend
2024-11-29T15:04:27,448   copying evalscope/backend/__init__.py -> build/lib/evalscope/backend
2024-11-29T15:04:27,450   copying evalscope/backend/base.py -> build/lib/evalscope/backend
2024-11-29T15:04:27,452   creating build/lib/evalscope/evaluator
2024-11-29T15:04:27,453   copying evalscope/evaluator/rating_eval.py -> build/lib/evalscope/evaluator
2024-11-29T15:04:27,455   copying evalscope/evaluator/__init__.py -> build/lib/evalscope/evaluator
2024-11-29T15:04:27,457   copying evalscope/evaluator/evaluator.py -> build/lib/evalscope/evaluator
2024-11-29T15:04:27,460   creating build/lib/evalscope/benchmarks
2024-11-29T15:04:27,461   copying evalscope/benchmarks/data_adapter.py -> build/lib/evalscope/benchmarks
2024-11-29T15:04:27,463   copying evalscope/benchmarks/__init__.py -> build/lib/evalscope/benchmarks
2024-11-29T15:04:27,465   copying evalscope/benchmarks/benchmark.py -> build/lib/evalscope/benchmarks
2024-11-29T15:04:27,467   creating build/lib/evalscope/models
2024-11-29T15:04:27,468   copying evalscope/models/template.py -> build/lib/evalscope/models
2024-11-29T15:04:27,472   copying evalscope/models/openai_model.py -> build/lib/evalscope/models
2024-11-29T15:04:27,474   copying evalscope/models/__init__.py -> build/lib/evalscope/models
2024-11-29T15:04:27,475   copying evalscope/models/dummy_chat_model.py -> build/lib/evalscope/models
2024-11-29T15:04:27,478   copying evalscope/models/model_adapter.py -> build/lib/evalscope/models
2024-11-29T15:04:27,480   copying evalscope/models/model.py -> build/lib/evalscope/models
2024-11-29T15:04:27,482   creating build/lib/evalscope/cli
2024-11-29T15:04:27,483   copying evalscope/cli/start_perf.py -> build/lib/evalscope/cli
2024-11-29T15:04:27,485   copying evalscope/cli/cli.py -> build/lib/evalscope/cli
2024-11-29T15:04:27,487   copying evalscope/cli/__init__.py -> build/lib/evalscope/cli
2024-11-29T15:04:27,489   copying evalscope/cli/start_server.py -> build/lib/evalscope/cli
2024-11-29T15:04:27,491   copying evalscope/cli/base.py -> build/lib/evalscope/cli
2024-11-29T15:04:27,493   creating build/lib/evalscope/metrics
2024-11-29T15:04:27,494   copying evalscope/metrics/math_accuracy.py -> build/lib/evalscope/metrics
2024-11-29T15:04:27,496   copying evalscope/metrics/rouge_metric.py -> build/lib/evalscope/metrics
2024-11-29T15:04:27,498   copying evalscope/metrics/__init__.py -> build/lib/evalscope/metrics
2024-11-29T15:04:27,500   copying evalscope/metrics/code_metric.py -> build/lib/evalscope/metrics
2024-11-29T15:04:27,502   copying evalscope/metrics/metrics.py -> build/lib/evalscope/metrics
2024-11-29T15:04:27,505   creating build/lib/evalscope/tools
2024-11-29T15:04:27,506   copying evalscope/tools/rewrite_eval_results.py -> build/lib/evalscope/tools
2024-11-29T15:04:27,508   copying evalscope/tools/combine_reports.py -> build/lib/evalscope/tools
2024-11-29T15:04:27,511   copying evalscope/tools/__init__.py -> build/lib/evalscope/tools
2024-11-29T15:04:27,512   copying evalscope/tools/gen_mmlu_subject_mapping.py -> build/lib/evalscope/tools
2024-11-29T15:04:27,515   creating build/lib/evalscope/utils
2024-11-29T15:04:27,516   copying evalscope/utils/task_cfg_parser.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,518   copying evalscope/utils/completion_parsers.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,520   copying evalscope/utils/__init__.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,522   copying evalscope/utils/arena_utils.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,524   copying evalscope/utils/task_utils.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,526   copying evalscope/utils/logger.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,528   copying evalscope/utils/utils.py -> build/lib/evalscope/utils
2024-11-29T15:04:27,531   creating build/lib/evalscope/registry
2024-11-29T15:04:27,532   copying evalscope/registry/__init__.py -> build/lib/evalscope/registry
2024-11-29T15:04:27,535   creating build/lib/evalscope/perf
2024-11-29T15:04:27,536   copying evalscope/perf/arguments.py -> build/lib/evalscope/perf
2024-11-29T15:04:27,538   copying evalscope/perf/http_client.py -> build/lib/evalscope/perf
2024-11-29T15:04:27,540   copying evalscope/perf/__init__.py -> build/lib/evalscope/perf
2024-11-29T15:04:27,541   copying evalscope/perf/main.py -> build/lib/evalscope/perf
2024-11-29T15:04:27,543   copying evalscope/perf/benchmark.py -> build/lib/evalscope/perf
2024-11-29T15:04:27,546   creating build/lib/evalscope/third_party
2024-11-29T15:04:27,547   copying evalscope/third_party/__init__.py -> build/lib/evalscope/third_party
2024-11-29T15:04:27,549   creating build/lib/evalscope/backend/rag_eval
2024-11-29T15:04:27,550   copying evalscope/backend/rag_eval/__init__.py -> build/lib/evalscope/backend/rag_eval
2024-11-29T15:04:27,552   copying evalscope/backend/rag_eval/backend_manager.py -> build/lib/evalscope/backend/rag_eval
2024-11-29T15:04:27,554   creating build/lib/evalscope/backend/opencompass
2024-11-29T15:04:27,555   copying evalscope/backend/opencompass/__init__.py -> build/lib/evalscope/backend/opencompass
2024-11-29T15:04:27,557   copying evalscope/backend/opencompass/api_meta_template.py -> build/lib/evalscope/backend/opencompass
2024-11-29T15:04:27,559   copying evalscope/backend/opencompass/backend_manager.py -> build/lib/evalscope/backend/opencompass
2024-11-29T15:04:27,562   creating build/lib/evalscope/backend/vlm_eval_kit
2024-11-29T15:04:27,563   copying evalscope/backend/vlm_eval_kit/__init__.py -> build/lib/evalscope/backend/vlm_eval_kit
2024-11-29T15:04:27,565   copying evalscope/backend/vlm_eval_kit/backend_manager.py -> build/lib/evalscope/backend/vlm_eval_kit
2024-11-29T15:04:27,567   copying evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/lib/evalscope/backend/vlm_eval_kit
2024-11-29T15:04:27,569   creating build/lib/evalscope/backend/rag_eval/ragas
2024-11-29T15:04:27,571   copying evalscope/backend/rag_eval/ragas/arguments.py -> build/lib/evalscope/backend/rag_eval/ragas
2024-11-29T15:04:27,573   copying evalscope/backend/rag_eval/ragas/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas
2024-11-29T15:04:27,574   copying evalscope/backend/rag_eval/ragas/task_template.py -> build/lib/evalscope/backend/rag_eval/ragas
2024-11-29T15:04:27,577   creating build/lib/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:27,578   copying evalscope/backend/rag_eval/cmteb/arguments.py -> build/lib/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:27,580   copying evalscope/backend/rag_eval/cmteb/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:27,582   copying evalscope/backend/rag_eval/cmteb/base.py -> build/lib/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:27,584   copying evalscope/backend/rag_eval/cmteb/task_template.py -> build/lib/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:27,586   creating build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,588   copying evalscope/backend/rag_eval/utils/tools.py -> build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,590   copying evalscope/backend/rag_eval/utils/clip.py -> build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,592   copying evalscope/backend/rag_eval/utils/__init__.py -> build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,594   copying evalscope/backend/rag_eval/utils/embedding.py -> build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,596   copying evalscope/backend/rag_eval/utils/llm.py -> build/lib/evalscope/backend/rag_eval/utils
2024-11-29T15:04:27,598   creating build/lib/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:27,599   copying evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:27,601   copying evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:27,603   copying evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:27,605   copying evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:27,608   creating build/lib/evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:27,609   copying evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:27,611   copying evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:27,613   copying evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/lib/evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:27,616   creating build/lib/evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:27,617   copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:27,619   copying evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:27,621   copying evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/lib/evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:27,623   creating build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,624   copying evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,626   copying evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,628   copying evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,630   copying evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,632   copying evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,635   copying evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,637   copying evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,639   copying evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/lib/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:27,642   creating build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:27,643   copying evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:27,645   copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:27,647   copying evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:27,650   copying evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:27,652   creating build/lib/evalscope/backend/opencompass/tasks
2024-11-29T15:04:27,654   copying evalscope/backend/opencompass/tasks/__init__.py -> build/lib/evalscope/backend/opencompass/tasks
2024-11-29T15:04:27,656   copying evalscope/backend/opencompass/tasks/eval_api.py -> build/lib/evalscope/backend/opencompass/tasks
2024-11-29T15:04:27,658   copying evalscope/backend/opencompass/tasks/eval_datasets.py -> build/lib/evalscope/backend/opencompass/tasks
2024-11-29T15:04:27,661   creating build/lib/evalscope/evaluator/reviewer
2024-11-29T15:04:27,662   copying evalscope/evaluator/reviewer/__init__.py -> build/lib/evalscope/evaluator/reviewer
2024-11-29T15:04:27,664   copying evalscope/evaluator/reviewer/auto_reviewer.py -> build/lib/evalscope/evaluator/reviewer
2024-11-29T15:04:27,667   creating build/lib/evalscope/benchmarks/general_qa
2024-11-29T15:04:27,668   copying evalscope/benchmarks/general_qa/__init__.py -> build/lib/evalscope/benchmarks/general_qa
2024-11-29T15:04:27,669   copying evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/lib/evalscope/benchmarks/general_qa
2024-11-29T15:04:27,672   creating build/lib/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:27,673   copying evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/lib/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:27,675   copying evalscope/benchmarks/trivia_qa/__init__.py -> build/lib/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:27,677   copying evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/lib/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:27,680   creating build/lib/evalscope/benchmarks/ceval
2024-11-29T15:04:27,682   copying evalscope/benchmarks/ceval/__init__.py -> build/lib/evalscope/benchmarks/ceval
2024-11-29T15:04:27,684   copying evalscope/benchmarks/ceval/ceval_exam.py -> build/lib/evalscope/benchmarks/ceval
2024-11-29T15:04:27,686   copying evalscope/benchmarks/ceval/ceval_adapter.py -> build/lib/evalscope/benchmarks/ceval
2024-11-29T15:04:27,689   creating build/lib/evalscope/benchmarks/bbh
2024-11-29T15:04:27,690   copying evalscope/benchmarks/bbh/bbh_adapter.py -> build/lib/evalscope/benchmarks/bbh
2024-11-29T15:04:27,692   copying evalscope/benchmarks/bbh/__init__.py -> build/lib/evalscope/benchmarks/bbh
2024-11-29T15:04:27,695   creating build/lib/evalscope/benchmarks/truthful_qa
2024-11-29T15:04:27,696   copying evalscope/benchmarks/truthful_qa/__init__.py -> build/lib/evalscope/benchmarks/truthful_qa
2024-11-29T15:04:27,698   copying evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/lib/evalscope/benchmarks/truthful_qa
2024-11-29T15:04:27,700   copying evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/lib/evalscope/benchmarks/truthful_qa
2024-11-29T15:04:27,703   creating build/lib/evalscope/benchmarks/cmmlu
2024-11-29T15:04:27,704   copying evalscope/benchmarks/cmmlu/__init__.py -> build/lib/evalscope/benchmarks/cmmlu
2024-11-29T15:04:27,706   copying evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/lib/evalscope/benchmarks/cmmlu
2024-11-29T15:04:27,709   copying evalscope/benchmarks/cmmlu/cmmlu.py -> build/lib/evalscope/benchmarks/cmmlu
2024-11-29T15:04:27,712   creating build/lib/evalscope/benchmarks/competition_math
2024-11-29T15:04:27,713   copying evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/lib/evalscope/benchmarks/competition_math
2024-11-29T15:04:27,716   copying evalscope/benchmarks/competition_math/__init__.py -> build/lib/evalscope/benchmarks/competition_math
2024-11-29T15:04:27,718   copying evalscope/benchmarks/competition_math/competition_math.py -> build/lib/evalscope/benchmarks/competition_math
2024-11-29T15:04:27,720   creating build/lib/evalscope/benchmarks/race
2024-11-29T15:04:27,721   copying evalscope/benchmarks/race/__init__.py -> build/lib/evalscope/benchmarks/race
2024-11-29T15:04:27,723   copying evalscope/benchmarks/race/race.py -> build/lib/evalscope/benchmarks/race
2024-11-29T15:04:27,725   copying evalscope/benchmarks/race/race_adapter.py -> build/lib/evalscope/benchmarks/race
2024-11-29T15:04:27,728   creating build/lib/evalscope/benchmarks/arc
2024-11-29T15:04:27,729   copying evalscope/benchmarks/arc/__init__.py -> build/lib/evalscope/benchmarks/arc
2024-11-29T15:04:27,731   copying evalscope/benchmarks/arc/arc_adapter.py -> build/lib/evalscope/benchmarks/arc
2024-11-29T15:04:27,734   copying evalscope/benchmarks/arc/ai2_arc.py -> build/lib/evalscope/benchmarks/arc
2024-11-29T15:04:27,736   creating build/lib/evalscope/benchmarks/hellaswag
2024-11-29T15:04:27,737   copying evalscope/benchmarks/hellaswag/__init__.py -> build/lib/evalscope/benchmarks/hellaswag
2024-11-29T15:04:27,739   copying evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/lib/evalscope/benchmarks/hellaswag
2024-11-29T15:04:27,742   copying evalscope/benchmarks/hellaswag/hellaswag.py -> build/lib/evalscope/benchmarks/hellaswag
2024-11-29T15:04:27,744   creating build/lib/evalscope/benchmarks/gsm8k
2024-11-29T15:04:27,746   copying evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/lib/evalscope/benchmarks/gsm8k
2024-11-29T15:04:27,748   copying evalscope/benchmarks/gsm8k/__init__.py -> build/lib/evalscope/benchmarks/gsm8k
2024-11-29T15:04:27,750   copying evalscope/benchmarks/gsm8k/gsm8k.py -> build/lib/evalscope/benchmarks/gsm8k
2024-11-29T15:04:27,753   creating build/lib/evalscope/benchmarks/humaneval
2024-11-29T15:04:27,754   copying evalscope/benchmarks/humaneval/humaneval.py -> build/lib/evalscope/benchmarks/humaneval
2024-11-29T15:04:27,756   copying evalscope/benchmarks/humaneval/__init__.py -> build/lib/evalscope/benchmarks/humaneval
2024-11-29T15:04:27,757   copying evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/lib/evalscope/benchmarks/humaneval
2024-11-29T15:04:27,760   creating build/lib/evalscope/benchmarks/mmlu
2024-11-29T15:04:27,761   copying evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/lib/evalscope/benchmarks/mmlu
2024-11-29T15:04:27,763   copying evalscope/benchmarks/mmlu/__init__.py -> build/lib/evalscope/benchmarks/mmlu
2024-11-29T15:04:27,765   copying evalscope/benchmarks/mmlu/mmlu.py -> build/lib/evalscope/benchmarks/mmlu
2024-11-29T15:04:27,768   creating build/lib/evalscope/models/api
2024-11-29T15:04:27,769   copying evalscope/models/api/__init__.py -> build/lib/evalscope/models/api
2024-11-29T15:04:27,771   copying evalscope/models/api/openai_api.py -> build/lib/evalscope/models/api
2024-11-29T15:04:27,774   creating build/lib/evalscope/models/custom
2024-11-29T15:04:27,775   copying evalscope/models/custom/__init__.py -> build/lib/evalscope/models/custom
2024-11-29T15:04:27,777   copying evalscope/models/custom/custom_model.py -> build/lib/evalscope/models/custom
2024-11-29T15:04:27,779   creating build/lib/evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:27,780   copying evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/lib/evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:27,783   copying evalscope/metrics/bundled_rouge_score/__init__.py -> build/lib/evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:27,785   creating build/lib/evalscope/perf/utils
2024-11-29T15:04:27,787   copying evalscope/perf/utils/benchmark_util.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,789   copying evalscope/perf/utils/analysis_result.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,791   copying evalscope/perf/utils/db_util.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,793   copying evalscope/perf/utils/chat_service.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,796   copying evalscope/perf/utils/__init__.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,797   copying evalscope/perf/utils/local_server.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,799   copying evalscope/perf/utils/handler.py -> build/lib/evalscope/perf/utils
2024-11-29T15:04:27,802   creating build/lib/evalscope/perf/plugin
2024-11-29T15:04:27,803   copying evalscope/perf/plugin/__init__.py -> build/lib/evalscope/perf/plugin
2024-11-29T15:04:27,805   copying evalscope/perf/plugin/registry.py -> build/lib/evalscope/perf/plugin
2024-11-29T15:04:27,807   creating build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,808   copying evalscope/perf/plugin/api/dashscope_api.py -> build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,811   copying evalscope/perf/plugin/api/__init__.py -> build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,812   copying evalscope/perf/plugin/api/openai_api.py -> build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,815   copying evalscope/perf/plugin/api/base.py -> build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,817   copying evalscope/perf/plugin/api/custom_api.py -> build/lib/evalscope/perf/plugin/api
2024-11-29T15:04:27,819   creating build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,820   copying evalscope/perf/plugin/datasets/flickr8k.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,822   copying evalscope/perf/plugin/datasets/longalpaca.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,824   copying evalscope/perf/plugin/datasets/openqa.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,826   copying evalscope/perf/plugin/datasets/__init__.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,827   copying evalscope/perf/plugin/datasets/custom.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,829   copying evalscope/perf/plugin/datasets/base.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,831   copying evalscope/perf/plugin/datasets/line_by_line.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,833   copying evalscope/perf/plugin/datasets/speed_benchmark.py -> build/lib/evalscope/perf/plugin/datasets
2024-11-29T15:04:27,835   creating build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,836   copying evalscope/third_party/longbench_write/eval.py -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,839   copying evalscope/third_party/longbench_write/__init__.py -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,840   copying evalscope/third_party/longbench_write/longbench_write.py -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,842   copying evalscope/third_party/longbench_write/infer.py -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,844   copying evalscope/third_party/longbench_write/utils.py -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:27,847   creating build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:27,848   copying evalscope/third_party/toolbench_static/eval.py -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:27,851   copying evalscope/third_party/toolbench_static/toolbench_static.py -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:27,853   copying evalscope/third_party/toolbench_static/__init__.py -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:27,855   copying evalscope/third_party/toolbench_static/infer.py -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:27,857   creating build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:27,859   copying evalscope/third_party/longbench_write/resources/__init__.py -> build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:27,861   creating build/lib/evalscope/third_party/longbench_write/tools
2024-11-29T15:04:27,862   copying evalscope/third_party/longbench_write/tools/__init__.py -> build/lib/evalscope/third_party/longbench_write/tools
2024-11-29T15:04:27,864   copying evalscope/third_party/longbench_write/tools/data_etl.py -> build/lib/evalscope/third_party/longbench_write/tools
2024-11-29T15:04:27,867   creating build/lib/evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:27,868   copying evalscope/third_party/toolbench_static/llm/__init__.py -> build/lib/evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:27,870   copying evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/lib/evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:27,872   creating build/lib/tests/rag
2024-11-29T15:04:27,873   copying tests/rag/test_clip_benchmark.py -> build/lib/tests/rag
2024-11-29T15:04:27,876   copying tests/rag/test_ragas.py -> build/lib/tests/rag
2024-11-29T15:04:27,877   copying tests/rag/__init__.py -> build/lib/tests/rag
2024-11-29T15:04:27,879   copying tests/rag/test_mteb.py -> build/lib/tests/rag
2024-11-29T15:04:27,882   creating build/lib/tests/vlm
2024-11-29T15:04:27,883   copying tests/vlm/test_vlmeval.py -> build/lib/tests/vlm
2024-11-29T15:04:27,885   copying tests/vlm/__init__.py -> build/lib/tests/vlm
2024-11-29T15:04:27,888   creating build/lib/tests/cli
2024-11-29T15:04:27,889   copying tests/cli/__init__.py -> build/lib/tests/cli
2024-11-29T15:04:27,891   copying tests/cli/test_run.py -> build/lib/tests/cli
2024-11-29T15:04:27,893   creating build/lib/tests/perf
2024-11-29T15:04:27,894   copying tests/perf/__init__.py -> build/lib/tests/perf
2024-11-29T15:04:27,896   copying tests/perf/test_perf.py -> build/lib/tests/perf
2024-11-29T15:04:27,898   creating build/lib/tests/swift
2024-11-29T15:04:27,899   copying tests/swift/test_run_swift_vlm_jugde_eval.py -> build/lib/tests/swift
2024-11-29T15:04:27,902   copying tests/swift/test_run_swift_vlm_eval.py -> build/lib/tests/swift
2024-11-29T15:04:27,904   copying tests/swift/__init__.py -> build/lib/tests/swift
2024-11-29T15:04:27,906   copying tests/swift/test_run_swift_eval.py -> build/lib/tests/swift
2024-11-29T15:04:27,908   running egg_info
2024-11-29T15:04:27,936   writing evalscope.egg-info/PKG-INFO
2024-11-29T15:04:27,966   writing dependency_links to evalscope.egg-info/dependency_links.txt
2024-11-29T15:04:27,967   writing entry points to evalscope.egg-info/entry_points.txt
2024-11-29T15:04:27,981   writing requirements to evalscope.egg-info/requires.txt
2024-11-29T15:04:27,982   writing top-level names to evalscope.egg-info/top_level.txt
2024-11-29T15:04:28,060   reading manifest file 'evalscope.egg-info/SOURCES.txt'
2024-11-29T15:04:28,080   reading manifest template 'MANIFEST.in'
2024-11-29T15:04:28,203   adding license file 'LICENSE'
2024-11-29T15:04:28,222   writing manifest file 'evalscope.egg-info/SOURCES.txt'
2024-11-29T15:04:28,225   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.clip_benchmark.utils' is absent from the `packages` configuration.
2024-11-29T15:04:28,225   !!

2024-11-29T15:04:28,226           ********************************************************************************
2024-11-29T15:04:28,227           ############################
2024-11-29T15:04:28,227           # Package would be ignored #
2024-11-29T15:04:28,228           ############################
2024-11-29T15:04:28,228           Python recognizes 'evalscope.backend.rag_eval.clip_benchmark.utils' as an importable package[^1],
2024-11-29T15:04:28,229           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,230           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,230           package, please make sure that 'evalscope.backend.rag_eval.clip_benchmark.utils' is explicitly added
2024-11-29T15:04:28,231           to the `packages` configuration field.

2024-11-29T15:04:28,232           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,233           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,233           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,234           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,235           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,236           If you don't want 'evalscope.backend.rag_eval.clip_benchmark.utils' to be distributed and are
2024-11-29T15:04:28,237           already explicitly excluding 'evalscope.backend.rag_eval.clip_benchmark.utils' via
2024-11-29T15:04:28,237           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,238           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,238           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,239           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,240           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,241           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,242                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,242                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,242                 directory, all directories are treated like packages.
2024-11-29T15:04:28,243           ********************************************************************************

2024-11-29T15:04:28,243   !!
2024-11-29T15:04:28,244     check.warn(importable)
2024-11-29T15:04:28,244   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts' is absent from the `packages` configuration.
2024-11-29T15:04:28,245   !!

2024-11-29T15:04:28,246           ********************************************************************************
2024-11-29T15:04:28,246           ############################
2024-11-29T15:04:28,246           # Package would be ignored #
2024-11-29T15:04:28,247           ############################
2024-11-29T15:04:28,247           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts' as an importable package[^1],
2024-11-29T15:04:28,248           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,248           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,249           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts' is explicitly added
2024-11-29T15:04:28,249           to the `packages` configuration field.

2024-11-29T15:04:28,250           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,250           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,251           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,251           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,252           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,253           If you don't want 'evalscope.backend.rag_eval.ragas.prompts' to be distributed and are
2024-11-29T15:04:28,253           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts' via
2024-11-29T15:04:28,254           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,254           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,255           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,255           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,256           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,258           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,258                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,258                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,259                 directory, all directories are treated like packages.
2024-11-29T15:04:28,259           ********************************************************************************

2024-11-29T15:04:28,260   !!
2024-11-29T15:04:28,261     check.warn(importable)
2024-11-29T15:04:28,261   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is absent from the `packages` configuration.
2024-11-29T15:04:28,262   !!

2024-11-29T15:04:28,262           ********************************************************************************
2024-11-29T15:04:28,263           ############################
2024-11-29T15:04:28,263           # Package would be ignored #
2024-11-29T15:04:28,264           ############################
2024-11-29T15:04:28,264           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' as an importable package[^1],
2024-11-29T15:04:28,265           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,265           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,266           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' is explicitly added
2024-11-29T15:04:28,266           to the `packages` configuration field.

2024-11-29T15:04:28,267           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,267           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,267           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,268           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,269           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,270           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' to be distributed and are
2024-11-29T15:04:28,270           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerCorrectness' via
2024-11-29T15:04:28,270           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,271           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,271           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,272           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,273           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,274           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,275                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,275                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,275                 directory, all directories are treated like packages.
2024-11-29T15:04:28,276           ********************************************************************************

2024-11-29T15:04:28,277   !!
2024-11-29T15:04:28,277     check.warn(importable)
2024-11-29T15:04:28,278   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is absent from the `packages` configuration.
2024-11-29T15:04:28,278   !!

2024-11-29T15:04:28,279           ********************************************************************************
2024-11-29T15:04:28,279           ############################
2024-11-29T15:04:28,280           # Package would be ignored #
2024-11-29T15:04:28,280           ############################
2024-11-29T15:04:28,281           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' as an importable package[^1],
2024-11-29T15:04:28,281           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,282           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,282           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' is explicitly added
2024-11-29T15:04:28,283           to the `packages` configuration field.

2024-11-29T15:04:28,284           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,284           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,285           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,286           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,287           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,287           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' to be distributed and are
2024-11-29T15:04:28,288           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.AnswerRelevancy' via
2024-11-29T15:04:28,288           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,288           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,289           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,290           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,290           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,291           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,292                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,292                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,293                 directory, all directories are treated like packages.
2024-11-29T15:04:28,293           ********************************************************************************

2024-11-29T15:04:28,294   !!
2024-11-29T15:04:28,295     check.warn(importable)
2024-11-29T15:04:28,295   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is absent from the `packages` configuration.
2024-11-29T15:04:28,295   !!

2024-11-29T15:04:28,296           ********************************************************************************
2024-11-29T15:04:28,297           ############################
2024-11-29T15:04:28,297           # Package would be ignored #
2024-11-29T15:04:28,298           ############################
2024-11-29T15:04:28,298           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' as an importable package[^1],
2024-11-29T15:04:28,298           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,299           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,300           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' is explicitly added
2024-11-29T15:04:28,300           to the `packages` configuration field.

2024-11-29T15:04:28,301           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,302           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,302           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,303           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,304           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,305           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' to be distributed and are
2024-11-29T15:04:28,305           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ContextPrecision' via
2024-11-29T15:04:28,306           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,306           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,307           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,308           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,309           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,310           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,311                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,312                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,312                 directory, all directories are treated like packages.
2024-11-29T15:04:28,312           ********************************************************************************

2024-11-29T15:04:28,313   !!
2024-11-29T15:04:28,314     check.warn(importable)
2024-11-29T15:04:28,314   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is absent from the `packages` configuration.
2024-11-29T15:04:28,315   !!

2024-11-29T15:04:28,316           ********************************************************************************
2024-11-29T15:04:28,316           ############################
2024-11-29T15:04:28,317           # Package would be ignored #
2024-11-29T15:04:28,317           ############################
2024-11-29T15:04:28,318           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' as an importable package[^1],
2024-11-29T15:04:28,318           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,319           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,320           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' is explicitly added
2024-11-29T15:04:28,320           to the `packages` configuration field.

2024-11-29T15:04:28,321           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,322           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,322           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,323           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,324           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,325           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' to be distributed and are
2024-11-29T15:04:28,326           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.Faithfulness' via
2024-11-29T15:04:28,326           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,327           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,327           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,328           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,329           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,331           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,332                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,332                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,333                 directory, all directories are treated like packages.
2024-11-29T15:04:28,333           ********************************************************************************

2024-11-29T15:04:28,335   !!
2024-11-29T15:04:28,335     check.warn(importable)
2024-11-29T15:04:28,336   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is absent from the `packages` configuration.
2024-11-29T15:04:28,336   !!

2024-11-29T15:04:28,337           ********************************************************************************
2024-11-29T15:04:28,338           ############################
2024-11-29T15:04:28,339           # Package would be ignored #
2024-11-29T15:04:28,339           ############################
2024-11-29T15:04:28,340           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' as an importable package[^1],
2024-11-29T15:04:28,341           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,342           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,342           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' is explicitly added
2024-11-29T15:04:28,343           to the `packages` configuration field.

2024-11-29T15:04:28,344           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,344           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,345           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,346           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,347           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,348           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' to be distributed and are
2024-11-29T15:04:28,348           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.HeadlinesExtractor' via
2024-11-29T15:04:28,349           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,349           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,350           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,351           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,352           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,354           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,354                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,355                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,356                 directory, all directories are treated like packages.
2024-11-29T15:04:28,356           ********************************************************************************

2024-11-29T15:04:28,357   !!
2024-11-29T15:04:28,358     check.warn(importable)
2024-11-29T15:04:28,358   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is absent from the `packages` configuration.
2024-11-29T15:04:28,359   !!

2024-11-29T15:04:28,360           ********************************************************************************
2024-11-29T15:04:28,360           ############################
2024-11-29T15:04:28,361           # Package would be ignored #
2024-11-29T15:04:28,362           ############################
2024-11-29T15:04:28,362           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' as an importable package[^1],
2024-11-29T15:04:28,363           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,364           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,364           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' is explicitly added
2024-11-29T15:04:28,365           to the `packages` configuration field.

2024-11-29T15:04:28,366           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,366           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,367           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,368           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,370           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,370           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' to be distributed and are
2024-11-29T15:04:28,371           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopAbstractQuerySynthesizer' via
2024-11-29T15:04:28,371           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,372           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,372           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,373           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,374           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,376           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,376                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,376                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,377                 directory, all directories are treated like packages.
2024-11-29T15:04:28,377           ********************************************************************************

2024-11-29T15:04:28,378   !!
2024-11-29T15:04:28,379     check.warn(importable)
2024-11-29T15:04:28,379   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is absent from the `packages` configuration.
2024-11-29T15:04:28,380   !!

2024-11-29T15:04:28,381           ********************************************************************************
2024-11-29T15:04:28,381           ############################
2024-11-29T15:04:28,382           # Package would be ignored #
2024-11-29T15:04:28,382           ############################
2024-11-29T15:04:28,383           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' as an importable package[^1],
2024-11-29T15:04:28,383           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,384           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,385           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' is explicitly added
2024-11-29T15:04:28,386           to the `packages` configuration field.

2024-11-29T15:04:28,387           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,387           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,388           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,389           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,390           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,391           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' to be distributed and are
2024-11-29T15:04:28,391           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiHopSpecificQuerySynthesizer' via
2024-11-29T15:04:28,392           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,392           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,393           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,394           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,396           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,398           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,398                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,398                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,399                 directory, all directories are treated like packages.
2024-11-29T15:04:28,400           ********************************************************************************

2024-11-29T15:04:28,400   !!
2024-11-29T15:04:28,401     check.warn(importable)
2024-11-29T15:04:28,401   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is absent from the `packages` configuration.
2024-11-29T15:04:28,402   !!

2024-11-29T15:04:28,403           ********************************************************************************
2024-11-29T15:04:28,403           ############################
2024-11-29T15:04:28,403           # Package would be ignored #
2024-11-29T15:04:28,404           ############################
2024-11-29T15:04:28,404           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' as an importable package[^1],
2024-11-29T15:04:28,405           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,406           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,406           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' is explicitly added
2024-11-29T15:04:28,407           to the `packages` configuration field.

2024-11-29T15:04:28,408           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,408           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,409           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,410           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,411           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,412           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' to be distributed and are
2024-11-29T15:04:28,413           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalFaithfulness' via
2024-11-29T15:04:28,414           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,414           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,415           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,416           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,417           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,419           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,419                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,420                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,420                 directory, all directories are treated like packages.
2024-11-29T15:04:28,421           ********************************************************************************

2024-11-29T15:04:28,422   !!
2024-11-29T15:04:28,422     check.warn(importable)
2024-11-29T15:04:28,423   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is absent from the `packages` configuration.
2024-11-29T15:04:28,424   !!

2024-11-29T15:04:28,425           ********************************************************************************
2024-11-29T15:04:28,425           ############################
2024-11-29T15:04:28,426           # Package would be ignored #
2024-11-29T15:04:28,427           ############################
2024-11-29T15:04:28,427           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' as an importable package[^1],
2024-11-29T15:04:28,428           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,428           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,429           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' is explicitly added
2024-11-29T15:04:28,429           to the `packages` configuration field.

2024-11-29T15:04:28,430           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,431           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,431           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,432           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,433           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,434           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' to be distributed and are
2024-11-29T15:04:28,435           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.MultiModalRelevance' via
2024-11-29T15:04:28,435           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,436           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,436           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,437           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,438           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,440           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,440                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,441                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,442                 directory, all directories are treated like packages.
2024-11-29T15:04:28,442           ********************************************************************************

2024-11-29T15:04:28,443   !!
2024-11-29T15:04:28,443     check.warn(importable)
2024-11-29T15:04:28,444   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is absent from the `packages` configuration.
2024-11-29T15:04:28,445   !!

2024-11-29T15:04:28,446           ********************************************************************************
2024-11-29T15:04:28,446           ############################
2024-11-29T15:04:28,447           # Package would be ignored #
2024-11-29T15:04:28,447           ############################
2024-11-29T15:04:28,448           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' as an importable package[^1],
2024-11-29T15:04:28,448           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,449           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,450           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' is explicitly added
2024-11-29T15:04:28,450           to the `packages` configuration field.

2024-11-29T15:04:28,451           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,452           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,452           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,454           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,455           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,456           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' to be distributed and are
2024-11-29T15:04:28,456           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.NERExtractor' via
2024-11-29T15:04:28,457           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,457           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,458           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,458           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,459           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,461           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,461                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,462                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,463                 directory, all directories are treated like packages.
2024-11-29T15:04:28,463           ********************************************************************************

2024-11-29T15:04:28,465   !!
2024-11-29T15:04:28,465     check.warn(importable)
2024-11-29T15:04:28,466   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is absent from the `packages` configuration.
2024-11-29T15:04:28,466   !!

2024-11-29T15:04:28,467           ********************************************************************************
2024-11-29T15:04:28,468           ############################
2024-11-29T15:04:28,468           # Package would be ignored #
2024-11-29T15:04:28,469           ############################
2024-11-29T15:04:28,478           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' as an importable package[^1],
2024-11-29T15:04:28,478           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,480           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,480           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' is explicitly added
2024-11-29T15:04:28,480           to the `packages` configuration field.

2024-11-29T15:04:28,482           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,482           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,483           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,484           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,485           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,488           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' to be distributed and are
2024-11-29T15:04:28,490           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SingleHopSpecificQuerySynthesizer' via
2024-11-29T15:04:28,492           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,494           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,498           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,503           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,504           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,506           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,507                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,507                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,508                 directory, all directories are treated like packages.
2024-11-29T15:04:28,508           ********************************************************************************

2024-11-29T15:04:28,509   !!
2024-11-29T15:04:28,510     check.warn(importable)
2024-11-29T15:04:28,510   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is absent from the `packages` configuration.
2024-11-29T15:04:28,511   !!

2024-11-29T15:04:28,512           ********************************************************************************
2024-11-29T15:04:28,512           ############################
2024-11-29T15:04:28,513           # Package would be ignored #
2024-11-29T15:04:28,513           ############################
2024-11-29T15:04:28,514           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' as an importable package[^1],
2024-11-29T15:04:28,514           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,515           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,516           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' is explicitly added
2024-11-29T15:04:28,516           to the `packages` configuration field.

2024-11-29T15:04:28,517           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,518           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,518           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,520           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,521           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,522           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' to be distributed and are
2024-11-29T15:04:28,522           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.SummaryExtractor' via
2024-11-29T15:04:28,523           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,523           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,524           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,525           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,526           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,528           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,529                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,529                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,530                 directory, all directories are treated like packages.
2024-11-29T15:04:28,531           ********************************************************************************

2024-11-29T15:04:28,532   !!
2024-11-29T15:04:28,532     check.warn(importable)
2024-11-29T15:04:28,533   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is absent from the `packages` configuration.
2024-11-29T15:04:28,533   !!

2024-11-29T15:04:28,534           ********************************************************************************
2024-11-29T15:04:28,535           ############################
2024-11-29T15:04:28,536           # Package would be ignored #
2024-11-29T15:04:28,537           ############################
2024-11-29T15:04:28,537           Python recognizes 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' as an importable package[^1],
2024-11-29T15:04:28,541           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,550           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,551           package, please make sure that 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' is explicitly added
2024-11-29T15:04:28,551           to the `packages` configuration field.

2024-11-29T15:04:28,552           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,553           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,553           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,554           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,555           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,556           If you don't want 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' to be distributed and are
2024-11-29T15:04:28,557           already explicitly excluding 'evalscope.backend.rag_eval.ragas.prompts.chinese.ThemesExtractor' via
2024-11-29T15:04:28,557           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,558           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,558           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,560           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,561           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,562           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,563                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,563                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,564                 directory, all directories are treated like packages.
2024-11-29T15:04:28,565           ********************************************************************************

2024-11-29T15:04:28,566   !!
2024-11-29T15:04:28,566     check.warn(importable)
2024-11-29T15:04:28,567   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.benchmarks.bbh.cot_prompts' is absent from the `packages` configuration.
2024-11-29T15:04:28,567   !!

2024-11-29T15:04:28,568           ********************************************************************************
2024-11-29T15:04:28,569           ############################
2024-11-29T15:04:28,570           # Package would be ignored #
2024-11-29T15:04:28,570           ############################
2024-11-29T15:04:28,571           Python recognizes 'evalscope.benchmarks.bbh.cot_prompts' as an importable package[^1],
2024-11-29T15:04:28,571           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,573           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,573           package, please make sure that 'evalscope.benchmarks.bbh.cot_prompts' is explicitly added
2024-11-29T15:04:28,574           to the `packages` configuration field.

2024-11-29T15:04:28,575           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,576           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,576           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,577           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,579           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,580           If you don't want 'evalscope.benchmarks.bbh.cot_prompts' to be distributed and are
2024-11-29T15:04:28,580           already explicitly excluding 'evalscope.benchmarks.bbh.cot_prompts' via
2024-11-29T15:04:28,581           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,581           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,582           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,583           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,584           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,585           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,586                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,587                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,587                 directory, all directories are treated like packages.
2024-11-29T15:04:28,588           ********************************************************************************

2024-11-29T15:04:28,589   !!
2024-11-29T15:04:28,589     check.warn(importable)
2024-11-29T15:04:28,590   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.metrics.resources' is absent from the `packages` configuration.
2024-11-29T15:04:28,590   !!

2024-11-29T15:04:28,591           ********************************************************************************
2024-11-29T15:04:28,592           ############################
2024-11-29T15:04:28,592           # Package would be ignored #
2024-11-29T15:04:28,593           ############################
2024-11-29T15:04:28,593           Python recognizes 'evalscope.metrics.resources' as an importable package[^1],
2024-11-29T15:04:28,594           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,595           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,595           package, please make sure that 'evalscope.metrics.resources' is explicitly added
2024-11-29T15:04:28,596           to the `packages` configuration field.

2024-11-29T15:04:28,597           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,597           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,598           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,599           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,600           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,601           If you don't want 'evalscope.metrics.resources' to be distributed and are
2024-11-29T15:04:28,602           already explicitly excluding 'evalscope.metrics.resources' via
2024-11-29T15:04:28,603           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,603           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,604           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,605           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,606           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,608           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,608                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,609                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,609                 directory, all directories are treated like packages.
2024-11-29T15:04:28,610           ********************************************************************************

2024-11-29T15:04:28,611   !!
2024-11-29T15:04:28,612     check.warn(importable)
2024-11-29T15:04:28,612   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.config' is absent from the `packages` configuration.
2024-11-29T15:04:28,613   !!

2024-11-29T15:04:28,614           ********************************************************************************
2024-11-29T15:04:28,614           ############################
2024-11-29T15:04:28,615           # Package would be ignored #
2024-11-29T15:04:28,615           ############################
2024-11-29T15:04:28,616           Python recognizes 'evalscope.registry.config' as an importable package[^1],
2024-11-29T15:04:28,616           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,617           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,618           package, please make sure that 'evalscope.registry.config' is explicitly added
2024-11-29T15:04:28,618           to the `packages` configuration field.

2024-11-29T15:04:28,619           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,620           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,620           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,622           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,622           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,623           If you don't want 'evalscope.registry.config' to be distributed and are
2024-11-29T15:04:28,624           already explicitly excluding 'evalscope.registry.config' via
2024-11-29T15:04:28,624           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,625           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,625           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,626           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,627           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,629           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,629                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,630                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,630                 directory, all directories are treated like packages.
2024-11-29T15:04:28,631           ********************************************************************************

2024-11-29T15:04:28,632   !!
2024-11-29T15:04:28,633     check.warn(importable)
2024-11-29T15:04:28,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data' is absent from the `packages` configuration.
2024-11-29T15:04:28,634   !!

2024-11-29T15:04:28,635           ********************************************************************************
2024-11-29T15:04:28,635           ############################
2024-11-29T15:04:28,636           # Package would be ignored #
2024-11-29T15:04:28,636           ############################
2024-11-29T15:04:28,637           Python recognizes 'evalscope.registry.data' as an importable package[^1],
2024-11-29T15:04:28,638           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,639           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,639           package, please make sure that 'evalscope.registry.data' is explicitly added
2024-11-29T15:04:28,640           to the `packages` configuration field.

2024-11-29T15:04:28,641           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,642           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,642           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,643           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,644           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,645           If you don't want 'evalscope.registry.data' to be distributed and are
2024-11-29T15:04:28,645           already explicitly excluding 'evalscope.registry.data' via
2024-11-29T15:04:28,646           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,647           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,647           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,648           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,649           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,652                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,652                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,653                 directory, all directories are treated like packages.
2024-11-29T15:04:28,654           ********************************************************************************

2024-11-29T15:04:28,655   !!
2024-11-29T15:04:28,655     check.warn(importable)
2024-11-29T15:04:28,656   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.prompt_template' is absent from the `packages` configuration.
2024-11-29T15:04:28,656   !!

2024-11-29T15:04:28,657           ********************************************************************************
2024-11-29T15:04:28,658           ############################
2024-11-29T15:04:28,659           # Package would be ignored #
2024-11-29T15:04:28,659           ############################
2024-11-29T15:04:28,660           Python recognizes 'evalscope.registry.data.prompt_template' as an importable package[^1],
2024-11-29T15:04:28,661           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,662           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,662           package, please make sure that 'evalscope.registry.data.prompt_template' is explicitly added
2024-11-29T15:04:28,663           to the `packages` configuration field.

2024-11-29T15:04:28,664           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,664           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,665           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,666           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,667           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,669           If you don't want 'evalscope.registry.data.prompt_template' to be distributed and are
2024-11-29T15:04:28,669           already explicitly excluding 'evalscope.registry.data.prompt_template' via
2024-11-29T15:04:28,670           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,670           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,671           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,672           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,673           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,675           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,675                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,676                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,676                 directory, all directories are treated like packages.
2024-11-29T15:04:28,677           ********************************************************************************

2024-11-29T15:04:28,678   !!
2024-11-29T15:04:28,678     check.warn(importable)
2024-11-29T15:04:28,679   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.data.qa_browser' is absent from the `packages` configuration.
2024-11-29T15:04:28,680   !!

2024-11-29T15:04:28,681           ********************************************************************************
2024-11-29T15:04:28,681           ############################
2024-11-29T15:04:28,682           # Package would be ignored #
2024-11-29T15:04:28,682           ############################
2024-11-29T15:04:28,683           Python recognizes 'evalscope.registry.data.qa_browser' as an importable package[^1],
2024-11-29T15:04:28,683           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,684           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,685           package, please make sure that 'evalscope.registry.data.qa_browser' is explicitly added
2024-11-29T15:04:28,685           to the `packages` configuration field.

2024-11-29T15:04:28,687           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,687           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,688           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,689           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,690           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,691           If you don't want 'evalscope.registry.data.qa_browser' to be distributed and are
2024-11-29T15:04:28,692           already explicitly excluding 'evalscope.registry.data.qa_browser' via
2024-11-29T15:04:28,692           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,693           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,693           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,694           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,696           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,697           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,698                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,699                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,699                 directory, all directories are treated like packages.
2024-11-29T15:04:28,700           ********************************************************************************

2024-11-29T15:04:28,701   !!
2024-11-29T15:04:28,702     check.warn(importable)
2024-11-29T15:04:28,702   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'evalscope.registry.tasks' is absent from the `packages` configuration.
2024-11-29T15:04:28,703   !!

2024-11-29T15:04:28,704           ********************************************************************************
2024-11-29T15:04:28,705           ############################
2024-11-29T15:04:28,705           # Package would be ignored #
2024-11-29T15:04:28,706           ############################
2024-11-29T15:04:28,707           Python recognizes 'evalscope.registry.tasks' as an importable package[^1],
2024-11-29T15:04:28,707           but it is absent from setuptools' `packages` configuration.

2024-11-29T15:04:28,708           This leads to an ambiguous overall configuration. If you want to distribute this
2024-11-29T15:04:28,709           package, please make sure that 'evalscope.registry.tasks' is explicitly added
2024-11-29T15:04:28,709           to the `packages` configuration field.

2024-11-29T15:04:28,710           Alternatively, you can also rely on setuptools' discovery methods
2024-11-29T15:04:28,711           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-11-29T15:04:28,711           instead of `find_packages(...)`/`find:`).

2024-11-29T15:04:28,713           You can read more about "package discovery" on setuptools documentation page:

2024-11-29T15:04:28,714           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-11-29T15:04:28,715           If you don't want 'evalscope.registry.tasks' to be distributed and are
2024-11-29T15:04:28,715           already explicitly excluding 'evalscope.registry.tasks' via
2024-11-29T15:04:28,716           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-11-29T15:04:28,716           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-11-29T15:04:28,717           combination with a more fine grained `package-data` configuration.

2024-11-29T15:04:28,718           You can read more about "package data files" on setuptools documentation page:

2024-11-29T15:04:28,719           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-11-29T15:04:28,721           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-11-29T15:04:28,721                 even if it does not contain any `.py` files.
2024-11-29T15:04:28,722                 On the other hand, currently there is no concept of package data
2024-11-29T15:04:28,722                 directory, all directories are treated like packages.
2024-11-29T15:04:28,723           ********************************************************************************

2024-11-29T15:04:28,724   !!
2024-11-29T15:04:28,725     check.warn(importable)
2024-11-29T15:04:28,725   creating build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,726   copying evalscope/registry/tasks/bbh.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,726   copying evalscope/registry/tasks/mmlu.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,727   copying evalscope/registry/tasks/bbh_mini.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,728   copying evalscope/registry/tasks/arc.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,728   copying evalscope/registry/tasks/ceval_mini.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,729   copying evalscope/registry/tasks/gsm8k.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,730   copying evalscope/registry/tasks/ceval.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,730   copying evalscope/registry/tasks/general_qa.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,731   copying evalscope/registry/tasks/mmlu_mini.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,731   copying evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,732   copying evalscope/registry/tasks/cmmlu.yaml -> build/lib/evalscope/registry/tasks
2024-11-29T15:04:28,732   creating build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,733   copying evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,733   copying evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,734   copying evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,734   copying evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,735   copying evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,736   copying evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,736   copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,737   copying evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,737   copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,738   copying evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,739   copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,739   copying evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,740   copying evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,740   copying evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,741   copying evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,742   copying evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,742   copying evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,743   copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,743   copying evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,744   copying evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,744   copying evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,745   copying evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,745   copying evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,746   copying evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,746   copying evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,747   copying evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,748   copying evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/lib/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:28,748   copying evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:28,749   copying evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:28,749   copying evalscope/third_party/longbench_write/resources/judge.txt -> build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:28,750   copying evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/lib/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:28,751   creating build/lib/evalscope/metrics/resources
2024-11-29T15:04:28,751   copying evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/lib/evalscope/metrics/resources
2024-11-29T15:04:28,752   copying evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/lib/evalscope/metrics/resources
2024-11-29T15:04:28,752   creating build/lib/evalscope/registry/config
2024-11-29T15:04:28,753   copying evalscope/registry/config/cfg_arena.yaml -> build/lib/evalscope/registry/config
2024-11-29T15:04:28,753   copying evalscope/registry/config/cfg_arena_zhihu.yaml -> build/lib/evalscope/registry/config
2024-11-29T15:04:28,754   copying evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/lib/evalscope/registry/config
2024-11-29T15:04:28,754   copying evalscope/registry/config/cfg_single.yaml -> build/lib/evalscope/registry/config
2024-11-29T15:04:28,755   creating build/lib/evalscope/registry/data
2024-11-29T15:04:28,755   copying evalscope/registry/data/question.jsonl -> build/lib/evalscope/registry/data
2024-11-29T15:04:28,756   creating build/lib/evalscope/registry/data/prompt_template
2024-11-29T15:04:28,756   copying evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/lib/evalscope/registry/data/prompt_template
2024-11-29T15:04:28,757   copying evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/lib/evalscope/registry/data/prompt_template
2024-11-29T15:04:28,757   creating build/lib/evalscope/registry/data/qa_browser
2024-11-29T15:04:28,758   copying evalscope/registry/data/qa_browser/battle.jsonl -> build/lib/evalscope/registry/data/qa_browser
2024-11-29T15:04:28,758   copying evalscope/registry/data/qa_browser/category_mapping.yaml -> build/lib/evalscope/registry/data/qa_browser
2024-11-29T15:04:28,759   creating build/lib/evalscope/backend/rag_eval/ragas/prompts
2024-11-29T15:04:28,760   copying evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/lib/evalscope/backend/rag_eval/ragas/prompts
2024-11-29T15:04:28,760   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,761   copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,762   copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,762   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy
2024-11-29T15:04:28,763   copying evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy
2024-11-29T15:04:28,763   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision
2024-11-29T15:04:28,764   copying evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision
2024-11-29T15:04:28,764   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,772   copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,773   copying evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,774   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor
2024-11-29T15:04:28,774   copying evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor
2024-11-29T15:04:28,775   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,776   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,776   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,777   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,777   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,778   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,778   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,778   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness
2024-11-29T15:04:28,779   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness
2024-11-29T15:04:28,780   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance
2024-11-29T15:04:28,780   copying evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance
2024-11-29T15:04:28,781   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor
2024-11-29T15:04:28,782   copying evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor
2024-11-29T15:04:28,782   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,783   copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,783   copying evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,784   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor
2024-11-29T15:04:28,784   copying evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor
2024-11-29T15:04:28,785   creating build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor
2024-11-29T15:04:28,785   copying evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor
2024-11-29T15:04:28,786   creating build/lib/evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:28,787   copying evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:28,787   copying evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/lib/evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:28,789   copying evalscope/benchmarks/trivia_qa/samples.jsonl -> build/lib/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:28,789   copying evalscope/benchmarks/ceval/samples.jsonl -> build/lib/evalscope/benchmarks/ceval
2024-11-29T15:04:28,790   copying evalscope/benchmarks/cmmlu/samples.jsonl -> build/lib/evalscope/benchmarks/cmmlu
2024-11-29T15:04:28,790   copying evalscope/benchmarks/race/samples.jsonl -> build/lib/evalscope/benchmarks/race
2024-11-29T15:04:28,791   copying evalscope/benchmarks/mmlu/samples.jsonl -> build/lib/evalscope/benchmarks/mmlu
2024-11-29T15:04:28,791   copying evalscope/third_party/longbench_write/README.md -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:28,792   copying evalscope/third_party/longbench_write/default_task.json -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:28,792   copying evalscope/third_party/longbench_write/default_task.yaml -> build/lib/evalscope/third_party/longbench_write
2024-11-29T15:04:28,793   copying evalscope/third_party/toolbench_static/README.md -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:28,794   copying evalscope/third_party/toolbench_static/config_default.json -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:28,794   copying evalscope/third_party/toolbench_static/config_default.yaml -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:28,795   copying evalscope/third_party/toolbench_static/requirements.txt -> build/lib/evalscope/third_party/toolbench_static
2024-11-29T15:04:28,795   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-11-29T15:04:28,796   !!

2024-11-29T15:04:28,797           ********************************************************************************
2024-11-29T15:04:28,798           Please avoid running ``setup.py`` directly.
2024-11-29T15:04:28,799           Instead, use pypa/build, pypa/installer or other
2024-11-29T15:04:28,799           standards-based tools.

2024-11-29T15:04:28,800           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-11-29T15:04:28,801           ********************************************************************************

2024-11-29T15:04:28,802   !!
2024-11-29T15:04:28,803     self.initialize_options()
2024-11-29T15:04:28,810   installing to build/bdist.linux-armv7l/wheel
2024-11-29T15:04:28,810   running install
2024-11-29T15:04:28,836   running install_lib
2024-11-29T15:04:28,864   creating build/bdist.linux-armv7l/wheel
2024-11-29T15:04:28,867   creating build/bdist.linux-armv7l/wheel/evalscope
2024-11-29T15:04:28,869   copying build/lib/evalscope/version.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:28,873   creating build/bdist.linux-armv7l/wheel/evalscope/backend
2024-11-29T15:04:28,874   copying build/lib/evalscope/backend/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend
2024-11-29T15:04:28,878   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval
2024-11-29T15:04:28,880   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas
2024-11-29T15:04:28,882   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:28,883   copying build/lib/evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:28,885   copying build/lib/evalscope/backend/rag_eval/ragas/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:28,887   copying build/lib/evalscope/backend/rag_eval/ragas/tasks/testset_generation.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/tasks
2024-11-29T15:04:28,890   copying build/lib/evalscope/backend/rag_eval/ragas/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas
2024-11-29T15:04:28,892   copying build/lib/evalscope/backend/rag_eval/ragas/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas
2024-11-29T15:04:28,894   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:28,895   copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:28,898   copying build/lib/evalscope/backend/rag_eval/ragas/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:28,900   copying build/lib/evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/metrics
2024-11-29T15:04:28,903   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts
2024-11-29T15:04:28,905   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese
2024-11-29T15:04:28,906   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor
2024-11-29T15:04:28,908   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor
2024-11-29T15:04:28,911   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,912   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,914   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness
2024-11-29T15:04:28,917   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy
2024-11-29T15:04:28,918   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy
2024-11-29T15:04:28,921   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,922   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,924   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness
2024-11-29T15:04:28,927   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor
2024-11-29T15:04:28,929   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor
2024-11-29T15:04:28,931   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor
2024-11-29T15:04:28,933   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor
2024-11-29T15:04:28,936   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,938   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,940   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer
2024-11-29T15:04:28,943   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor
2024-11-29T15:04:28,945   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor
2024-11-29T15:04:28,947   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,949   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,951   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer
2024-11-29T15:04:28,953   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision
2024-11-29T15:04:28,954   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision
2024-11-29T15:04:28,957   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,958   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,960   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,962   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer
2024-11-29T15:04:28,965   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness
2024-11-29T15:04:28,966   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness
2024-11-29T15:04:28,969   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance
2024-11-29T15:04:28,970   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance
2024-11-29T15:04:28,972   copying build/lib/evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas/prompts
2024-11-29T15:04:28,974   copying build/lib/evalscope/backend/rag_eval/ragas/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/ragas
2024-11-29T15:04:28,976   copying build/lib/evalscope/backend/rag_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval
2024-11-29T15:04:28,979   copying build/lib/evalscope/backend/rag_eval/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval
2024-11-29T15:04:28,982   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:28,984   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,985   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,987   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,990   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,992   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,995   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:28,998   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/STS.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:29,000   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Reranking.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:29,002   copying build/lib/evalscope/backend/rag_eval/cmteb/tasks/Clustering.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb/tasks
2024-11-29T15:04:29,005   copying build/lib/evalscope/backend/rag_eval/cmteb/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:29,006   copying build/lib/evalscope/backend/rag_eval/cmteb/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:29,008   copying build/lib/evalscope/backend/rag_eval/cmteb/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:29,011   copying build/lib/evalscope/backend/rag_eval/cmteb/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/cmteb
2024-11-29T15:04:29,013   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,014   copying build/lib/evalscope/backend/rag_eval/utils/tools.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,017   copying build/lib/evalscope/backend/rag_eval/utils/clip.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,020   copying build/lib/evalscope/backend/rag_eval/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,021   copying build/lib/evalscope/backend/rag_eval/utils/embedding.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,024   copying build/lib/evalscope/backend/rag_eval/utils/llm.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/utils
2024-11-29T15:04:29,026   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:29,028   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:29,030   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:29,032   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:29,036   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:29,040   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/tasks
2024-11-29T15:04:29,043   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:29,045   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:29,047   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:29,050   creating build/bdist.linux-armv7l/wheel/evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:29,052   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:29,054   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark/utils
2024-11-29T15:04:29,057   copying build/lib/evalscope/backend/rag_eval/clip_benchmark/task_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/rag_eval/clip_benchmark
2024-11-29T15:04:29,059   creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass
2024-11-29T15:04:29,061   creating build/bdist.linux-armv7l/wheel/evalscope/backend/opencompass/tasks
2024-11-29T15:04:29,063   copying build/lib/evalscope/backend/opencompass/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks
2024-11-29T15:04:29,064   copying build/lib/evalscope/backend/opencompass/tasks/eval_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks
2024-11-29T15:04:29,066   copying build/lib/evalscope/backend/opencompass/tasks/eval_datasets.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass/tasks
2024-11-29T15:04:29,069   copying build/lib/evalscope/backend/opencompass/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass
2024-11-29T15:04:29,070   copying build/lib/evalscope/backend/opencompass/api_meta_template.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass
2024-11-29T15:04:29,072   copying build/lib/evalscope/backend/opencompass/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/opencompass
2024-11-29T15:04:29,075   copying build/lib/evalscope/backend/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend
2024-11-29T15:04:29,077   creating build/bdist.linux-armv7l/wheel/evalscope/backend/vlm_eval_kit
2024-11-29T15:04:29,079   copying build/lib/evalscope/backend/vlm_eval_kit/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit
2024-11-29T15:04:29,081   copying build/lib/evalscope/backend/vlm_eval_kit/backend_manager.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit
2024-11-29T15:04:29,083   copying build/lib/evalscope/backend/vlm_eval_kit/custom_dataset.py -> build/bdist.linux-armv7l/wheel/./evalscope/backend/vlm_eval_kit
2024-11-29T15:04:29,086   creating build/bdist.linux-armv7l/wheel/evalscope/evaluator
2024-11-29T15:04:29,087   copying build/lib/evalscope/evaluator/rating_eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator
2024-11-29T15:04:29,090   creating build/bdist.linux-armv7l/wheel/evalscope/evaluator/reviewer
2024-11-29T15:04:29,091   copying build/lib/evalscope/evaluator/reviewer/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer
2024-11-29T15:04:29,094   copying build/lib/evalscope/evaluator/reviewer/auto_reviewer.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator/reviewer
2024-11-29T15:04:29,096   copying build/lib/evalscope/evaluator/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator
2024-11-29T15:04:29,098   copying build/lib/evalscope/evaluator/evaluator.py -> build/bdist.linux-armv7l/wheel/./evalscope/evaluator
2024-11-29T15:04:29,101   copying build/lib/evalscope/run.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,105   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks
2024-11-29T15:04:29,106   copying build/lib/evalscope/benchmarks/data_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks
2024-11-29T15:04:29,110   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/general_qa
2024-11-29T15:04:29,111   copying build/lib/evalscope/benchmarks/general_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa
2024-11-29T15:04:29,113   copying build/lib/evalscope/benchmarks/general_qa/general_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/general_qa
2024-11-29T15:04:29,116   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/trivia_qa
2024-11-29T15:04:29,117   copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa
2024-11-29T15:04:29,119   copying build/lib/evalscope/benchmarks/trivia_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa
2024-11-29T15:04:29,122   copying build/lib/evalscope/benchmarks/trivia_qa/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa
2024-11-29T15:04:29,124   copying build/lib/evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/trivia_qa
2024-11-29T15:04:29,127   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/ceval
2024-11-29T15:04:29,128   copying build/lib/evalscope/benchmarks/ceval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval
2024-11-29T15:04:29,130   copying build/lib/evalscope/benchmarks/ceval/ceval_exam.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval
2024-11-29T15:04:29,133   copying build/lib/evalscope/benchmarks/ceval/ceval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval
2024-11-29T15:04:29,135   copying build/lib/evalscope/benchmarks/ceval/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/ceval
2024-11-29T15:04:29,138   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh
2024-11-29T15:04:29,139   copying build/lib/evalscope/benchmarks/bbh/bbh_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh
2024-11-29T15:04:29,143   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,145   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,147   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,149   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/navigate.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,151   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,153   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/snarks.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,155   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,157   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,159   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,162   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,164   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,166   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,168   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,170   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/object_counting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,172   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,175   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,176   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,178   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,180   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,182   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,184   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,186   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,188   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,190   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,192   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,194   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,197   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,199   copying build/lib/evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh/cot_prompts
2024-11-29T15:04:29,201   copying build/lib/evalscope/benchmarks/bbh/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/bbh
2024-11-29T15:04:29,204   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/truthful_qa
2024-11-29T15:04:29,206   copying build/lib/evalscope/benchmarks/truthful_qa/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa
2024-11-29T15:04:29,209   copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa
2024-11-29T15:04:29,212   copying build/lib/evalscope/benchmarks/truthful_qa/truthful_qa.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/truthful_qa
2024-11-29T15:04:29,216   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/cmmlu
2024-11-29T15:04:29,217   copying build/lib/evalscope/benchmarks/cmmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu
2024-11-29T15:04:29,220   copying build/lib/evalscope/benchmarks/cmmlu/cmmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu
2024-11-29T15:04:29,223   copying build/lib/evalscope/benchmarks/cmmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu
2024-11-29T15:04:29,225   copying build/lib/evalscope/benchmarks/cmmlu/cmmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/cmmlu
2024-11-29T15:04:29,230   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/competition_math
2024-11-29T15:04:29,231   copying build/lib/evalscope/benchmarks/competition_math/competition_math_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math
2024-11-29T15:04:29,235   copying build/lib/evalscope/benchmarks/competition_math/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math
2024-11-29T15:04:29,238   copying build/lib/evalscope/benchmarks/competition_math/competition_math.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/competition_math
2024-11-29T15:04:29,240   copying build/lib/evalscope/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks
2024-11-29T15:04:29,243   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/race
2024-11-29T15:04:29,245   copying build/lib/evalscope/benchmarks/race/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race
2024-11-29T15:04:29,247   copying build/lib/evalscope/benchmarks/race/race.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race
2024-11-29T15:04:29,250   copying build/lib/evalscope/benchmarks/race/race_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race
2024-11-29T15:04:29,253   copying build/lib/evalscope/benchmarks/race/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/race
2024-11-29T15:04:29,256   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/arc
2024-11-29T15:04:29,257   copying build/lib/evalscope/benchmarks/arc/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc
2024-11-29T15:04:29,260   copying build/lib/evalscope/benchmarks/arc/arc_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc
2024-11-29T15:04:29,263   copying build/lib/evalscope/benchmarks/arc/ai2_arc.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/arc
2024-11-29T15:04:29,266   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/hellaswag
2024-11-29T15:04:29,268   copying build/lib/evalscope/benchmarks/hellaswag/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag
2024-11-29T15:04:29,270   copying build/lib/evalscope/benchmarks/hellaswag/hellaswag_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag
2024-11-29T15:04:29,273   copying build/lib/evalscope/benchmarks/hellaswag/hellaswag.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/hellaswag
2024-11-29T15:04:29,277   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/gsm8k
2024-11-29T15:04:29,278   copying build/lib/evalscope/benchmarks/gsm8k/gsm8k_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k
2024-11-29T15:04:29,282   copying build/lib/evalscope/benchmarks/gsm8k/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k
2024-11-29T15:04:29,284   copying build/lib/evalscope/benchmarks/gsm8k/gsm8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/gsm8k
2024-11-29T15:04:29,287   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/humaneval
2024-11-29T15:04:29,289   copying build/lib/evalscope/benchmarks/humaneval/humaneval.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval
2024-11-29T15:04:29,291   copying build/lib/evalscope/benchmarks/humaneval/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval
2024-11-29T15:04:29,293   copying build/lib/evalscope/benchmarks/humaneval/humaneval_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/humaneval
2024-11-29T15:04:29,296   copying build/lib/evalscope/benchmarks/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks
2024-11-29T15:04:29,299   creating build/bdist.linux-armv7l/wheel/evalscope/benchmarks/mmlu
2024-11-29T15:04:29,300   copying build/lib/evalscope/benchmarks/mmlu/mmlu_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu
2024-11-29T15:04:29,303   copying build/lib/evalscope/benchmarks/mmlu/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu
2024-11-29T15:04:29,305   copying build/lib/evalscope/benchmarks/mmlu/mmlu.py -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu
2024-11-29T15:04:29,307   copying build/lib/evalscope/benchmarks/mmlu/samples.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/benchmarks/mmlu
2024-11-29T15:04:29,309   creating build/bdist.linux-armv7l/wheel/evalscope/models
2024-11-29T15:04:29,311   creating build/bdist.linux-armv7l/wheel/evalscope/models/api
2024-11-29T15:04:29,312   copying build/lib/evalscope/models/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api
2024-11-29T15:04:29,314   copying build/lib/evalscope/models/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/api
2024-11-29T15:04:29,316   copying build/lib/evalscope/models/template.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,320   copying build/lib/evalscope/models/openai_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,322   copying build/lib/evalscope/models/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,324   creating build/bdist.linux-armv7l/wheel/evalscope/models/custom
2024-11-29T15:04:29,325   copying build/lib/evalscope/models/custom/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom
2024-11-29T15:04:29,327   copying build/lib/evalscope/models/custom/custom_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models/custom
2024-11-29T15:04:29,330   copying build/lib/evalscope/models/dummy_chat_model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,331   copying build/lib/evalscope/models/model_adapter.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,334   copying build/lib/evalscope/models/model.py -> build/bdist.linux-armv7l/wheel/./evalscope/models
2024-11-29T15:04:29,336   copying build/lib/evalscope/config.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,338   creating build/bdist.linux-armv7l/wheel/evalscope/cli
2024-11-29T15:04:29,340   copying build/lib/evalscope/cli/start_perf.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli
2024-11-29T15:04:29,342   copying build/lib/evalscope/cli/cli.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli
2024-11-29T15:04:29,344   copying build/lib/evalscope/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli
2024-11-29T15:04:29,345   copying build/lib/evalscope/cli/start_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli
2024-11-29T15:04:29,347   copying build/lib/evalscope/cli/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/cli
2024-11-29T15:04:29,349   copying build/lib/evalscope/run_ms.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,352   copying build/lib/evalscope/run_arena.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,354   copying build/lib/evalscope/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,356   copying build/lib/evalscope/cache.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,358   copying build/lib/evalscope/summarizer.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,361   creating build/bdist.linux-armv7l/wheel/evalscope/metrics
2024-11-29T15:04:29,362   copying build/lib/evalscope/metrics/math_accuracy.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics
2024-11-29T15:04:29,364   copying build/lib/evalscope/metrics/rouge_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics
2024-11-29T15:04:29,367   creating build/bdist.linux-armv7l/wheel/evalscope/metrics/resources
2024-11-29T15:04:29,368   copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.bpe -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources
2024-11-29T15:04:29,379   copying build/lib/evalscope/metrics/resources/gpt2-zhcn3-v4.json -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/resources
2024-11-29T15:04:29,411   creating build/bdist.linux-armv7l/wheel/evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:29,412   copying build/lib/evalscope/metrics/bundled_rouge_score/rouge_scorer.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:29,414   copying build/lib/evalscope/metrics/bundled_rouge_score/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics/bundled_rouge_score
2024-11-29T15:04:29,416   copying build/lib/evalscope/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics
2024-11-29T15:04:29,418   copying build/lib/evalscope/metrics/code_metric.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics
2024-11-29T15:04:29,420   copying build/lib/evalscope/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/./evalscope/metrics
2024-11-29T15:04:29,423   creating build/bdist.linux-armv7l/wheel/evalscope/tools
2024-11-29T15:04:29,424   copying build/lib/evalscope/tools/rewrite_eval_results.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools
2024-11-29T15:04:29,426   copying build/lib/evalscope/tools/combine_reports.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools
2024-11-29T15:04:29,428   copying build/lib/evalscope/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools
2024-11-29T15:04:29,430   copying build/lib/evalscope/tools/gen_mmlu_subject_mapping.py -> build/bdist.linux-armv7l/wheel/./evalscope/tools
2024-11-29T15:04:29,433   creating build/bdist.linux-armv7l/wheel/evalscope/utils
2024-11-29T15:04:29,434   copying build/lib/evalscope/utils/task_cfg_parser.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,436   copying build/lib/evalscope/utils/completion_parsers.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,438   copying build/lib/evalscope/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,440   copying build/lib/evalscope/utils/arena_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,442   copying build/lib/evalscope/utils/task_utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,444   copying build/lib/evalscope/utils/logger.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,446   copying build/lib/evalscope/utils/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/utils
2024-11-29T15:04:29,450   creating build/bdist.linux-armv7l/wheel/evalscope/registry
2024-11-29T15:04:29,452   creating build/bdist.linux-armv7l/wheel/evalscope/registry/tasks
2024-11-29T15:04:29,453   copying build/lib/evalscope/registry/tasks/bbh.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,455   copying build/lib/evalscope/registry/tasks/mmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,457   copying build/lib/evalscope/registry/tasks/bbh_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,459   copying build/lib/evalscope/registry/tasks/arc.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,461   copying build/lib/evalscope/registry/tasks/ceval_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,462   copying build/lib/evalscope/registry/tasks/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,464   copying build/lib/evalscope/registry/tasks/ceval.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,466   copying build/lib/evalscope/registry/tasks/general_qa.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,468   copying build/lib/evalscope/registry/tasks/mmlu_mini.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,470   copying build/lib/evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,472   copying build/lib/evalscope/registry/tasks/cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/tasks
2024-11-29T15:04:29,474   copying build/lib/evalscope/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/registry
2024-11-29T15:04:29,476   creating build/bdist.linux-armv7l/wheel/evalscope/registry/config
2024-11-29T15:04:29,478   copying build/lib/evalscope/registry/config/cfg_pairwise_baseline.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config
2024-11-29T15:04:29,480   copying build/lib/evalscope/registry/config/cfg_single.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config
2024-11-29T15:04:29,482   copying build/lib/evalscope/registry/config/cfg_arena.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config
2024-11-29T15:04:29,483   copying build/lib/evalscope/registry/config/cfg_arena_zhihu.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/config
2024-11-29T15:04:29,486   creating build/bdist.linux-armv7l/wheel/evalscope/registry/data
2024-11-29T15:04:29,487   creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/prompt_template
2024-11-29T15:04:29,489   copying build/lib/evalscope/registry/data/prompt_template/lmsys_v2.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template
2024-11-29T15:04:29,491   copying build/lib/evalscope/registry/data/prompt_template/prompt_templates.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/prompt_template
2024-11-29T15:04:29,494   copying build/lib/evalscope/registry/data/question.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data
2024-11-29T15:04:29,497   creating build/bdist.linux-armv7l/wheel/evalscope/registry/data/qa_browser
2024-11-29T15:04:29,498   copying build/lib/evalscope/registry/data/qa_browser/category_mapping.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser
2024-11-29T15:04:29,500   copying build/lib/evalscope/registry/data/qa_browser/battle.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/registry/data/qa_browser
2024-11-29T15:04:29,521   creating build/bdist.linux-armv7l/wheel/evalscope/perf
2024-11-29T15:04:29,522   copying build/lib/evalscope/perf/arguments.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf
2024-11-29T15:04:29,525   copying build/lib/evalscope/perf/http_client.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf
2024-11-29T15:04:29,527   copying build/lib/evalscope/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf
2024-11-29T15:04:29,529   creating build/bdist.linux-armv7l/wheel/evalscope/perf/utils
2024-11-29T15:04:29,531   copying build/lib/evalscope/perf/utils/benchmark_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,533   copying build/lib/evalscope/perf/utils/analysis_result.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,535   copying build/lib/evalscope/perf/utils/db_util.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,537   copying build/lib/evalscope/perf/utils/chat_service.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,540   copying build/lib/evalscope/perf/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,541   copying build/lib/evalscope/perf/utils/local_server.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,544   copying build/lib/evalscope/perf/utils/handler.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/utils
2024-11-29T15:04:29,546   copying build/lib/evalscope/perf/main.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf
2024-11-29T15:04:29,548   creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin
2024-11-29T15:04:29,550   creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/api
2024-11-29T15:04:29,551   copying build/lib/evalscope/perf/plugin/api/dashscope_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api
2024-11-29T15:04:29,553   copying build/lib/evalscope/perf/plugin/api/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api
2024-11-29T15:04:29,555   copying build/lib/evalscope/perf/plugin/api/openai_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api
2024-11-29T15:04:29,557   copying build/lib/evalscope/perf/plugin/api/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api
2024-11-29T15:04:29,559   copying build/lib/evalscope/perf/plugin/api/custom_api.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/api
2024-11-29T15:04:29,561   copying build/lib/evalscope/perf/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin
2024-11-29T15:04:29,563   copying build/lib/evalscope/perf/plugin/registry.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin
2024-11-29T15:04:29,566   creating build/bdist.linux-armv7l/wheel/evalscope/perf/plugin/datasets
2024-11-29T15:04:29,567   copying build/lib/evalscope/perf/plugin/datasets/flickr8k.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,569   copying build/lib/evalscope/perf/plugin/datasets/longalpaca.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,571   copying build/lib/evalscope/perf/plugin/datasets/openqa.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,573   copying build/lib/evalscope/perf/plugin/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,575   copying build/lib/evalscope/perf/plugin/datasets/custom.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,577   copying build/lib/evalscope/perf/plugin/datasets/base.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,579   copying build/lib/evalscope/perf/plugin/datasets/line_by_line.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,581   copying build/lib/evalscope/perf/plugin/datasets/speed_benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf/plugin/datasets
2024-11-29T15:04:29,583   copying build/lib/evalscope/perf/benchmark.py -> build/bdist.linux-armv7l/wheel/./evalscope/perf
2024-11-29T15:04:29,586   copying build/lib/evalscope/constants.py -> build/bdist.linux-armv7l/wheel/./evalscope
2024-11-29T15:04:29,588   creating build/bdist.linux-armv7l/wheel/evalscope/third_party
2024-11-29T15:04:29,589   copying build/lib/evalscope/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party
2024-11-29T15:04:29,592   creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write
2024-11-29T15:04:29,593   copying build/lib/evalscope/third_party/longbench_write/default_task.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,595   copying build/lib/evalscope/third_party/longbench_write/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,598   copying build/lib/evalscope/third_party/longbench_write/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,600   creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,602   copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,605   copying build/lib/evalscope/third_party/longbench_write/resources/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,607   copying build/lib/evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,609   copying build/lib/evalscope/third_party/longbench_write/resources/judge.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,611   copying build/lib/evalscope/third_party/longbench_write/resources/longbench_write.jsonl -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/resources
2024-11-29T15:04:29,615   copying build/lib/evalscope/third_party/longbench_write/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,617   copying build/lib/evalscope/third_party/longbench_write/longbench_write.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,619   creating build/bdist.linux-armv7l/wheel/evalscope/third_party/longbench_write/tools
2024-11-29T15:04:29,620   copying build/lib/evalscope/third_party/longbench_write/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools
2024-11-29T15:04:29,622   copying build/lib/evalscope/third_party/longbench_write/tools/data_etl.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write/tools
2024-11-29T15:04:29,624   copying build/lib/evalscope/third_party/longbench_write/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,627   copying build/lib/evalscope/third_party/longbench_write/utils.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,629   copying build/lib/evalscope/third_party/longbench_write/default_task.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/longbench_write
2024-11-29T15:04:29,631   creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static
2024-11-29T15:04:29,633   copying build/lib/evalscope/third_party/toolbench_static/README.md -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,635   copying build/lib/evalscope/third_party/toolbench_static/config_default.json -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,637   copying build/lib/evalscope/third_party/toolbench_static/eval.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,639   copying build/lib/evalscope/third_party/toolbench_static/toolbench_static.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,641   copying build/lib/evalscope/third_party/toolbench_static/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,644   creating build/bdist.linux-armv7l/wheel/evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:29,645   copying build/lib/evalscope/third_party/toolbench_static/llm/__init__.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:29,647   copying build/lib/evalscope/third_party/toolbench_static/llm/swift_infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static/llm
2024-11-29T15:04:29,649   copying build/lib/evalscope/third_party/toolbench_static/config_default.yaml -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,651   copying build/lib/evalscope/third_party/toolbench_static/infer.py -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,654   copying build/lib/evalscope/third_party/toolbench_static/requirements.txt -> build/bdist.linux-armv7l/wheel/./evalscope/third_party/toolbench_static
2024-11-29T15:04:29,656   creating build/bdist.linux-armv7l/wheel/tests
2024-11-29T15:04:29,658   creating build/bdist.linux-armv7l/wheel/tests/rag
2024-11-29T15:04:29,659   copying build/lib/tests/rag/test_clip_benchmark.py -> build/bdist.linux-armv7l/wheel/./tests/rag
2024-11-29T15:04:29,661   copying build/lib/tests/rag/test_ragas.py -> build/bdist.linux-armv7l/wheel/./tests/rag
2024-11-29T15:04:29,663   copying build/lib/tests/rag/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/rag
2024-11-29T15:04:29,665   copying build/lib/tests/rag/test_mteb.py -> build/bdist.linux-armv7l/wheel/./tests/rag
2024-11-29T15:04:29,668   creating build/bdist.linux-armv7l/wheel/tests/vlm
2024-11-29T15:04:29,669   copying build/lib/tests/vlm/test_vlmeval.py -> build/bdist.linux-armv7l/wheel/./tests/vlm
2024-11-29T15:04:29,671   copying build/lib/tests/vlm/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/vlm
2024-11-29T15:04:29,673   creating build/bdist.linux-armv7l/wheel/tests/cli
2024-11-29T15:04:29,674   copying build/lib/tests/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/cli
2024-11-29T15:04:29,676   copying build/lib/tests/cli/test_run.py -> build/bdist.linux-armv7l/wheel/./tests/cli
2024-11-29T15:04:29,678   copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests
2024-11-29T15:04:29,680   copying build/lib/tests/test_run_all.py -> build/bdist.linux-armv7l/wheel/./tests
2024-11-29T15:04:29,683   creating build/bdist.linux-armv7l/wheel/tests/perf
2024-11-29T15:04:29,684   copying build/lib/tests/perf/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/perf
2024-11-29T15:04:29,686   copying build/lib/tests/perf/test_perf.py -> build/bdist.linux-armv7l/wheel/./tests/perf
2024-11-29T15:04:29,688   creating build/bdist.linux-armv7l/wheel/tests/swift
2024-11-29T15:04:29,690   copying build/lib/tests/swift/test_run_swift_vlm_jugde_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift
2024-11-29T15:04:29,692   copying build/lib/tests/swift/test_run_swift_vlm_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift
2024-11-29T15:04:29,695   copying build/lib/tests/swift/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/swift
2024-11-29T15:04:29,697   copying build/lib/tests/swift/test_run_swift_eval.py -> build/bdist.linux-armv7l/wheel/./tests/swift
2024-11-29T15:04:29,700   running install_egg_info
2024-11-29T15:04:29,733   Copying evalscope.egg-info to build/bdist.linux-armv7l/wheel/./evalscope-0.7.0-py3.11.egg-info
2024-11-29T15:04:29,749   running install_scripts
2024-11-29T15:04:29,799   creating build/bdist.linux-armv7l/wheel/evalscope-0.7.0.dist-info/WHEEL
2024-11-29T15:04:29,802   creating '/tmp/pip-wheel-31h9zes0/evalscope-0.7.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-11-29T15:04:29,805   adding 'evalscope/__init__.py'
2024-11-29T15:04:29,807   adding 'evalscope/cache.py'
2024-11-29T15:04:29,809   adding 'evalscope/config.py'
2024-11-29T15:04:29,811   adding 'evalscope/constants.py'
2024-11-29T15:04:29,814   adding 'evalscope/run.py'
2024-11-29T15:04:29,816   adding 'evalscope/run_arena.py'
2024-11-29T15:04:29,818   adding 'evalscope/run_ms.py'
2024-11-29T15:04:29,820   adding 'evalscope/summarizer.py'
2024-11-29T15:04:29,822   adding 'evalscope/version.py'
2024-11-29T15:04:29,824   adding 'evalscope/backend/__init__.py'
2024-11-29T15:04:29,825   adding 'evalscope/backend/base.py'
2024-11-29T15:04:29,827   adding 'evalscope/backend/opencompass/__init__.py'
2024-11-29T15:04:29,829   adding 'evalscope/backend/opencompass/api_meta_template.py'
2024-11-29T15:04:29,832   adding 'evalscope/backend/opencompass/backend_manager.py'
2024-11-29T15:04:29,834   adding 'evalscope/backend/opencompass/tasks/__init__.py'
2024-11-29T15:04:29,836   adding 'evalscope/backend/opencompass/tasks/eval_api.py'
2024-11-29T15:04:29,838   adding 'evalscope/backend/opencompass/tasks/eval_datasets.py'
2024-11-29T15:04:29,840   adding 'evalscope/backend/rag_eval/__init__.py'
2024-11-29T15:04:29,842   adding 'evalscope/backend/rag_eval/backend_manager.py'
2024-11-29T15:04:29,844   adding 'evalscope/backend/rag_eval/clip_benchmark/__init__.py'
2024-11-29T15:04:29,846   adding 'evalscope/backend/rag_eval/clip_benchmark/arguments.py'
2024-11-29T15:04:29,848   adding 'evalscope/backend/rag_eval/clip_benchmark/dataset_builder.py'
2024-11-29T15:04:29,850   adding 'evalscope/backend/rag_eval/clip_benchmark/task_template.py'
2024-11-29T15:04:29,852   adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/__init__.py'
2024-11-29T15:04:29,853   adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/image_caption.py'
2024-11-29T15:04:29,856   adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_classification.py'
2024-11-29T15:04:29,858   adding 'evalscope/backend/rag_eval/clip_benchmark/tasks/zeroshot_retrieval.py'
2024-11-29T15:04:29,861   adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdataset_convert.py'
2024-11-29T15:04:29,862   adding 'evalscope/backend/rag_eval/clip_benchmark/utils/webdatasets.txt'
2024-11-29T15:04:29,864   adding 'evalscope/backend/rag_eval/cmteb/__init__.py'
2024-11-29T15:04:29,866   adding 'evalscope/backend/rag_eval/cmteb/arguments.py'
2024-11-29T15:04:29,868   adding 'evalscope/backend/rag_eval/cmteb/base.py'
2024-11-29T15:04:29,870   adding 'evalscope/backend/rag_eval/cmteb/task_template.py'
2024-11-29T15:04:29,872   adding 'evalscope/backend/rag_eval/cmteb/tasks/Classification.py'
2024-11-29T15:04:29,874   adding 'evalscope/backend/rag_eval/cmteb/tasks/Clustering.py'
2024-11-29T15:04:29,876   adding 'evalscope/backend/rag_eval/cmteb/tasks/CustomTask.py'
2024-11-29T15:04:29,878   adding 'evalscope/backend/rag_eval/cmteb/tasks/PairClassification.py'
2024-11-29T15:04:29,879   adding 'evalscope/backend/rag_eval/cmteb/tasks/Reranking.py'
2024-11-29T15:04:29,882   adding 'evalscope/backend/rag_eval/cmteb/tasks/Retrieval.py'
2024-11-29T15:04:29,884   adding 'evalscope/backend/rag_eval/cmteb/tasks/STS.py'
2024-11-29T15:04:29,887   adding 'evalscope/backend/rag_eval/cmteb/tasks/__init__.py'
2024-11-29T15:04:29,889   adding 'evalscope/backend/rag_eval/ragas/__init__.py'
2024-11-29T15:04:29,891   adding 'evalscope/backend/rag_eval/ragas/arguments.py'
2024-11-29T15:04:29,892   adding 'evalscope/backend/rag_eval/ragas/task_template.py'
2024-11-29T15:04:29,894   adding 'evalscope/backend/rag_eval/ragas/metrics/__init__.py'
2024-11-29T15:04:29,896   adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_faithfulness.py'
2024-11-29T15:04:29,898   adding 'evalscope/backend/rag_eval/ragas/metrics/multi_modal_relevance.py'
2024-11-29T15:04:29,900   adding 'evalscope/backend/rag_eval/ragas/prompts/persona_prompt.py'
2024-11-29T15:04:29,903   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/correctness_prompt_chinese.json'
2024-11-29T15:04:29,904   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerCorrectness/long_form_answer_prompt_chinese.json'
2024-11-29T15:04:29,907   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/AnswerRelevancy/question_generation_chinese.json'
2024-11-29T15:04:29,909   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ContextPrecision/context_precision_prompt_chinese.json'
2024-11-29T15:04:29,911   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/nli_statements_message_chinese.json'
2024-11-29T15:04:29,913   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/Faithfulness/statement_prompt_chinese.json'
2024-11-29T15:04:29,915   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/HeadlinesExtractor/prompt_chinese.json'
2024-11-29T15:04:29,917   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/concept_combination_prompt_chinese.json'
2024-11-29T15:04:29,919   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/generate_query_reference_prompt_chinese.json'
2024-11-29T15:04:29,921   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopAbstractQuerySynthesizer/theme_persona_matching_prompt_chinese.json'
2024-11-29T15:04:29,923   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json'
2024-11-29T15:04:29,924   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json'
2024-11-29T15:04:29,927   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalFaithfulness/faithfulness_prompt_chinese.json'
2024-11-29T15:04:29,929   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/MultiModalRelevance/relevance_prompt_chinese.json'
2024-11-29T15:04:29,930   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/NERExtractor/prompt_chinese.json'
2024-11-29T15:04:29,932   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/generate_query_reference_prompt_chinese.json'
2024-11-29T15:04:29,933   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SingleHopSpecificQuerySynthesizer/theme_persona_matching_prompt_chinese.json'
2024-11-29T15:04:29,935   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/SummaryExtractor/prompt_chinese.json'
2024-11-29T15:04:29,937   adding 'evalscope/backend/rag_eval/ragas/prompts/chinese/ThemesExtractor/prompt_chinese.json'
2024-11-29T15:04:29,938   adding 'evalscope/backend/rag_eval/ragas/tasks/__init__.py'
2024-11-29T15:04:29,940   adding 'evalscope/backend/rag_eval/ragas/tasks/testset_generation.py'
2024-11-29T15:04:29,942   adding 'evalscope/backend/rag_eval/ragas/tasks/translate_prompt.py'
2024-11-29T15:04:29,943   adding 'evalscope/backend/rag_eval/utils/__init__.py'
2024-11-29T15:04:29,945   adding 'evalscope/backend/rag_eval/utils/clip.py'
2024-11-29T15:04:29,946   adding 'evalscope/backend/rag_eval/utils/embedding.py'
2024-11-29T15:04:29,947   adding 'evalscope/backend/rag_eval/utils/llm.py'
2024-11-29T15:04:29,949   adding 'evalscope/backend/rag_eval/utils/tools.py'
2024-11-29T15:04:29,950   adding 'evalscope/backend/vlm_eval_kit/__init__.py'
2024-11-29T15:04:29,952   adding 'evalscope/backend/vlm_eval_kit/backend_manager.py'
2024-11-29T15:04:29,953   adding 'evalscope/backend/vlm_eval_kit/custom_dataset.py'
2024-11-29T15:04:29,955   adding 'evalscope/benchmarks/__init__.py'
2024-11-29T15:04:29,956   adding 'evalscope/benchmarks/benchmark.py'
2024-11-29T15:04:29,958   adding 'evalscope/benchmarks/data_adapter.py'
2024-11-29T15:04:29,960   adding 'evalscope/benchmarks/arc/__init__.py'
2024-11-29T15:04:29,961   adding 'evalscope/benchmarks/arc/ai2_arc.py'
2024-11-29T15:04:29,963   adding 'evalscope/benchmarks/arc/arc_adapter.py'
2024-11-29T15:04:29,965   adding 'evalscope/benchmarks/bbh/__init__.py'
2024-11-29T15:04:29,966   adding 'evalscope/benchmarks/bbh/bbh_adapter.py'
2024-11-29T15:04:29,969   adding 'evalscope/benchmarks/bbh/cot_prompts/boolean_expressions.txt'
2024-11-29T15:04:29,970   adding 'evalscope/benchmarks/bbh/cot_prompts/causal_judgement.txt'
2024-11-29T15:04:29,971   adding 'evalscope/benchmarks/bbh/cot_prompts/date_understanding.txt'
2024-11-29T15:04:29,972   adding 'evalscope/benchmarks/bbh/cot_prompts/disambiguation_qa.txt'
2024-11-29T15:04:29,974   adding 'evalscope/benchmarks/bbh/cot_prompts/dyck_languages.txt'
2024-11-29T15:04:29,975   adding 'evalscope/benchmarks/bbh/cot_prompts/formal_fallacies.txt'
2024-11-29T15:04:29,977   adding 'evalscope/benchmarks/bbh/cot_prompts/geometric_shapes.txt'
2024-11-29T15:04:29,978   adding 'evalscope/benchmarks/bbh/cot_prompts/hyperbaton.txt'
2024-11-29T15:04:29,979   adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt'
2024-11-29T15:04:29,980   adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt'
2024-11-29T15:04:29,982   adding 'evalscope/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt'
2024-11-29T15:04:29,983   adding 'evalscope/benchmarks/bbh/cot_prompts/movie_recommendation.txt'
2024-11-29T15:04:29,984   adding 'evalscope/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt'
2024-11-29T15:04:29,985   adding 'evalscope/benchmarks/bbh/cot_prompts/navigate.txt'
2024-11-29T15:04:29,987   adding 'evalscope/benchmarks/bbh/cot_prompts/object_counting.txt'
2024-11-29T15:04:29,988   adding 'evalscope/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt'
2024-11-29T15:04:29,990   adding 'evalscope/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt'
2024-11-29T15:04:29,992   adding 'evalscope/benchmarks/bbh/cot_prompts/ruin_names.txt'
2024-11-29T15:04:29,993   adding 'evalscope/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt'
2024-11-29T15:04:29,995   adding 'evalscope/benchmarks/bbh/cot_prompts/snarks.txt'
2024-11-29T15:04:29,996   adding 'evalscope/benchmarks/bbh/cot_prompts/sports_understanding.txt'
2024-11-29T15:04:29,998   adding 'evalscope/benchmarks/bbh/cot_prompts/temporal_sequences.txt'
2024-11-29T15:04:29,999   adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt'
2024-11-29T15:04:30,001   adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt'
2024-11-29T15:04:30,003   adding 'evalscope/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt'
2024-11-29T15:04:30,004   adding 'evalscope/benchmarks/bbh/cot_prompts/web_of_lies.txt'
2024-11-29T15:04:30,006   adding 'evalscope/benchmarks/bbh/cot_prompts/word_sorting.txt'
2024-11-29T15:04:30,008   adding 'evalscope/benchmarks/ceval/__init__.py'
2024-11-29T15:04:30,012   adding 'evalscope/benchmarks/ceval/ceval_adapter.py'
2024-11-29T15:04:30,014   adding 'evalscope/benchmarks/ceval/ceval_exam.py'
2024-11-29T15:04:30,016   adding 'evalscope/benchmarks/ceval/samples.jsonl'
2024-11-29T15:04:30,019   adding 'evalscope/benchmarks/cmmlu/__init__.py'
2024-11-29T15:04:30,022   adding 'evalscope/benchmarks/cmmlu/cmmlu.py'
2024-11-29T15:04:30,025   adding 'evalscope/benchmarks/cmmlu/cmmlu_adapter.py'
2024-11-29T15:04:30,027   adding 'evalscope/benchmarks/cmmlu/samples.jsonl'
2024-11-29T15:04:30,030   adding 'evalscope/benchmarks/competition_math/__init__.py'
2024-11-29T15:04:30,032   adding 'evalscope/benchmarks/competition_math/competition_math.py'
2024-11-29T15:04:30,036   adding 'evalscope/benchmarks/competition_math/competition_math_adapter.py'
2024-11-29T15:04:30,039   adding 'evalscope/benchmarks/general_qa/__init__.py'
2024-11-29T15:04:30,041   adding 'evalscope/benchmarks/general_qa/general_qa_adapter.py'
2024-11-29T15:04:30,044   adding 'evalscope/benchmarks/gsm8k/__init__.py'
2024-11-29T15:04:30,046   adding 'evalscope/benchmarks/gsm8k/gsm8k.py'
2024-11-29T15:04:30,049   adding 'evalscope/benchmarks/gsm8k/gsm8k_adapter.py'
2024-11-29T15:04:30,052   adding 'evalscope/benchmarks/hellaswag/__init__.py'
2024-11-29T15:04:30,054   adding 'evalscope/benchmarks/hellaswag/hellaswag.py'
2024-11-29T15:04:30,057   adding 'evalscope/benchmarks/hellaswag/hellaswag_adapter.py'
2024-11-29T15:04:30,060   adding 'evalscope/benchmarks/humaneval/__init__.py'
2024-11-29T15:04:30,062   adding 'evalscope/benchmarks/humaneval/humaneval.py'
2024-11-29T15:04:30,064   adding 'evalscope/benchmarks/humaneval/humaneval_adapter.py'
2024-11-29T15:04:30,067   adding 'evalscope/benchmarks/mmlu/__init__.py'
2024-11-29T15:04:30,069   adding 'evalscope/benchmarks/mmlu/mmlu.py'
2024-11-29T15:04:30,073   adding 'evalscope/benchmarks/mmlu/mmlu_adapter.py'
2024-11-29T15:04:30,075   adding 'evalscope/benchmarks/mmlu/samples.jsonl'
2024-11-29T15:04:30,078   adding 'evalscope/benchmarks/race/__init__.py'
2024-11-29T15:04:30,080   adding 'evalscope/benchmarks/race/race.py'
2024-11-29T15:04:30,083   adding 'evalscope/benchmarks/race/race_adapter.py'
2024-11-29T15:04:30,086   adding 'evalscope/benchmarks/race/samples.jsonl'
2024-11-29T15:04:30,088   adding 'evalscope/benchmarks/trivia_qa/__init__.py'
2024-11-29T15:04:30,091   adding 'evalscope/benchmarks/trivia_qa/samples.jsonl'
2024-11-29T15:04:30,093   adding 'evalscope/benchmarks/trivia_qa/trivia_qa.py'
2024-11-29T15:04:30,095   adding 'evalscope/benchmarks/trivia_qa/trivia_qa_adapter.py'
2024-11-29T15:04:30,098   adding 'evalscope/benchmarks/truthful_qa/__init__.py'
2024-11-29T15:04:30,101   adding 'evalscope/benchmarks/truthful_qa/truthful_qa.py'
2024-11-29T15:04:30,104   adding 'evalscope/benchmarks/truthful_qa/truthful_qa_adapter.py'
2024-11-29T15:04:30,106   adding 'evalscope/cli/__init__.py'
2024-11-29T15:04:30,108   adding 'evalscope/cli/base.py'
2024-11-29T15:04:30,110   adding 'evalscope/cli/cli.py'
2024-11-29T15:04:30,111   adding 'evalscope/cli/start_perf.py'
2024-11-29T15:04:30,113   adding 'evalscope/cli/start_server.py'
2024-11-29T15:04:30,115   adding 'evalscope/evaluator/__init__.py'
2024-11-29T15:04:30,118   adding 'evalscope/evaluator/evaluator.py'
2024-11-29T15:04:30,120   adding 'evalscope/evaluator/rating_eval.py'
2024-11-29T15:04:30,122   adding 'evalscope/evaluator/reviewer/__init__.py'
2024-11-29T15:04:30,125   adding 'evalscope/evaluator/reviewer/auto_reviewer.py'
2024-11-29T15:04:30,127   adding 'evalscope/metrics/__init__.py'
2024-11-29T15:04:30,128   adding 'evalscope/metrics/code_metric.py'
2024-11-29T15:04:30,130   adding 'evalscope/metrics/math_accuracy.py'
2024-11-29T15:04:30,132   adding 'evalscope/metrics/metrics.py'
2024-11-29T15:04:30,134   adding 'evalscope/metrics/rouge_metric.py'
2024-11-29T15:04:30,136   adding 'evalscope/metrics/bundled_rouge_score/__init__.py'
2024-11-29T15:04:30,138   adding 'evalscope/metrics/bundled_rouge_score/rouge_scorer.py'
2024-11-29T15:04:30,298   adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.bpe'
2024-11-29T15:04:30,541   adding 'evalscope/metrics/resources/gpt2-zhcn3-v4.json'
2024-11-29T15:04:30,552   adding 'evalscope/models/__init__.py'
2024-11-29T15:04:30,553   adding 'evalscope/models/dummy_chat_model.py'
2024-11-29T15:04:30,555   adding 'evalscope/models/model.py'
2024-11-29T15:04:30,558   adding 'evalscope/models/model_adapter.py'
2024-11-29T15:04:30,560   adding 'evalscope/models/openai_model.py'
2024-11-29T15:04:30,566   adding 'evalscope/models/template.py'
2024-11-29T15:04:30,568   adding 'evalscope/models/api/__init__.py'
2024-11-29T15:04:30,570   adding 'evalscope/models/api/openai_api.py'
2024-11-29T15:04:30,572   adding 'evalscope/models/custom/__init__.py'
2024-11-29T15:04:30,573   adding 'evalscope/models/custom/custom_model.py'
2024-11-29T15:04:30,576   adding 'evalscope/perf/__init__.py'
2024-11-29T15:04:30,577   adding 'evalscope/perf/arguments.py'
2024-11-29T15:04:30,580   adding 'evalscope/perf/benchmark.py'
2024-11-29T15:04:30,582   adding 'evalscope/perf/http_client.py'
2024-11-29T15:04:30,583   adding 'evalscope/perf/main.py'
2024-11-29T15:04:30,585   adding 'evalscope/perf/plugin/__init__.py'
2024-11-29T15:04:30,587   adding 'evalscope/perf/plugin/registry.py'
2024-11-29T15:04:30,589   adding 'evalscope/perf/plugin/api/__init__.py'
2024-11-29T15:04:30,591   adding 'evalscope/perf/plugin/api/base.py'
2024-11-29T15:04:30,593   adding 'evalscope/perf/plugin/api/custom_api.py'
2024-11-29T15:04:30,595   adding 'evalscope/perf/plugin/api/dashscope_api.py'
2024-11-29T15:04:30,596   adding 'evalscope/perf/plugin/api/openai_api.py'
2024-11-29T15:04:30,598   adding 'evalscope/perf/plugin/datasets/__init__.py'
2024-11-29T15:04:30,600   adding 'evalscope/perf/plugin/datasets/base.py'
2024-11-29T15:04:30,602   adding 'evalscope/perf/plugin/datasets/custom.py'
2024-11-29T15:04:30,603   adding 'evalscope/perf/plugin/datasets/flickr8k.py'
2024-11-29T15:04:30,605   adding 'evalscope/perf/plugin/datasets/line_by_line.py'
2024-11-29T15:04:30,606   adding 'evalscope/perf/plugin/datasets/longalpaca.py'
2024-11-29T15:04:30,607   adding 'evalscope/perf/plugin/datasets/openqa.py'
2024-11-29T15:04:30,609   adding 'evalscope/perf/plugin/datasets/speed_benchmark.py'
2024-11-29T15:04:30,611   adding 'evalscope/perf/utils/__init__.py'
2024-11-29T15:04:30,613   adding 'evalscope/perf/utils/analysis_result.py'
2024-11-29T15:04:30,614   adding 'evalscope/perf/utils/benchmark_util.py'
2024-11-29T15:04:30,616   adding 'evalscope/perf/utils/chat_service.py'
2024-11-29T15:04:30,618   adding 'evalscope/perf/utils/db_util.py'
2024-11-29T15:04:30,620   adding 'evalscope/perf/utils/handler.py'
2024-11-29T15:04:30,622   adding 'evalscope/perf/utils/local_server.py'
2024-11-29T15:04:30,624   adding 'evalscope/registry/__init__.py'
2024-11-29T15:04:30,626   adding 'evalscope/registry/config/cfg_arena.yaml'
2024-11-29T15:04:30,628   adding 'evalscope/registry/config/cfg_arena_zhihu.yaml'
2024-11-29T15:04:30,630   adding 'evalscope/registry/config/cfg_pairwise_baseline.yaml'
2024-11-29T15:04:30,632   adding 'evalscope/registry/config/cfg_single.yaml'
2024-11-29T15:04:30,635   adding 'evalscope/registry/data/question.jsonl'
2024-11-29T15:04:30,637   adding 'evalscope/registry/data/prompt_template/lmsys_v2.jsonl'
2024-11-29T15:04:30,639   adding 'evalscope/registry/data/prompt_template/prompt_templates.jsonl'
2024-11-29T15:04:30,804   adding 'evalscope/registry/data/qa_browser/battle.jsonl'
2024-11-29T15:04:30,813   adding 'evalscope/registry/data/qa_browser/category_mapping.yaml'
2024-11-29T15:04:30,816   adding 'evalscope/registry/tasks/arc.yaml'
2024-11-29T15:04:30,817   adding 'evalscope/registry/tasks/bbh.yaml'
2024-11-29T15:04:30,819   adding 'evalscope/registry/tasks/bbh_mini.yaml'
2024-11-29T15:04:30,820   adding 'evalscope/registry/tasks/ceval.yaml'
2024-11-29T15:04:30,822   adding 'evalscope/registry/tasks/ceval_mini.yaml'
2024-11-29T15:04:30,824   adding 'evalscope/registry/tasks/cmmlu.yaml'
2024-11-29T15:04:30,825   adding 'evalscope/registry/tasks/eval_qwen-7b-chat_v100.yaml'
2024-11-29T15:04:30,827   adding 'evalscope/registry/tasks/general_qa.yaml'
2024-11-29T15:04:30,828   adding 'evalscope/registry/tasks/gsm8k.yaml'
2024-11-29T15:04:30,830   adding 'evalscope/registry/tasks/mmlu.yaml'
2024-11-29T15:04:30,831   adding 'evalscope/registry/tasks/mmlu_mini.yaml'
2024-11-29T15:04:30,833   adding 'evalscope/third_party/__init__.py'
2024-11-29T15:04:30,835   adding 'evalscope/third_party/longbench_write/README.md'
2024-11-29T15:04:30,837   adding 'evalscope/third_party/longbench_write/__init__.py'
2024-11-29T15:04:30,838   adding 'evalscope/third_party/longbench_write/default_task.json'
2024-11-29T15:04:30,840   adding 'evalscope/third_party/longbench_write/default_task.yaml'
2024-11-29T15:04:30,842   adding 'evalscope/third_party/longbench_write/eval.py'
2024-11-29T15:04:30,844   adding 'evalscope/third_party/longbench_write/infer.py'
2024-11-29T15:04:30,846   adding 'evalscope/third_party/longbench_write/longbench_write.py'
2024-11-29T15:04:30,848   adding 'evalscope/third_party/longbench_write/utils.py'
2024-11-29T15:04:30,850   adding 'evalscope/third_party/longbench_write/resources/__init__.py'
2024-11-29T15:04:30,851   adding 'evalscope/third_party/longbench_write/resources/judge.txt'
2024-11-29T15:04:30,859   adding 'evalscope/third_party/longbench_write/resources/longbench_write.jsonl'
2024-11-29T15:04:30,863   adding 'evalscope/third_party/longbench_write/resources/longbench_write_en.jsonl'
2024-11-29T15:04:30,865   adding 'evalscope/third_party/longbench_write/resources/longwrite_ruler.jsonl'
2024-11-29T15:04:30,867   adding 'evalscope/third_party/longbench_write/tools/__init__.py'
2024-11-29T15:04:30,868   adding 'evalscope/third_party/longbench_write/tools/data_etl.py'
2024-11-29T15:04:30,871   adding 'evalscope/third_party/toolbench_static/README.md'
2024-11-29T15:04:30,872   adding 'evalscope/third_party/toolbench_static/__init__.py'
2024-11-29T15:04:30,874   adding 'evalscope/third_party/toolbench_static/config_default.json'
2024-11-29T15:04:30,875   adding 'evalscope/third_party/toolbench_static/config_default.yaml'
2024-11-29T15:04:30,877   adding 'evalscope/third_party/toolbench_static/eval.py'
2024-11-29T15:04:30,879   adding 'evalscope/third_party/toolbench_static/infer.py'
2024-11-29T15:04:30,881   adding 'evalscope/third_party/toolbench_static/requirements.txt'
2024-11-29T15:04:30,882   adding 'evalscope/third_party/toolbench_static/toolbench_static.py'
2024-11-29T15:04:30,884   adding 'evalscope/third_party/toolbench_static/llm/__init__.py'
2024-11-29T15:04:30,886   adding 'evalscope/third_party/toolbench_static/llm/swift_infer.py'
2024-11-29T15:04:30,888   adding 'evalscope/tools/__init__.py'
2024-11-29T15:04:30,890   adding 'evalscope/tools/combine_reports.py'
2024-11-29T15:04:30,892   adding 'evalscope/tools/gen_mmlu_subject_mapping.py'
2024-11-29T15:04:30,893   adding 'evalscope/tools/rewrite_eval_results.py'
2024-11-29T15:04:30,895   adding 'evalscope/utils/__init__.py'
2024-11-29T15:04:30,898   adding 'evalscope/utils/arena_utils.py'
2024-11-29T15:04:30,899   adding 'evalscope/utils/completion_parsers.py'
2024-11-29T15:04:30,901   adding 'evalscope/utils/logger.py'
2024-11-29T15:04:30,902   adding 'evalscope/utils/task_cfg_parser.py'
2024-11-29T15:04:30,904   adding 'evalscope/utils/task_utils.py'
2024-11-29T15:04:30,907   adding 'evalscope/utils/utils.py'
2024-11-29T15:04:30,910   adding 'tests/__init__.py'
2024-11-29T15:04:30,911   adding 'tests/test_run_all.py'
2024-11-29T15:04:30,913   adding 'tests/cli/__init__.py'
2024-11-29T15:04:30,915   adding 'tests/cli/test_run.py'
2024-11-29T15:04:30,917   adding 'tests/perf/__init__.py'
2024-11-29T15:04:30,918   adding 'tests/perf/test_perf.py'
2024-11-29T15:04:30,920   adding 'tests/rag/__init__.py'
2024-11-29T15:04:30,922   adding 'tests/rag/test_clip_benchmark.py'
2024-11-29T15:04:30,923   adding 'tests/rag/test_mteb.py'
2024-11-29T15:04:30,925   adding 'tests/rag/test_ragas.py'
2024-11-29T15:04:30,927   adding 'tests/swift/__init__.py'
2024-11-29T15:04:30,928   adding 'tests/swift/test_run_swift_eval.py'
2024-11-29T15:04:30,930   adding 'tests/swift/test_run_swift_vlm_eval.py'
2024-11-29T15:04:30,932   adding 'tests/swift/test_run_swift_vlm_jugde_eval.py'
2024-11-29T15:04:30,934   adding 'tests/vlm/__init__.py'
2024-11-29T15:04:30,936   adding 'tests/vlm/test_vlmeval.py'
2024-11-29T15:04:30,938   adding 'evalscope-0.7.0.dist-info/LICENSE'
2024-11-29T15:04:30,941   adding 'evalscope-0.7.0.dist-info/METADATA'
2024-11-29T15:04:30,943   adding 'evalscope-0.7.0.dist-info/WHEEL'
2024-11-29T15:04:30,944   adding 'evalscope-0.7.0.dist-info/entry_points.txt'
2024-11-29T15:04:30,945   adding 'evalscope-0.7.0.dist-info/top_level.txt'
2024-11-29T15:04:30,950   adding 'evalscope-0.7.0.dist-info/RECORD'
2024-11-29T15:04:30,969   removing build/bdist.linux-armv7l/wheel
2024-11-29T15:04:31,174   Building wheel for evalscope (setup.py): finished with status 'done'
2024-11-29T15:04:31,191   Created wheel for evalscope: filename=evalscope-0.7.0-py3-none-any.whl size=1428098 sha256=2deddeb89bfb6fa02844b72a2be24627526136cbd45315e8e4dadb672d53c9fc
2024-11-29T15:04:31,192   Stored in directory: /tmp/pip-ephem-wheel-cache-dszp0at6/wheels/d2/b8/67/cb2814ad69c556f43eab3f2e5c8f79714623b6e48dbbbb660e
2024-11-29T15:04:31,218 Successfully built evalscope
2024-11-29T15:04:31,267 Removed build tracker: '/tmp/pip-build-tracker-h166ysxm'