2024-11-03T22:29:28,574 Created temporary directory: /tmp/pip-build-tracker-7gv5cad3 2024-11-03T22:29:28,575 Initialized build tracking at /tmp/pip-build-tracker-7gv5cad3 2024-11-03T22:29:28,576 Created build tracker: /tmp/pip-build-tracker-7gv5cad3 2024-11-03T22:29:28,576 Entered build tracker: /tmp/pip-build-tracker-7gv5cad3 2024-11-03T22:29:28,577 Created temporary directory: /tmp/pip-wheel-vptgy0bd 2024-11-03T22:29:28,581 Created temporary directory: /tmp/pip-ephem-wheel-cache-0qwspur2 2024-11-03T22:29:28,625 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-11-03T22:29:28,628 2 location(s) to search for versions of verl: 2024-11-03T22:29:28,628 * https://pypi.org/simple/verl/ 2024-11-03T22:29:28,628 * https://www.piwheels.org/simple/verl/ 2024-11-03T22:29:28,629 Fetching project page and analyzing links: https://pypi.org/simple/verl/ 2024-11-03T22:29:28,630 Getting page https://pypi.org/simple/verl/ 2024-11-03T22:29:28,631 Found index url https://pypi.org/simple/ 2024-11-03T22:29:28,854 Fetched page https://pypi.org/simple/verl/ as application/vnd.pypi.simple.v1+json 2024-11-03T22:29:28,855 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/9f/86/496edb88346dafe6a0476247aae75f6ec1662af25c077d03026dc7cd9edf/verl-0.1rc0-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-11-03T22:29:28,856 Found link https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz (from https://pypi.org/simple/verl/), version: 0.1rc0 2024-11-03T22:29:28,857 Fetching project page and analyzing links: https://www.piwheels.org/simple/verl/ 2024-11-03T22:29:28,857 Getting page https://www.piwheels.org/simple/verl/ 2024-11-03T22:29:28,859 Found index url https://www.piwheels.org/simple/ 2024-11-03T22:29:29,021 Fetched page https://www.piwheels.org/simple/verl/ as text/html 2024-11-03T22:29:29,023 Skipping link: not a file: https://www.piwheels.org/simple/verl/ 2024-11-03T22:29:29,023 Skipping link: not a file: https://pypi.org/simple/verl/ 2024-11-03T22:29:29,041 Given no hashes to check 1 links for project 'verl': discarding no candidates 2024-11-03T22:29:29,042 Collecting verl==0.1rc0 2024-11-03T22:29:29,045 Created temporary directory: /tmp/pip-unpack-omqz6ss3 2024-11-03T22:29:29,264 Downloading verl-0.1rc0.tar.gz (222 kB) 2024-11-03T22:29:29,680 Added verl==0.1rc0 from https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz to build tracker '/tmp/pip-build-tracker-7gv5cad3' 2024-11-03T22:29:29,682 Running setup.py (path:/tmp/pip-wheel-vptgy0bd/verl_eeab50bb7bb6472f9251135f680e2b5b/setup.py) egg_info for package verl 2024-11-03T22:29:29,683 Created temporary directory: /tmp/pip-pip-egg-info-9fp76zrp 2024-11-03T22:29:29,684 Preparing metadata (setup.py): started 2024-11-03T22:29:29,685 Running command python setup.py egg_info 2024-11-03T22:29:30,715 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:337: InformationOnly: Normalizing '0.1.pre' to '0.1rc0' 2024-11-03T22:29:30,715 self.metadata.version = self._normalize_version(self.metadata.version) 2024-11-03T22:29:30,750 running egg_info 2024-11-03T22:29:30,777 creating /tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info 2024-11-03T22:29:30,778 writing /tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/PKG-INFO 2024-11-03T22:29:30,783 writing dependency_links to /tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/dependency_links.txt 2024-11-03T22:29:30,786 writing requirements to /tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/requires.txt 2024-11-03T22:29:30,787 writing top-level names to /tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/top_level.txt 2024-11-03T22:29:30,788 writing manifest file '/tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/SOURCES.txt' 2024-11-03T22:29:30,931 reading manifest file '/tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/SOURCES.txt' 2024-11-03T22:29:30,932 adding license file 'LICENSE' 2024-11-03T22:29:30,940 writing manifest file '/tmp/pip-pip-egg-info-9fp76zrp/verl.egg-info/SOURCES.txt' 2024-11-03T22:29:31,049 Preparing metadata (setup.py): finished with status 'done' 2024-11-03T22:29:31,053 Source in /tmp/pip-wheel-vptgy0bd/verl_eeab50bb7bb6472f9251135f680e2b5b has version 0.1rc0, which satisfies requirement verl==0.1rc0 from https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz 2024-11-03T22:29:31,054 Removed verl==0.1rc0 from https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz from build tracker '/tmp/pip-build-tracker-7gv5cad3' 2024-11-03T22:29:31,062 Created temporary directory: /tmp/pip-unpack-kxksj55h 2024-11-03T22:29:31,063 Created temporary directory: /tmp/pip-unpack-l4ubmq_3 2024-11-03T22:29:31,063 Building wheels for collected packages: verl 2024-11-03T22:29:31,067 Created temporary directory: /tmp/pip-wheel-zj86tj9c 2024-11-03T22:29:31,068 Building wheel for verl (setup.py): started 2024-11-03T22:29:31,069 Destination directory: /tmp/pip-wheel-zj86tj9c 2024-11-03T22:29:31,069 Running command python setup.py bdist_wheel 2024-11-03T22:29:32,071 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:337: InformationOnly: Normalizing '0.1.pre' to '0.1rc0' 2024-11-03T22:29:32,072 self.metadata.version = self._normalize_version(self.metadata.version) 2024-11-03T22:29:32,080 running bdist_wheel 2024-11-03T22:29:32,212 running build 2024-11-03T22:29:32,213 running build_py 2024-11-03T22:29:32,243 creating build/lib/single_controller 2024-11-03T22:29:32,245 copying ./single_controller/__init__.py -> build/lib/single_controller 2024-11-03T22:29:32,248 creating build/lib/verl 2024-11-03T22:29:32,249 copying ./verl/protocol.py -> build/lib/verl 2024-11-03T22:29:32,252 copying ./verl/__init__.py -> build/lib/verl 2024-11-03T22:29:32,255 creating build/lib/single_controller/ray 2024-11-03T22:29:32,256 copying ./single_controller/ray/base.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,260 copying ./single_controller/ray/megatron.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,264 copying ./single_controller/ray/dp.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,265 copying ./single_controller/ray/dist_data_pass_protocol.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,267 copying ./single_controller/ray/decorator.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,269 copying ./single_controller/ray/__init__.py -> build/lib/single_controller/ray 2024-11-03T22:29:32,271 creating build/lib/single_controller/base 2024-11-03T22:29:32,273 copying ./single_controller/base/dp.py -> build/lib/single_controller/base 2024-11-03T22:29:32,275 copying ./single_controller/base/worker_group.py -> build/lib/single_controller/base 2024-11-03T22:29:32,277 copying ./single_controller/base/decorator.py -> build/lib/single_controller/base 2024-11-03T22:29:32,280 copying ./single_controller/base/worker.py -> build/lib/single_controller/base 2024-11-03T22:29:32,282 copying ./single_controller/base/__init__.py -> build/lib/single_controller/base 2024-11-03T22:29:32,284 creating build/lib/single_controller/base/register_center 2024-11-03T22:29:32,286 copying ./single_controller/base/register_center/ray.py -> build/lib/single_controller/base/register_center 2024-11-03T22:29:32,287 copying ./single_controller/base/register_center/__init__.py -> build/lib/single_controller/base/register_center 2024-11-03T22:29:32,290 creating build/lib/single_controller/base/megatron 2024-11-03T22:29:32,291 copying ./single_controller/base/megatron/worker_group.py -> build/lib/single_controller/base/megatron 2024-11-03T22:29:32,294 copying ./single_controller/base/megatron/worker.py -> build/lib/single_controller/base/megatron 2024-11-03T22:29:32,296 copying ./single_controller/base/megatron/__init__.py -> build/lib/single_controller/base/megatron 2024-11-03T22:29:32,299 creating build/lib/verl/third_party 2024-11-03T22:29:32,300 copying ./verl/third_party/__init__.py -> build/lib/verl/third_party 2024-11-03T22:29:32,303 creating build/lib/verl/utils 2024-11-03T22:29:32,304 copying ./verl/utils/logging_utils.py -> build/lib/verl/utils 2024-11-03T22:29:32,306 copying ./verl/utils/import_utils.py -> build/lib/verl/utils 2024-11-03T22:29:32,308 copying ./verl/utils/py_functional.py -> build/lib/verl/utils 2024-11-03T22:29:32,310 copying ./verl/utils/model.py -> build/lib/verl/utils 2024-11-03T22:29:32,313 copying ./verl/utils/tracking.py -> build/lib/verl/utils 2024-11-03T22:29:32,316 copying ./verl/utils/torch_dtypes.py -> build/lib/verl/utils 2024-11-03T22:29:32,319 copying ./verl/utils/fs.py -> build/lib/verl/utils 2024-11-03T22:29:32,320 copying ./verl/utils/megatron_utils.py -> build/lib/verl/utils 2024-11-03T22:29:32,323 copying ./verl/utils/memory_buffer.py -> build/lib/verl/utils 2024-11-03T22:29:32,325 copying ./verl/utils/hdfs_io.py -> build/lib/verl/utils 2024-11-03T22:29:32,328 copying ./verl/utils/config.py -> build/lib/verl/utils 2024-11-03T22:29:32,330 copying ./verl/utils/distributed.py -> build/lib/verl/utils 2024-11-03T22:29:32,331 copying ./verl/utils/fsdp_utils.py -> build/lib/verl/utils 2024-11-03T22:29:32,334 copying ./verl/utils/ray_utils.py -> build/lib/verl/utils 2024-11-03T22:29:32,336 copying ./verl/utils/__init__.py -> build/lib/verl/utils 2024-11-03T22:29:32,338 copying ./verl/utils/torch_functional.py -> build/lib/verl/utils 2024-11-03T22:29:32,341 creating build/lib/verl/models 2024-11-03T22:29:32,343 copying ./verl/models/weight_loader_registry.py -> build/lib/verl/models 2024-11-03T22:29:32,345 copying ./verl/models/__init__.py -> build/lib/verl/models 2024-11-03T22:29:32,347 copying ./verl/models/registry.py -> build/lib/verl/models 2024-11-03T22:29:32,350 creating build/lib/verl/trainer 2024-11-03T22:29:32,351 copying ./verl/trainer/main_generation.py -> build/lib/verl/trainer 2024-11-03T22:29:32,354 copying ./verl/trainer/fsdp_sft_trainer.py -> build/lib/verl/trainer 2024-11-03T22:29:32,357 copying ./verl/trainer/main_eval.py -> build/lib/verl/trainer 2024-11-03T22:29:32,359 copying ./verl/trainer/main_ppo.py -> build/lib/verl/trainer 2024-11-03T22:29:32,361 copying ./verl/trainer/__init__.py -> build/lib/verl/trainer 2024-11-03T22:29:32,363 creating build/lib/verl/third_party/vllm 2024-11-03T22:29:32,365 copying ./verl/third_party/vllm/__init__.py -> build/lib/verl/third_party/vllm 2024-11-03T22:29:32,367 creating build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,369 copying ./verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,371 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,375 copying ./verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,379 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,383 copying ./verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,386 copying ./verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,388 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,390 copying ./verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,394 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,396 copying ./verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,399 copying ./verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,402 copying ./verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,405 copying ./verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,409 copying ./verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:32,412 creating build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,413 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,417 copying ./verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,419 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,422 copying ./verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,424 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,427 copying ./verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,430 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,433 copying ./verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,437 copying ./verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,440 copying ./verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,443 copying ./verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:32,448 creating build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,450 copying ./verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,453 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,456 copying ./verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,458 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,462 copying ./verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,464 copying ./verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,467 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,469 copying ./verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,472 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,475 copying ./verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,478 copying ./verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,483 copying ./verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,487 copying ./verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,489 copying ./verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:32,492 creating build/lib/verl/utils/logger 2024-11-03T22:29:32,494 copying ./verl/utils/logger/__init__.py -> build/lib/verl/utils/logger 2024-11-03T22:29:32,496 copying ./verl/utils/logger/aggregate_logger.py -> build/lib/verl/utils/logger 2024-11-03T22:29:32,498 creating build/lib/verl/utils/reward_score 2024-11-03T22:29:32,500 copying ./verl/utils/reward_score/__init__.py -> build/lib/verl/utils/reward_score 2024-11-03T22:29:32,502 copying ./verl/utils/reward_score/gsm8k.py -> build/lib/verl/utils/reward_score 2024-11-03T22:29:32,503 copying ./verl/utils/reward_score/math.py -> build/lib/verl/utils/reward_score 2024-11-03T22:29:32,506 creating build/lib/verl/utils/rendezvous 2024-11-03T22:29:32,507 copying ./verl/utils/rendezvous/ray_backend.py -> build/lib/verl/utils/rendezvous 2024-11-03T22:29:32,510 copying ./verl/utils/rendezvous/__init__.py -> build/lib/verl/utils/rendezvous 2024-11-03T22:29:32,512 creating build/lib/verl/utils/dataset 2024-11-03T22:29:32,513 copying ./verl/utils/dataset/rl_dataset.py -> build/lib/verl/utils/dataset 2024-11-03T22:29:32,516 copying ./verl/utils/dataset/sft_dataset.py -> build/lib/verl/utils/dataset 2024-11-03T22:29:32,518 copying ./verl/utils/dataset/rm_dataset.py -> build/lib/verl/utils/dataset 2024-11-03T22:29:32,520 copying ./verl/utils/dataset/__init__.py -> build/lib/verl/utils/dataset 2024-11-03T22:29:32,523 creating build/lib/verl/utils/megatron 2024-11-03T22:29:32,524 copying ./verl/utils/megatron/pipeline_parallel.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,526 copying ./verl/utils/megatron/sequence_parallel.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,528 copying ./verl/utils/megatron/memory.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,530 copying ./verl/utils/megatron/optimizer_config.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,531 copying ./verl/utils/megatron/tensor_parallel.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,534 copying ./verl/utils/megatron/__init__.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,536 copying ./verl/utils/megatron/optimizer.py -> build/lib/verl/utils/megatron 2024-11-03T22:29:32,539 creating build/lib/verl/utils/debug 2024-11-03T22:29:32,540 copying ./verl/utils/debug/performance.py -> build/lib/verl/utils/debug 2024-11-03T22:29:32,542 copying ./verl/utils/debug/trajectory_tracker.py -> build/lib/verl/utils/debug 2024-11-03T22:29:32,544 copying ./verl/utils/debug/__init__.py -> build/lib/verl/utils/debug 2024-11-03T22:29:32,547 creating build/lib/verl/models/llama 2024-11-03T22:29:32,548 copying ./verl/models/llama/__init__.py -> build/lib/verl/models/llama 2024-11-03T22:29:32,550 creating build/lib/verl/models/llama/megatron 2024-11-03T22:29:32,552 copying ./verl/models/llama/megatron/modeling_llama_megatron.py -> build/lib/verl/models/llama/megatron 2024-11-03T22:29:32,555 copying ./verl/models/llama/megatron/__init__.py -> build/lib/verl/models/llama/megatron 2024-11-03T22:29:32,557 creating build/lib/verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:32,558 copying ./verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:32,561 copying ./verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:32,563 copying ./verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:32,566 creating build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,567 copying ./verl/models/llama/megatron/layers/parallel_mlp.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,570 copying ./verl/models/llama/megatron/layers/parallel_linear.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,572 copying ./verl/models/llama/megatron/layers/parallel_attention.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,575 copying ./verl/models/llama/megatron/layers/parallel_decoder.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,577 copying ./verl/models/llama/megatron/layers/__init__.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,579 copying ./verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/lib/verl/models/llama/megatron/layers 2024-11-03T22:29:32,582 creating build/lib/verl/trainer/ppo 2024-11-03T22:29:32,583 copying ./verl/trainer/ppo/core_algos.py -> build/lib/verl/trainer/ppo 2024-11-03T22:29:32,585 copying ./verl/trainer/ppo/ray_trainer.py -> build/lib/verl/trainer/ppo 2024-11-03T22:29:32,588 copying ./verl/trainer/ppo/__init__.py -> build/lib/verl/trainer/ppo 2024-11-03T22:29:32,590 creating build/lib/verl/trainer/ppo/rollout 2024-11-03T22:29:32,592 copying ./verl/trainer/ppo/rollout/base.py -> build/lib/verl/trainer/ppo/rollout 2024-11-03T22:29:32,594 copying ./verl/trainer/ppo/rollout/hf_rollout.py -> build/lib/verl/trainer/ppo/rollout 2024-11-03T22:29:32,596 copying ./verl/trainer/ppo/rollout/tokenizer.py -> build/lib/verl/trainer/ppo/rollout 2024-11-03T22:29:32,598 copying ./verl/trainer/ppo/rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout 2024-11-03T22:29:32,601 creating build/lib/verl/trainer/ppo/workers 2024-11-03T22:29:32,602 copying ./verl/trainer/ppo/workers/fsdp_workers.py -> build/lib/verl/trainer/ppo/workers 2024-11-03T22:29:32,605 copying ./verl/trainer/ppo/workers/megatron_workers.py -> build/lib/verl/trainer/ppo/workers 2024-11-03T22:29:32,608 copying ./verl/trainer/ppo/workers/__init__.py -> build/lib/verl/trainer/ppo/workers 2024-11-03T22:29:32,610 creating build/lib/verl/trainer/ppo/actor 2024-11-03T22:29:32,611 copying ./verl/trainer/ppo/actor/base.py -> build/lib/verl/trainer/ppo/actor 2024-11-03T22:29:32,614 copying ./verl/trainer/ppo/actor/dp_actor.py -> build/lib/verl/trainer/ppo/actor 2024-11-03T22:29:32,616 copying ./verl/trainer/ppo/actor/megatron_actor.py -> build/lib/verl/trainer/ppo/actor 2024-11-03T22:29:32,619 copying ./verl/trainer/ppo/actor/__init__.py -> build/lib/verl/trainer/ppo/actor 2024-11-03T22:29:32,621 creating build/lib/verl/trainer/ppo/critic 2024-11-03T22:29:32,622 copying ./verl/trainer/ppo/critic/dp_critic.py -> build/lib/verl/trainer/ppo/critic 2024-11-03T22:29:32,625 copying ./verl/trainer/ppo/critic/base.py -> build/lib/verl/trainer/ppo/critic 2024-11-03T22:29:32,627 copying ./verl/trainer/ppo/critic/__init__.py -> build/lib/verl/trainer/ppo/critic 2024-11-03T22:29:32,629 copying ./verl/trainer/ppo/critic/megatron_critic.py -> build/lib/verl/trainer/ppo/critic 2024-11-03T22:29:32,632 creating build/lib/verl/trainer/ppo/reward_model 2024-11-03T22:29:32,634 copying ./verl/trainer/ppo/reward_model/base.py -> build/lib/verl/trainer/ppo/reward_model 2024-11-03T22:29:32,635 copying ./verl/trainer/ppo/reward_model/__init__.py -> build/lib/verl/trainer/ppo/reward_model 2024-11-03T22:29:32,638 creating build/lib/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:32,639 copying ./verl/trainer/ppo/hybrid_engine/base.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:32,642 copying ./verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:32,644 copying ./verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:32,647 copying ./verl/trainer/ppo/hybrid_engine/__init__.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:32,649 creating build/lib/verl/trainer/ppo/rollout/naive 2024-11-03T22:29:32,650 copying ./verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-11-03T22:29:32,653 copying ./verl/trainer/ppo/rollout/naive/__init__.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-11-03T22:29:32,655 creating build/lib/verl/trainer/ppo/rollout/megatron 2024-11-03T22:29:32,656 copying ./verl/trainer/ppo/rollout/megatron/__init__.py -> build/lib/verl/trainer/ppo/rollout/megatron 2024-11-03T22:29:32,659 creating build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:32,660 copying ./verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:32,663 copying ./verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:32,665 creating build/lib/verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:32,666 copying ./verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:32,669 copying ./verl/trainer/ppo/reward_model/megatron/__init__.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:32,671 running egg_info 2024-11-03T22:29:32,700 writing verl.egg-info/PKG-INFO 2024-11-03T22:29:32,706 writing dependency_links to verl.egg-info/dependency_links.txt 2024-11-03T22:29:32,708 writing requirements to verl.egg-info/requires.txt 2024-11-03T22:29:32,710 writing top-level names to verl.egg-info/top_level.txt 2024-11-03T22:29:32,779 reading manifest file 'verl.egg-info/SOURCES.txt' 2024-11-03T22:29:32,799 adding license file 'LICENSE' 2024-11-03T22:29:32,813 writing manifest file 'verl.egg-info/SOURCES.txt' 2024-11-03T22:29:32,816 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'single_controller.version' is absent from the `packages` configuration. 2024-11-03T22:29:32,816 !! 2024-11-03T22:29:32,817 ******************************************************************************** 2024-11-03T22:29:32,818 ############################ 2024-11-03T22:29:32,818 # Package would be ignored # 2024-11-03T22:29:32,819 ############################ 2024-11-03T22:29:32,819 Python recognizes 'single_controller.version' as an importable package[^1], 2024-11-03T22:29:32,820 but it is absent from setuptools' `packages` configuration. 2024-11-03T22:29:32,821 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-03T22:29:32,821 package, please make sure that 'single_controller.version' is explicitly added 2024-11-03T22:29:32,822 to the `packages` configuration field. 2024-11-03T22:29:32,823 Alternatively, you can also rely on setuptools' discovery methods 2024-11-03T22:29:32,823 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-03T22:29:32,824 instead of `find_packages(...)`/`find:`). 2024-11-03T22:29:32,825 You can read more about "package discovery" on setuptools documentation page: 2024-11-03T22:29:32,826 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-03T22:29:32,827 If you don't want 'single_controller.version' to be distributed and are 2024-11-03T22:29:32,828 already explicitly excluding 'single_controller.version' via 2024-11-03T22:29:32,828 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-03T22:29:32,836 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-03T22:29:32,837 combination with a more fine grained `package-data` configuration. 2024-11-03T22:29:32,838 You can read more about "package data files" on setuptools documentation page: 2024-11-03T22:29:32,839 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-03T22:29:32,841 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-03T22:29:32,842 even if it does not contain any `.py` files. 2024-11-03T22:29:32,842 On the other hand, currently there is no concept of package data 2024-11-03T22:29:32,843 directory, all directories are treated like packages. 2024-11-03T22:29:32,843 ******************************************************************************** 2024-11-03T22:29:32,844 !! 2024-11-03T22:29:32,845 check.warn(importable) 2024-11-03T22:29:32,846 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.trainer.config' is absent from the `packages` configuration. 2024-11-03T22:29:32,846 !! 2024-11-03T22:29:32,848 ******************************************************************************** 2024-11-03T22:29:32,848 ############################ 2024-11-03T22:29:32,849 # Package would be ignored # 2024-11-03T22:29:32,849 ############################ 2024-11-03T22:29:32,849 Python recognizes 'verl.trainer.config' as an importable package[^1], 2024-11-03T22:29:32,850 but it is absent from setuptools' `packages` configuration. 2024-11-03T22:29:32,851 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-03T22:29:32,851 package, please make sure that 'verl.trainer.config' is explicitly added 2024-11-03T22:29:32,852 to the `packages` configuration field. 2024-11-03T22:29:32,853 Alternatively, you can also rely on setuptools' discovery methods 2024-11-03T22:29:32,853 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-03T22:29:32,854 instead of `find_packages(...)`/`find:`). 2024-11-03T22:29:32,855 You can read more about "package discovery" on setuptools documentation page: 2024-11-03T22:29:32,856 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-03T22:29:32,857 If you don't want 'verl.trainer.config' to be distributed and are 2024-11-03T22:29:32,857 already explicitly excluding 'verl.trainer.config' via 2024-11-03T22:29:32,858 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-03T22:29:32,858 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-03T22:29:32,859 combination with a more fine grained `package-data` configuration. 2024-11-03T22:29:32,860 You can read more about "package data files" on setuptools documentation page: 2024-11-03T22:29:32,860 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-03T22:29:32,862 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-03T22:29:32,863 even if it does not contain any `.py` files. 2024-11-03T22:29:32,863 On the other hand, currently there is no concept of package data 2024-11-03T22:29:32,864 directory, all directories are treated like packages. 2024-11-03T22:29:32,864 ******************************************************************************** 2024-11-03T22:29:32,865 !! 2024-11-03T22:29:32,866 check.warn(importable) 2024-11-03T22:29:32,866 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.version' is absent from the `packages` configuration. 2024-11-03T22:29:32,867 !! 2024-11-03T22:29:32,868 ******************************************************************************** 2024-11-03T22:29:32,868 ############################ 2024-11-03T22:29:32,869 # Package would be ignored # 2024-11-03T22:29:32,869 ############################ 2024-11-03T22:29:32,870 Python recognizes 'verl.version' as an importable package[^1], 2024-11-03T22:29:32,870 but it is absent from setuptools' `packages` configuration. 2024-11-03T22:29:32,871 This leads to an ambiguous overall configuration. If you want to distribute this 2024-11-03T22:29:32,872 package, please make sure that 'verl.version' is explicitly added 2024-11-03T22:29:32,872 to the `packages` configuration field. 2024-11-03T22:29:32,874 Alternatively, you can also rely on setuptools' discovery methods 2024-11-03T22:29:32,874 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-11-03T22:29:32,875 instead of `find_packages(...)`/`find:`). 2024-11-03T22:29:32,876 You can read more about "package discovery" on setuptools documentation page: 2024-11-03T22:29:32,877 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-11-03T22:29:32,878 If you don't want 'verl.version' to be distributed and are 2024-11-03T22:29:32,879 already explicitly excluding 'verl.version' via 2024-11-03T22:29:32,879 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-11-03T22:29:32,879 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-11-03T22:29:32,880 combination with a more fine grained `package-data` configuration. 2024-11-03T22:29:32,881 You can read more about "package data files" on setuptools documentation page: 2024-11-03T22:29:32,881 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-11-03T22:29:32,883 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-11-03T22:29:32,883 even if it does not contain any `.py` files. 2024-11-03T22:29:32,884 On the other hand, currently there is no concept of package data 2024-11-03T22:29:32,884 directory, all directories are treated like packages. 2024-11-03T22:29:32,885 ******************************************************************************** 2024-11-03T22:29:32,886 !! 2024-11-03T22:29:32,886 check.warn(importable) 2024-11-03T22:29:32,887 creating build/lib/single_controller/version 2024-11-03T22:29:32,887 copying ./single_controller/version/version -> build/lib/single_controller/version 2024-11-03T22:29:32,888 creating build/lib/verl/version 2024-11-03T22:29:32,888 copying ./verl/version/version -> build/lib/verl/version 2024-11-03T22:29:32,889 creating build/lib/verl/trainer/config 2024-11-03T22:29:32,890 copying ./verl/trainer/config/ppo_trainer.yaml -> build/lib/verl/trainer/config 2024-11-03T22:29:32,890 copying ./verl/trainer/config/generation.yaml -> build/lib/verl/trainer/config 2024-11-03T22:29:32,891 copying ./verl/trainer/config/sft_trainer.yaml -> build/lib/verl/trainer/config 2024-11-03T22:29:32,891 copying ./verl/trainer/config/evaluation.yaml -> build/lib/verl/trainer/config 2024-11-03T22:29:32,892 copying ./verl/trainer/config/ppo_megatron_trainer.yaml -> build/lib/verl/trainer/config 2024-11-03T22:29:32,936 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-11-03T22:29:32,936 !! 2024-11-03T22:29:32,938 ******************************************************************************** 2024-11-03T22:29:32,938 Please avoid running ``setup.py`` directly. 2024-11-03T22:29:32,939 Instead, use pypa/build, pypa/installer or other 2024-11-03T22:29:32,939 standards-based tools. 2024-11-03T22:29:32,940 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-11-03T22:29:32,941 ******************************************************************************** 2024-11-03T22:29:32,942 !! 2024-11-03T22:29:32,943 self.initialize_options() 2024-11-03T22:29:32,964 installing to build/bdist.linux-armv7l/wheel 2024-11-03T22:29:32,965 running install 2024-11-03T22:29:32,990 running install_lib 2024-11-03T22:29:33,018 creating build/bdist.linux-armv7l/wheel 2024-11-03T22:29:33,020 creating build/bdist.linux-armv7l/wheel/single_controller 2024-11-03T22:29:33,021 creating build/bdist.linux-armv7l/wheel/single_controller/ray 2024-11-03T22:29:33,023 copying build/lib/single_controller/ray/base.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,026 copying build/lib/single_controller/ray/megatron.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,028 copying build/lib/single_controller/ray/dp.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,030 copying build/lib/single_controller/ray/dist_data_pass_protocol.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,032 copying build/lib/single_controller/ray/decorator.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,035 copying build/lib/single_controller/ray/__init__.py -> build/bdist.linux-armv7l/wheel/./single_controller/ray 2024-11-03T22:29:33,037 creating build/bdist.linux-armv7l/wheel/single_controller/version 2024-11-03T22:29:33,039 copying build/lib/single_controller/version/version -> build/bdist.linux-armv7l/wheel/./single_controller/version 2024-11-03T22:29:33,041 copying build/lib/single_controller/__init__.py -> build/bdist.linux-armv7l/wheel/./single_controller 2024-11-03T22:29:33,043 creating build/bdist.linux-armv7l/wheel/single_controller/base 2024-11-03T22:29:33,045 copying build/lib/single_controller/base/dp.py -> build/bdist.linux-armv7l/wheel/./single_controller/base 2024-11-03T22:29:33,047 copying build/lib/single_controller/base/worker_group.py -> build/bdist.linux-armv7l/wheel/./single_controller/base 2024-11-03T22:29:33,049 copying build/lib/single_controller/base/decorator.py -> build/bdist.linux-armv7l/wheel/./single_controller/base 2024-11-03T22:29:33,052 creating build/bdist.linux-armv7l/wheel/single_controller/base/register_center 2024-11-03T22:29:33,053 copying build/lib/single_controller/base/register_center/ray.py -> build/bdist.linux-armv7l/wheel/./single_controller/base/register_center 2024-11-03T22:29:33,055 copying build/lib/single_controller/base/register_center/__init__.py -> build/bdist.linux-armv7l/wheel/./single_controller/base/register_center 2024-11-03T22:29:33,057 copying build/lib/single_controller/base/worker.py -> build/bdist.linux-armv7l/wheel/./single_controller/base 2024-11-03T22:29:33,060 creating build/bdist.linux-armv7l/wheel/single_controller/base/megatron 2024-11-03T22:29:33,061 copying build/lib/single_controller/base/megatron/worker_group.py -> build/bdist.linux-armv7l/wheel/./single_controller/base/megatron 2024-11-03T22:29:33,063 copying build/lib/single_controller/base/megatron/worker.py -> build/bdist.linux-armv7l/wheel/./single_controller/base/megatron 2024-11-03T22:29:33,066 copying build/lib/single_controller/base/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./single_controller/base/megatron 2024-11-03T22:29:33,067 copying build/lib/single_controller/base/__init__.py -> build/bdist.linux-armv7l/wheel/./single_controller/base 2024-11-03T22:29:33,070 creating build/bdist.linux-armv7l/wheel/verl 2024-11-03T22:29:33,072 creating build/bdist.linux-armv7l/wheel/verl/third_party 2024-11-03T22:29:33,074 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm 2024-11-03T22:29:33,076 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,078 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,080 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,083 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,086 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,088 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,091 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,093 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,096 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,098 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,101 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,103 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,106 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,108 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,111 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-11-03T22:29:33,114 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,116 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,121 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,123 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,126 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,128 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,130 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,133 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,135 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,138 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,141 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,142 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-11-03T22:29:33,145 copying build/lib/verl/third_party/vllm/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm 2024-11-03T22:29:33,147 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,148 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,150 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,153 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,156 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,158 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,161 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,163 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,165 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,168 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,170 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,173 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,176 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,179 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,183 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-11-03T22:29:33,185 copying build/lib/verl/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party 2024-11-03T22:29:33,188 creating build/bdist.linux-armv7l/wheel/verl/utils 2024-11-03T22:29:33,189 copying build/lib/verl/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,191 copying build/lib/verl/utils/import_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,193 copying build/lib/verl/utils/py_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,195 creating build/bdist.linux-armv7l/wheel/verl/utils/logger 2024-11-03T22:29:33,196 copying build/lib/verl/utils/logger/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-11-03T22:29:33,198 copying build/lib/verl/utils/logger/aggregate_logger.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-11-03T22:29:33,200 copying build/lib/verl/utils/model.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,203 creating build/bdist.linux-armv7l/wheel/verl/utils/reward_score 2024-11-03T22:29:33,204 copying build/lib/verl/utils/reward_score/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-11-03T22:29:33,206 copying build/lib/verl/utils/reward_score/gsm8k.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-11-03T22:29:33,208 copying build/lib/verl/utils/reward_score/math.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-11-03T22:29:33,211 creating build/bdist.linux-armv7l/wheel/verl/utils/rendezvous 2024-11-03T22:29:33,212 copying build/lib/verl/utils/rendezvous/ray_backend.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-11-03T22:29:33,214 copying build/lib/verl/utils/rendezvous/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-11-03T22:29:33,216 copying build/lib/verl/utils/tracking.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,218 copying build/lib/verl/utils/torch_dtypes.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,220 copying build/lib/verl/utils/fs.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,222 copying build/lib/verl/utils/megatron_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,225 copying build/lib/verl/utils/memory_buffer.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,227 creating build/bdist.linux-armv7l/wheel/verl/utils/dataset 2024-11-03T22:29:33,228 copying build/lib/verl/utils/dataset/rl_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-11-03T22:29:33,231 copying build/lib/verl/utils/dataset/sft_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-11-03T22:29:33,233 copying build/lib/verl/utils/dataset/rm_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-11-03T22:29:33,235 copying build/lib/verl/utils/dataset/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-11-03T22:29:33,237 copying build/lib/verl/utils/hdfs_io.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,240 creating build/bdist.linux-armv7l/wheel/verl/utils/megatron 2024-11-03T22:29:33,241 copying build/lib/verl/utils/megatron/pipeline_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,243 copying build/lib/verl/utils/megatron/sequence_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,245 copying build/lib/verl/utils/megatron/memory.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,247 copying build/lib/verl/utils/megatron/optimizer_config.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,249 copying build/lib/verl/utils/megatron/tensor_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,251 copying build/lib/verl/utils/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,253 copying build/lib/verl/utils/megatron/optimizer.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-11-03T22:29:33,255 copying build/lib/verl/utils/config.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,256 copying build/lib/verl/utils/distributed.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,259 creating build/bdist.linux-armv7l/wheel/verl/utils/debug 2024-11-03T22:29:33,260 copying build/lib/verl/utils/debug/performance.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-11-03T22:29:33,262 copying build/lib/verl/utils/debug/trajectory_tracker.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-11-03T22:29:33,264 copying build/lib/verl/utils/debug/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-11-03T22:29:33,266 copying build/lib/verl/utils/fsdp_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,268 copying build/lib/verl/utils/ray_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,270 copying build/lib/verl/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,272 copying build/lib/verl/utils/torch_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-11-03T22:29:33,275 creating build/bdist.linux-armv7l/wheel/verl/version 2024-11-03T22:29:33,276 copying build/lib/verl/version/version -> build/bdist.linux-armv7l/wheel/./verl/version 2024-11-03T22:29:33,279 creating build/bdist.linux-armv7l/wheel/verl/models 2024-11-03T22:29:33,280 copying build/lib/verl/models/weight_loader_registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-11-03T22:29:33,283 creating build/bdist.linux-armv7l/wheel/verl/models/llama 2024-11-03T22:29:33,285 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron 2024-11-03T22:29:33,287 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:33,289 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:33,293 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:33,296 copying build/lib/verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-11-03T22:29:33,299 copying build/lib/verl/models/llama/megatron/modeling_llama_megatron.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-11-03T22:29:33,303 copying build/lib/verl/models/llama/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-11-03T22:29:33,306 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/layers 2024-11-03T22:29:33,307 copying build/lib/verl/models/llama/megatron/layers/parallel_mlp.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,309 copying build/lib/verl/models/llama/megatron/layers/parallel_linear.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,311 copying build/lib/verl/models/llama/megatron/layers/parallel_attention.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,314 copying build/lib/verl/models/llama/megatron/layers/parallel_decoder.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,316 copying build/lib/verl/models/llama/megatron/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,318 copying build/lib/verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-11-03T22:29:33,320 copying build/lib/verl/models/llama/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama 2024-11-03T22:29:33,321 copying build/lib/verl/models/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-11-03T22:29:33,323 copying build/lib/verl/models/registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-11-03T22:29:33,325 copying build/lib/verl/protocol.py -> build/bdist.linux-armv7l/wheel/./verl 2024-11-03T22:29:33,328 creating build/bdist.linux-armv7l/wheel/verl/trainer 2024-11-03T22:29:33,329 copying build/lib/verl/trainer/main_generation.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-11-03T22:29:33,331 copying build/lib/verl/trainer/fsdp_sft_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-11-03T22:29:33,334 copying build/lib/verl/trainer/main_eval.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-11-03T22:29:33,336 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo 2024-11-03T22:29:33,338 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout 2024-11-03T22:29:33,340 copying build/lib/verl/trainer/ppo/rollout/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-11-03T22:29:33,342 copying build/lib/verl/trainer/ppo/rollout/hf_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-11-03T22:29:33,344 copying build/lib/verl/trainer/ppo/rollout/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-11-03T22:29:33,347 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/naive 2024-11-03T22:29:33,348 copying build/lib/verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-11-03T22:29:33,351 copying build/lib/verl/trainer/ppo/rollout/naive/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-11-03T22:29:33,353 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/megatron 2024-11-03T22:29:33,354 copying build/lib/verl/trainer/ppo/rollout/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/megatron 2024-11-03T22:29:33,357 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:33,358 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:33,361 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-11-03T22:29:33,363 copying build/lib/verl/trainer/ppo/rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-11-03T22:29:33,364 copying build/lib/verl/trainer/ppo/core_algos.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-11-03T22:29:33,367 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/workers 2024-11-03T22:29:33,369 copying build/lib/verl/trainer/ppo/workers/fsdp_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-11-03T22:29:33,372 copying build/lib/verl/trainer/ppo/workers/megatron_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-11-03T22:29:33,375 copying build/lib/verl/trainer/ppo/workers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-11-03T22:29:33,377 copying build/lib/verl/trainer/ppo/ray_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-11-03T22:29:33,380 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/actor 2024-11-03T22:29:33,381 copying build/lib/verl/trainer/ppo/actor/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-11-03T22:29:33,383 copying build/lib/verl/trainer/ppo/actor/dp_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-11-03T22:29:33,385 copying build/lib/verl/trainer/ppo/actor/megatron_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-11-03T22:29:33,388 copying build/lib/verl/trainer/ppo/actor/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-11-03T22:29:33,390 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/critic 2024-11-03T22:29:33,392 copying build/lib/verl/trainer/ppo/critic/dp_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-11-03T22:29:33,394 copying build/lib/verl/trainer/ppo/critic/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-11-03T22:29:33,396 copying build/lib/verl/trainer/ppo/critic/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-11-03T22:29:33,398 copying build/lib/verl/trainer/ppo/critic/megatron_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-11-03T22:29:33,401 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model 2024-11-03T22:29:33,402 copying build/lib/verl/trainer/ppo/reward_model/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-11-03T22:29:33,405 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:33,406 copying build/lib/verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:33,410 copying build/lib/verl/trainer/ppo/reward_model/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-11-03T22:29:33,412 copying build/lib/verl/trainer/ppo/reward_model/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-11-03T22:29:33,414 copying build/lib/verl/trainer/ppo/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-11-03T22:29:33,417 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:33,418 copying build/lib/verl/trainer/ppo/hybrid_engine/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:33,420 copying build/lib/verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:33,423 copying build/lib/verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:33,426 copying build/lib/verl/trainer/ppo/hybrid_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-11-03T22:29:33,429 creating build/bdist.linux-armv7l/wheel/verl/trainer/config 2024-11-03T22:29:33,430 copying build/lib/verl/trainer/config/ppo_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-11-03T22:29:33,432 copying build/lib/verl/trainer/config/generation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-11-03T22:29:33,434 copying build/lib/verl/trainer/config/sft_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-11-03T22:29:33,437 copying build/lib/verl/trainer/config/evaluation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-11-03T22:29:33,439 copying build/lib/verl/trainer/config/ppo_megatron_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-11-03T22:29:33,441 copying build/lib/verl/trainer/main_ppo.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-11-03T22:29:33,444 copying build/lib/verl/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-11-03T22:29:33,446 copying build/lib/verl/__init__.py -> build/bdist.linux-armv7l/wheel/./verl 2024-11-03T22:29:33,448 running install_egg_info 2024-11-03T22:29:33,482 Copying verl.egg-info to build/bdist.linux-armv7l/wheel/./verl-0.1rc0-py3.11.egg-info 2024-11-03T22:29:33,493 running install_scripts 2024-11-03T22:29:33,511 creating build/bdist.linux-armv7l/wheel/verl-0.1rc0.dist-info/WHEEL 2024-11-03T22:29:33,513 creating '/tmp/pip-wheel-zj86tj9c/verl-0.1rc0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-11-03T22:29:33,515 adding 'single_controller/__init__.py' 2024-11-03T22:29:33,517 adding 'single_controller/base/__init__.py' 2024-11-03T22:29:33,519 adding 'single_controller/base/decorator.py' 2024-11-03T22:29:33,520 adding 'single_controller/base/dp.py' 2024-11-03T22:29:33,522 adding 'single_controller/base/worker.py' 2024-11-03T22:29:33,524 adding 'single_controller/base/worker_group.py' 2024-11-03T22:29:33,526 adding 'single_controller/base/megatron/__init__.py' 2024-11-03T22:29:33,527 adding 'single_controller/base/megatron/worker.py' 2024-11-03T22:29:33,529 adding 'single_controller/base/megatron/worker_group.py' 2024-11-03T22:29:33,531 adding 'single_controller/base/register_center/__init__.py' 2024-11-03T22:29:33,532 adding 'single_controller/base/register_center/ray.py' 2024-11-03T22:29:33,534 adding 'single_controller/ray/__init__.py' 2024-11-03T22:29:33,537 adding 'single_controller/ray/base.py' 2024-11-03T22:29:33,538 adding 'single_controller/ray/decorator.py' 2024-11-03T22:29:33,539 adding 'single_controller/ray/dist_data_pass_protocol.py' 2024-11-03T22:29:33,541 adding 'single_controller/ray/dp.py' 2024-11-03T22:29:33,542 adding 'single_controller/ray/megatron.py' 2024-11-03T22:29:33,544 adding 'single_controller/version/version' 2024-11-03T22:29:33,545 adding 'verl/__init__.py' 2024-11-03T22:29:33,548 adding 'verl/protocol.py' 2024-11-03T22:29:33,550 adding 'verl/models/__init__.py' 2024-11-03T22:29:33,551 adding 'verl/models/registry.py' 2024-11-03T22:29:33,553 adding 'verl/models/weight_loader_registry.py' 2024-11-03T22:29:33,554 adding 'verl/models/llama/__init__.py' 2024-11-03T22:29:33,556 adding 'verl/models/llama/megatron/__init__.py' 2024-11-03T22:29:33,558 adding 'verl/models/llama/megatron/modeling_llama_megatron.py' 2024-11-03T22:29:33,560 adding 'verl/models/llama/megatron/checkpoint_utils/__init__.py' 2024-11-03T22:29:33,562 adding 'verl/models/llama/megatron/checkpoint_utils/llama_loader.py' 2024-11-03T22:29:33,565 adding 'verl/models/llama/megatron/checkpoint_utils/llama_saver.py' 2024-11-03T22:29:33,567 adding 'verl/models/llama/megatron/layers/__init__.py' 2024-11-03T22:29:33,569 adding 'verl/models/llama/megatron/layers/parallel_attention.py' 2024-11-03T22:29:33,571 adding 'verl/models/llama/megatron/layers/parallel_decoder.py' 2024-11-03T22:29:33,572 adding 'verl/models/llama/megatron/layers/parallel_linear.py' 2024-11-03T22:29:33,574 adding 'verl/models/llama/megatron/layers/parallel_mlp.py' 2024-11-03T22:29:33,575 adding 'verl/models/llama/megatron/layers/parallel_rmsnorm.py' 2024-11-03T22:29:33,577 adding 'verl/third_party/__init__.py' 2024-11-03T22:29:33,578 adding 'verl/third_party/vllm/__init__.py' 2024-11-03T22:29:33,580 adding 'verl/third_party/vllm/vllm_v_0_3_1/__init__.py' 2024-11-03T22:29:33,582 adding 'verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py' 2024-11-03T22:29:33,585 adding 'verl/third_party/vllm/vllm_v_0_3_1/config.py' 2024-11-03T22:29:33,588 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm.py' 2024-11-03T22:29:33,592 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py' 2024-11-03T22:29:33,594 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_loader.py' 2024-11-03T22:29:33,596 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_runner.py' 2024-11-03T22:29:33,598 adding 'verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py' 2024-11-03T22:29:33,599 adding 'verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py' 2024-11-03T22:29:33,600 adding 'verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py' 2024-11-03T22:29:33,603 adding 'verl/third_party/vllm/vllm_v_0_3_1/worker.py' 2024-11-03T22:29:33,605 adding 'verl/third_party/vllm/vllm_v_0_4_2/__init__.py' 2024-11-03T22:29:33,607 adding 'verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py' 2024-11-03T22:29:33,609 adding 'verl/third_party/vllm/vllm_v_0_4_2/config.py' 2024-11-03T22:29:33,610 adding 'verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py' 2024-11-03T22:29:33,612 adding 'verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py' 2024-11-03T22:29:33,614 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm.py' 2024-11-03T22:29:33,616 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py' 2024-11-03T22:29:33,618 adding 'verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py' 2024-11-03T22:29:33,620 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_loader.py' 2024-11-03T22:29:33,622 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_runner.py' 2024-11-03T22:29:33,624 adding 'verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py' 2024-11-03T22:29:33,626 adding 'verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py' 2024-11-03T22:29:33,627 adding 'verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py' 2024-11-03T22:29:33,629 adding 'verl/third_party/vllm/vllm_v_0_4_2/worker.py' 2024-11-03T22:29:33,631 adding 'verl/third_party/vllm/vllm_v_0_5_4/__init__.py' 2024-11-03T22:29:33,634 adding 'verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py' 2024-11-03T22:29:33,636 adding 'verl/third_party/vllm/vllm_v_0_5_4/config.py' 2024-11-03T22:29:33,638 adding 'verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py' 2024-11-03T22:29:33,640 adding 'verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py' 2024-11-03T22:29:33,642 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm.py' 2024-11-03T22:29:33,644 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py' 2024-11-03T22:29:33,646 adding 'verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py' 2024-11-03T22:29:33,648 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_loader.py' 2024-11-03T22:29:33,650 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_runner.py' 2024-11-03T22:29:33,652 adding 'verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py' 2024-11-03T22:29:33,654 adding 'verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py' 2024-11-03T22:29:33,655 adding 'verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py' 2024-11-03T22:29:33,657 adding 'verl/third_party/vllm/vllm_v_0_5_4/worker.py' 2024-11-03T22:29:33,659 adding 'verl/trainer/__init__.py' 2024-11-03T22:29:33,661 adding 'verl/trainer/fsdp_sft_trainer.py' 2024-11-03T22:29:33,663 adding 'verl/trainer/main_eval.py' 2024-11-03T22:29:33,664 adding 'verl/trainer/main_generation.py' 2024-11-03T22:29:33,666 adding 'verl/trainer/main_ppo.py' 2024-11-03T22:29:33,668 adding 'verl/trainer/config/evaluation.yaml' 2024-11-03T22:29:33,669 adding 'verl/trainer/config/generation.yaml' 2024-11-03T22:29:33,670 adding 'verl/trainer/config/ppo_megatron_trainer.yaml' 2024-11-03T22:29:33,672 adding 'verl/trainer/config/ppo_trainer.yaml' 2024-11-03T22:29:33,673 adding 'verl/trainer/config/sft_trainer.yaml' 2024-11-03T22:29:33,675 adding 'verl/trainer/ppo/__init__.py' 2024-11-03T22:29:33,677 adding 'verl/trainer/ppo/core_algos.py' 2024-11-03T22:29:33,679 adding 'verl/trainer/ppo/ray_trainer.py' 2024-11-03T22:29:33,681 adding 'verl/trainer/ppo/actor/__init__.py' 2024-11-03T22:29:33,683 adding 'verl/trainer/ppo/actor/base.py' 2024-11-03T22:29:33,684 adding 'verl/trainer/ppo/actor/dp_actor.py' 2024-11-03T22:29:33,687 adding 'verl/trainer/ppo/actor/megatron_actor.py' 2024-11-03T22:29:33,688 adding 'verl/trainer/ppo/critic/__init__.py' 2024-11-03T22:29:33,690 adding 'verl/trainer/ppo/critic/base.py' 2024-11-03T22:29:33,691 adding 'verl/trainer/ppo/critic/dp_critic.py' 2024-11-03T22:29:33,693 adding 'verl/trainer/ppo/critic/megatron_critic.py' 2024-11-03T22:29:33,695 adding 'verl/trainer/ppo/hybrid_engine/__init__.py' 2024-11-03T22:29:33,696 adding 'verl/trainer/ppo/hybrid_engine/base.py' 2024-11-03T22:29:33,698 adding 'verl/trainer/ppo/hybrid_engine/fsdp_vllm.py' 2024-11-03T22:29:33,700 adding 'verl/trainer/ppo/hybrid_engine/megatron_vllm.py' 2024-11-03T22:29:33,702 adding 'verl/trainer/ppo/reward_model/__init__.py' 2024-11-03T22:29:33,703 adding 'verl/trainer/ppo/reward_model/base.py' 2024-11-03T22:29:33,705 adding 'verl/trainer/ppo/reward_model/megatron/__init__.py' 2024-11-03T22:29:33,707 adding 'verl/trainer/ppo/reward_model/megatron/reward_model.py' 2024-11-03T22:29:33,709 adding 'verl/trainer/ppo/rollout/__init__.py' 2024-11-03T22:29:33,710 adding 'verl/trainer/ppo/rollout/base.py' 2024-11-03T22:29:33,712 adding 'verl/trainer/ppo/rollout/hf_rollout.py' 2024-11-03T22:29:33,714 adding 'verl/trainer/ppo/rollout/tokenizer.py' 2024-11-03T22:29:33,715 adding 'verl/trainer/ppo/rollout/megatron/__init__.py' 2024-11-03T22:29:33,717 adding 'verl/trainer/ppo/rollout/naive/__init__.py' 2024-11-03T22:29:33,719 adding 'verl/trainer/ppo/rollout/naive/naive_rollout.py' 2024-11-03T22:29:33,721 adding 'verl/trainer/ppo/rollout/vllm_rollout/__init__.py' 2024-11-03T22:29:33,722 adding 'verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py' 2024-11-03T22:29:33,724 adding 'verl/trainer/ppo/workers/__init__.py' 2024-11-03T22:29:33,728 adding 'verl/trainer/ppo/workers/fsdp_workers.py' 2024-11-03T22:29:33,731 adding 'verl/trainer/ppo/workers/megatron_workers.py' 2024-11-03T22:29:33,733 adding 'verl/utils/__init__.py' 2024-11-03T22:29:33,735 adding 'verl/utils/config.py' 2024-11-03T22:29:33,736 adding 'verl/utils/distributed.py' 2024-11-03T22:29:33,737 adding 'verl/utils/fs.py' 2024-11-03T22:29:33,739 adding 'verl/utils/fsdp_utils.py' 2024-11-03T22:29:33,740 adding 'verl/utils/hdfs_io.py' 2024-11-03T22:29:33,742 adding 'verl/utils/import_utils.py' 2024-11-03T22:29:33,743 adding 'verl/utils/logging_utils.py' 2024-11-03T22:29:33,745 adding 'verl/utils/megatron_utils.py' 2024-11-03T22:29:33,746 adding 'verl/utils/memory_buffer.py' 2024-11-03T22:29:33,749 adding 'verl/utils/model.py' 2024-11-03T22:29:33,750 adding 'verl/utils/py_functional.py' 2024-11-03T22:29:33,751 adding 'verl/utils/ray_utils.py' 2024-11-03T22:29:33,752 adding 'verl/utils/torch_dtypes.py' 2024-11-03T22:29:33,755 adding 'verl/utils/torch_functional.py' 2024-11-03T22:29:33,756 adding 'verl/utils/tracking.py' 2024-11-03T22:29:33,758 adding 'verl/utils/dataset/__init__.py' 2024-11-03T22:29:33,760 adding 'verl/utils/dataset/rl_dataset.py' 2024-11-03T22:29:33,761 adding 'verl/utils/dataset/rm_dataset.py' 2024-11-03T22:29:33,763 adding 'verl/utils/dataset/sft_dataset.py' 2024-11-03T22:29:33,765 adding 'verl/utils/debug/__init__.py' 2024-11-03T22:29:33,766 adding 'verl/utils/debug/performance.py' 2024-11-03T22:29:33,767 adding 'verl/utils/debug/trajectory_tracker.py' 2024-11-03T22:29:33,769 adding 'verl/utils/logger/__init__.py' 2024-11-03T22:29:33,771 adding 'verl/utils/logger/aggregate_logger.py' 2024-11-03T22:29:33,772 adding 'verl/utils/megatron/__init__.py' 2024-11-03T22:29:33,774 adding 'verl/utils/megatron/memory.py' 2024-11-03T22:29:33,775 adding 'verl/utils/megatron/optimizer.py' 2024-11-03T22:29:33,777 adding 'verl/utils/megatron/optimizer_config.py' 2024-11-03T22:29:33,778 adding 'verl/utils/megatron/pipeline_parallel.py' 2024-11-03T22:29:33,779 adding 'verl/utils/megatron/sequence_parallel.py' 2024-11-03T22:29:33,781 adding 'verl/utils/megatron/tensor_parallel.py' 2024-11-03T22:29:33,783 adding 'verl/utils/rendezvous/__init__.py' 2024-11-03T22:29:33,784 adding 'verl/utils/rendezvous/ray_backend.py' 2024-11-03T22:29:33,786 adding 'verl/utils/reward_score/__init__.py' 2024-11-03T22:29:33,787 adding 'verl/utils/reward_score/gsm8k.py' 2024-11-03T22:29:33,789 adding 'verl/utils/reward_score/math.py' 2024-11-03T22:29:33,790 adding 'verl/version/version' 2024-11-03T22:29:33,793 adding 'verl-0.1rc0.dist-info/LICENSE' 2024-11-03T22:29:33,795 adding 'verl-0.1rc0.dist-info/METADATA' 2024-11-03T22:29:33,796 adding 'verl-0.1rc0.dist-info/WHEEL' 2024-11-03T22:29:33,797 adding 'verl-0.1rc0.dist-info/top_level.txt' 2024-11-03T22:29:33,799 adding 'verl-0.1rc0.dist-info/RECORD' 2024-11-03T22:29:33,806 removing build/bdist.linux-armv7l/wheel 2024-11-03T22:29:33,990 Building wheel for verl (setup.py): finished with status 'done' 2024-11-03T22:29:33,996 Created wheel for verl: filename=verl-0.1rc0-py3-none-any.whl size=332562 sha256=62d25a38487e84cf2bdd4add756e1011e625dfccbee891d4e8ee0f78a3a7508e 2024-11-03T22:29:33,997 Stored in directory: /tmp/pip-ephem-wheel-cache-0qwspur2/wheels/11/c6/83/88d6b0a1ca1cd9c1f20840c2516fd0560d04e1d06a04474324 2024-11-03T22:29:34,013 Successfully built verl 2024-11-03T22:29:34,026 Removed build tracker: '/tmp/pip-build-tracker-7gv5cad3'