2024-12-11T20:01:02,444 Created temporary directory: /tmp/pip-build-tracker-wv8eh6sv 2024-12-11T20:01:02,446 Initialized build tracking at /tmp/pip-build-tracker-wv8eh6sv 2024-12-11T20:01:02,447 Created build tracker: /tmp/pip-build-tracker-wv8eh6sv 2024-12-11T20:01:02,447 Entered build tracker: /tmp/pip-build-tracker-wv8eh6sv 2024-12-11T20:01:02,448 Created temporary directory: /tmp/pip-wheel-4yheqdlp 2024-12-11T20:01:02,452 Created temporary directory: /tmp/pip-ephem-wheel-cache-m4ejc4zg 2024-12-11T20:01:02,496 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-11T20:01:02,498 2 location(s) to search for versions of verl: 2024-12-11T20:01:02,498 * https://pypi.org/simple/verl/ 2024-12-11T20:01:02,498 * https://www.piwheels.org/simple/verl/ 2024-12-11T20:01:02,499 Fetching project page and analyzing links: https://pypi.org/simple/verl/ 2024-12-11T20:01:02,500 Getting page https://pypi.org/simple/verl/ 2024-12-11T20:01:02,501 Found index url https://pypi.org/simple/ 2024-12-11T20:01:02,646 Fetched page https://pypi.org/simple/verl/ as application/vnd.pypi.simple.v1+json 2024-12-11T20:01:02,649 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/9f/86/496edb88346dafe6a0476247aae75f6ec1662af25c077d03026dc7cd9edf/verl-0.1rc0-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T20:01:02,649 Found link https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz (from https://pypi.org/simple/verl/), version: 0.1rc0 2024-12-11T20:01:02,650 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/b9/b3/f9912b1e4a833dfe0e83f99088f7ea530a593d98f47eecb3bd091ec77137/verl-0.1rc2-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T20:01:02,650 Found link https://files.pythonhosted.org/packages/49/9f/d2ab2587b09b449b792db6975fe499724b79bea47213a76729cdd5efa112/verl-0.1rc2.tar.gz (from https://pypi.org/simple/verl/), version: 0.1rc2 2024-12-11T20:01:02,651 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/6f/70/86b0ed59aec2376ac9c0ee6bf11a364212b657b1489080d495a7e904fe14/verl-0.1-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T20:01:02,652 Found link https://files.pythonhosted.org/packages/0d/75/9566144efde887c1eb88874e4952b70fc0491345cc75dd6da12217d0a053/verl-0.1.tar.gz (from https://pypi.org/simple/verl/), version: 0.1 2024-12-11T20:01:02,653 Fetching project page and analyzing links: https://www.piwheels.org/simple/verl/ 2024-12-11T20:01:02,654 Getting page https://www.piwheels.org/simple/verl/ 2024-12-11T20:01:02,655 Found index url https://www.piwheels.org/simple/ 2024-12-11T20:01:02,865 Fetched page https://www.piwheels.org/simple/verl/ as text/html 2024-12-11T20:01:02,867 Skipping link: No binaries permitted for verl: https://www.piwheels.org/simple/verl/verl-0.1rc2-py3-none-any.whl#sha256=4af932cb33e77dda2ebe245544a30268aade2d61b7f65f116a9aadd0727bd36a (from https://www.piwheels.org/simple/verl/) 2024-12-11T20:01:02,867 Skipping link: No binaries permitted for verl: https://www.piwheels.org/simple/verl/verl-0.1rc0-py3-none-any.whl#sha256=62d25a38487e84cf2bdd4add756e1011e625dfccbee891d4e8ee0f78a3a7508e (from https://www.piwheels.org/simple/verl/) 2024-12-11T20:01:02,868 Skipping link: not a file: https://www.piwheels.org/simple/verl/ 2024-12-11T20:01:02,869 Skipping link: not a file: https://pypi.org/simple/verl/ 2024-12-11T20:01:02,888 Given no hashes to check 1 links for project 'verl': discarding no candidates 2024-12-11T20:01:02,889 Collecting verl==0.1 2024-12-11T20:01:02,892 Created temporary directory: /tmp/pip-unpack-1xoiomgh 2024-12-11T20:01:03,113 Downloading verl-0.1.tar.gz (249 kB) 2024-12-11T20:01:03,548 Added verl==0.1 from https://files.pythonhosted.org/packages/0d/75/9566144efde887c1eb88874e4952b70fc0491345cc75dd6da12217d0a053/verl-0.1.tar.gz to build tracker '/tmp/pip-build-tracker-wv8eh6sv' 2024-12-11T20:01:03,550 Running setup.py (path:/tmp/pip-wheel-4yheqdlp/verl_6d23bc6c756a4f6ebca06ab86dff2002/setup.py) egg_info for package verl 2024-12-11T20:01:03,551 Created temporary directory: /tmp/pip-pip-egg-info-twiaejg7 2024-12-11T20:01:03,552 Preparing metadata (setup.py): started 2024-12-11T20:01:03,553 Running command python setup.py egg_info 2024-12-11T20:01:04,667 running egg_info 2024-12-11T20:01:04,694 creating /tmp/pip-pip-egg-info-twiaejg7/verl.egg-info 2024-12-11T20:01:04,695 writing /tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/PKG-INFO 2024-12-11T20:01:04,702 writing dependency_links to /tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/dependency_links.txt 2024-12-11T20:01:04,705 writing requirements to /tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/requires.txt 2024-12-11T20:01:04,706 writing top-level names to /tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/top_level.txt 2024-12-11T20:01:04,708 writing manifest file '/tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/SOURCES.txt' 2024-12-11T20:01:04,843 reading manifest file '/tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/SOURCES.txt' 2024-12-11T20:01:04,844 adding license file 'LICENSE' 2024-12-11T20:01:04,852 writing manifest file '/tmp/pip-pip-egg-info-twiaejg7/verl.egg-info/SOURCES.txt' 2024-12-11T20:01:04,961 Preparing metadata (setup.py): finished with status 'done' 2024-12-11T20:01:04,965 Source in /tmp/pip-wheel-4yheqdlp/verl_6d23bc6c756a4f6ebca06ab86dff2002 has version 0.1, which satisfies requirement verl==0.1 from https://files.pythonhosted.org/packages/0d/75/9566144efde887c1eb88874e4952b70fc0491345cc75dd6da12217d0a053/verl-0.1.tar.gz 2024-12-11T20:01:04,966 Removed verl==0.1 from https://files.pythonhosted.org/packages/0d/75/9566144efde887c1eb88874e4952b70fc0491345cc75dd6da12217d0a053/verl-0.1.tar.gz from build tracker '/tmp/pip-build-tracker-wv8eh6sv' 2024-12-11T20:01:04,975 Created temporary directory: /tmp/pip-unpack-5s6ggoxk 2024-12-11T20:01:04,976 Created temporary directory: /tmp/pip-unpack-3wktn1cu 2024-12-11T20:01:04,977 Building wheels for collected packages: verl 2024-12-11T20:01:04,981 Created temporary directory: /tmp/pip-wheel-x6bibpl_ 2024-12-11T20:01:04,981 Building wheel for verl (setup.py): started 2024-12-11T20:01:04,983 Destination directory: /tmp/pip-wheel-x6bibpl_ 2024-12-11T20:01:04,983 Running command python setup.py bdist_wheel 2024-12-11T20:01:06,003 running bdist_wheel 2024-12-11T20:01:06,133 running build 2024-12-11T20:01:06,134 running build_py 2024-12-11T20:01:06,163 creating build/lib/verl 2024-12-11T20:01:06,165 copying ./verl/__init__.py -> build/lib/verl 2024-12-11T20:01:06,167 copying ./verl/protocol.py -> build/lib/verl 2024-12-11T20:01:06,171 creating build/lib/verl/models 2024-12-11T20:01:06,172 copying ./verl/models/registry.py -> build/lib/verl/models 2024-12-11T20:01:06,174 copying ./verl/models/__init__.py -> build/lib/verl/models 2024-12-11T20:01:06,176 copying ./verl/models/weight_loader_registry.py -> build/lib/verl/models 2024-12-11T20:01:06,178 creating build/lib/verl/third_party 2024-12-11T20:01:06,179 copying ./verl/third_party/__init__.py -> build/lib/verl/third_party 2024-12-11T20:01:06,181 creating build/lib/verl/trainer 2024-12-11T20:01:06,183 copying ./verl/trainer/__init__.py -> build/lib/verl/trainer 2024-12-11T20:01:06,184 copying ./verl/trainer/main_generation.py -> build/lib/verl/trainer 2024-12-11T20:01:06,187 copying ./verl/trainer/main_eval.py -> build/lib/verl/trainer 2024-12-11T20:01:06,189 copying ./verl/trainer/main_ppo.py -> build/lib/verl/trainer 2024-12-11T20:01:06,191 copying ./verl/trainer/fsdp_sft_trainer.py -> build/lib/verl/trainer 2024-12-11T20:01:06,194 creating build/lib/verl/utils 2024-12-11T20:01:06,196 copying ./verl/utils/fsdp_utils.py -> build/lib/verl/utils 2024-12-11T20:01:06,198 copying ./verl/utils/model.py -> build/lib/verl/utils 2024-12-11T20:01:06,200 copying ./verl/utils/__init__.py -> build/lib/verl/utils 2024-12-11T20:01:06,203 copying ./verl/utils/tokenizer.py -> build/lib/verl/utils 2024-12-11T20:01:06,205 copying ./verl/utils/distributed.py -> build/lib/verl/utils 2024-12-11T20:01:06,206 copying ./verl/utils/py_functional.py -> build/lib/verl/utils 2024-12-11T20:01:06,208 copying ./verl/utils/tracking.py -> build/lib/verl/utils 2024-12-11T20:01:06,210 copying ./verl/utils/ray_utils.py -> build/lib/verl/utils 2024-12-11T20:01:06,212 copying ./verl/utils/memory_buffer.py -> build/lib/verl/utils 2024-12-11T20:01:06,214 copying ./verl/utils/fs.py -> build/lib/verl/utils 2024-12-11T20:01:06,216 copying ./verl/utils/megatron_utils.py -> build/lib/verl/utils 2024-12-11T20:01:06,218 copying ./verl/utils/import_utils.py -> build/lib/verl/utils 2024-12-11T20:01:06,220 copying ./verl/utils/hdfs_io.py -> build/lib/verl/utils 2024-12-11T20:01:06,222 copying ./verl/utils/logging_utils.py -> build/lib/verl/utils 2024-12-11T20:01:06,224 copying ./verl/utils/torch_functional.py -> build/lib/verl/utils 2024-12-11T20:01:06,226 copying ./verl/utils/config.py -> build/lib/verl/utils 2024-12-11T20:01:06,228 copying ./verl/utils/torch_dtypes.py -> build/lib/verl/utils 2024-12-11T20:01:06,230 creating build/lib/verl/single_controller 2024-12-11T20:01:06,231 copying ./verl/single_controller/__init__.py -> build/lib/verl/single_controller 2024-12-11T20:01:06,233 creating build/lib/verl/models/llama 2024-12-11T20:01:06,235 copying ./verl/models/llama/__init__.py -> build/lib/verl/models/llama 2024-12-11T20:01:06,237 creating build/lib/verl/models/llama/megatron 2024-12-11T20:01:06,238 copying ./verl/models/llama/megatron/__init__.py -> build/lib/verl/models/llama/megatron 2024-12-11T20:01:06,240 copying ./verl/models/llama/megatron/modeling_llama_megatron.py -> build/lib/verl/models/llama/megatron 2024-12-11T20:01:06,243 creating build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,244 copying ./verl/models/llama/megatron/layers/parallel_attention.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,247 copying ./verl/models/llama/megatron/layers/__init__.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,249 copying ./verl/models/llama/megatron/layers/parallel_mlp.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,251 copying ./verl/models/llama/megatron/layers/parallel_linear.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,253 copying ./verl/models/llama/megatron/layers/parallel_decoder.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,255 copying ./verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T20:01:06,258 creating build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,259 copying ./verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,261 copying ./verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,264 copying ./verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,267 creating build/lib/verl/third_party/vllm 2024-12-11T20:01:06,268 copying ./verl/third_party/vllm/__init__.py -> build/lib/verl/third_party/vllm 2024-12-11T20:01:06,271 creating build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,272 copying ./verl/third_party/vllm/vllm_v_0_6_3/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,274 copying ./verl/third_party/vllm/vllm_v_0_6_3/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,276 copying ./verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,278 copying ./verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,280 copying ./verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,282 copying ./verl/third_party/vllm/vllm_v_0_6_3/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,284 copying ./verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,287 copying ./verl/third_party/vllm/vllm_v_0_6_3/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,289 copying ./verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,292 copying ./verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,294 copying ./verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,297 copying ./verl/third_party/vllm/vllm_v_0_6_3/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,299 copying ./verl/third_party/vllm/vllm_v_0_6_3/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,301 copying ./verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:06,305 creating build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,306 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,309 copying ./verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,310 copying ./verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,313 copying ./verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,315 copying ./verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,317 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,319 copying ./verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,322 copying ./verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,324 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,327 copying ./verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,329 copying ./verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,331 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,334 copying ./verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,336 copying ./verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:06,339 creating build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,340 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,343 copying ./verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,345 copying ./verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,348 copying ./verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,350 copying ./verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,351 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,354 copying ./verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,357 copying ./verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,360 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,362 copying ./verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,366 copying ./verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,368 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,371 copying ./verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,373 copying ./verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:06,376 creating build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,377 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,380 copying ./verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,382 copying ./verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,384 copying ./verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,386 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,389 copying ./verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,391 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,394 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,396 copying ./verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,399 copying ./verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,401 copying ./verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:06,404 creating build/lib/verl/trainer/ppo 2024-12-11T20:01:06,405 copying ./verl/trainer/ppo/__init__.py -> build/lib/verl/trainer/ppo 2024-12-11T20:01:06,407 copying ./verl/trainer/ppo/ray_trainer.py -> build/lib/verl/trainer/ppo 2024-12-11T20:01:06,410 copying ./verl/trainer/ppo/core_algos.py -> build/lib/verl/trainer/ppo 2024-12-11T20:01:06,413 creating build/lib/verl/trainer/ppo/actor 2024-12-11T20:01:06,414 copying ./verl/trainer/ppo/actor/__init__.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T20:01:06,416 copying ./verl/trainer/ppo/actor/dp_actor.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T20:01:06,418 copying ./verl/trainer/ppo/actor/megatron_actor.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T20:01:06,420 copying ./verl/trainer/ppo/actor/base.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T20:01:06,423 creating build/lib/verl/trainer/ppo/rollout 2024-12-11T20:01:06,424 copying ./verl/trainer/ppo/rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T20:01:06,426 copying ./verl/trainer/ppo/rollout/tokenizer.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T20:01:06,429 copying ./verl/trainer/ppo/rollout/hf_rollout.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T20:01:06,431 copying ./verl/trainer/ppo/rollout/base.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T20:01:06,433 creating build/lib/verl/trainer/ppo/workers 2024-12-11T20:01:06,434 copying ./verl/trainer/ppo/workers/__init__.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T20:01:06,436 copying ./verl/trainer/ppo/workers/megatron_workers.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T20:01:06,439 copying ./verl/trainer/ppo/workers/fsdp_workers.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T20:01:06,443 creating build/lib/verl/trainer/ppo/critic 2024-12-11T20:01:06,444 copying ./verl/trainer/ppo/critic/__init__.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T20:01:06,446 copying ./verl/trainer/ppo/critic/dp_critic.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T20:01:06,449 copying ./verl/trainer/ppo/critic/megatron_critic.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T20:01:06,451 copying ./verl/trainer/ppo/critic/base.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T20:01:06,453 creating build/lib/verl/trainer/ppo/reward_model 2024-12-11T20:01:06,454 copying ./verl/trainer/ppo/reward_model/__init__.py -> build/lib/verl/trainer/ppo/reward_model 2024-12-11T20:01:06,456 copying ./verl/trainer/ppo/reward_model/base.py -> build/lib/verl/trainer/ppo/reward_model 2024-12-11T20:01:06,459 creating build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:06,460 copying ./verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:06,462 copying ./verl/trainer/ppo/hybrid_engine/__init__.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:06,464 copying ./verl/trainer/ppo/hybrid_engine/base.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:06,466 copying ./verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:06,469 creating build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T20:01:06,470 copying ./verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T20:01:06,472 copying ./verl/trainer/ppo/rollout/naive/__init__.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T20:01:06,475 creating build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:06,476 copying ./verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:06,478 copying ./verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:06,481 creating build/lib/verl/trainer/ppo/rollout/megatron 2024-12-11T20:01:06,482 copying ./verl/trainer/ppo/rollout/megatron/__init__.py -> build/lib/verl/trainer/ppo/rollout/megatron 2024-12-11T20:01:06,484 creating build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:06,486 copying ./verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:06,489 copying ./verl/trainer/ppo/reward_model/megatron/__init__.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:06,491 creating build/lib/verl/utils/debug 2024-12-11T20:01:06,492 copying ./verl/utils/debug/performance.py -> build/lib/verl/utils/debug 2024-12-11T20:01:06,494 copying ./verl/utils/debug/trajectory_tracker.py -> build/lib/verl/utils/debug 2024-12-11T20:01:06,496 copying ./verl/utils/debug/__init__.py -> build/lib/verl/utils/debug 2024-12-11T20:01:06,499 creating build/lib/verl/utils/megatron 2024-12-11T20:01:06,500 copying ./verl/utils/megatron/optimizer.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,502 copying ./verl/utils/megatron/__init__.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,504 copying ./verl/utils/megatron/tensor_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,506 copying ./verl/utils/megatron/optimizer_config.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,508 copying ./verl/utils/megatron/sequence_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,510 copying ./verl/utils/megatron/memory.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,512 copying ./verl/utils/megatron/pipeline_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T20:01:06,515 creating build/lib/verl/utils/reward_score 2024-12-11T20:01:06,516 copying ./verl/utils/reward_score/__init__.py -> build/lib/verl/utils/reward_score 2024-12-11T20:01:06,518 copying ./verl/utils/reward_score/gsm8k.py -> build/lib/verl/utils/reward_score 2024-12-11T20:01:06,520 copying ./verl/utils/reward_score/math.py -> build/lib/verl/utils/reward_score 2024-12-11T20:01:06,522 creating build/lib/verl/utils/dataset 2024-12-11T20:01:06,523 copying ./verl/utils/dataset/rm_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T20:01:06,526 copying ./verl/utils/dataset/rl_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T20:01:06,528 copying ./verl/utils/dataset/__init__.py -> build/lib/verl/utils/dataset 2024-12-11T20:01:06,530 copying ./verl/utils/dataset/sft_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T20:01:06,533 creating build/lib/verl/utils/rendezvous 2024-12-11T20:01:06,534 copying ./verl/utils/rendezvous/__init__.py -> build/lib/verl/utils/rendezvous 2024-12-11T20:01:06,535 copying ./verl/utils/rendezvous/ray_backend.py -> build/lib/verl/utils/rendezvous 2024-12-11T20:01:06,538 creating build/lib/verl/utils/logger 2024-12-11T20:01:06,539 copying ./verl/utils/logger/aggregate_logger.py -> build/lib/verl/utils/logger 2024-12-11T20:01:06,541 copying ./verl/utils/logger/__init__.py -> build/lib/verl/utils/logger 2024-12-11T20:01:06,543 creating build/lib/verl/single_controller/base 2024-12-11T20:01:06,544 copying ./verl/single_controller/base/decorator.py -> build/lib/verl/single_controller/base 2024-12-11T20:01:06,547 copying ./verl/single_controller/base/__init__.py -> build/lib/verl/single_controller/base 2024-12-11T20:01:06,549 copying ./verl/single_controller/base/worker.py -> build/lib/verl/single_controller/base 2024-12-11T20:01:06,551 copying ./verl/single_controller/base/dp.py -> build/lib/verl/single_controller/base 2024-12-11T20:01:06,553 copying ./verl/single_controller/base/worker_group.py -> build/lib/verl/single_controller/base 2024-12-11T20:01:06,556 creating build/lib/verl/single_controller/ray 2024-12-11T20:01:06,557 copying ./verl/single_controller/ray/decorator.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,559 copying ./verl/single_controller/ray/dist_data_pass_protocol.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,560 copying ./verl/single_controller/ray/megatron.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,562 copying ./verl/single_controller/ray/__init__.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,564 copying ./verl/single_controller/ray/base.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,567 copying ./verl/single_controller/ray/dp.py -> build/lib/verl/single_controller/ray 2024-12-11T20:01:06,570 creating build/lib/verl/single_controller/base/megatron 2024-12-11T20:01:06,571 copying ./verl/single_controller/base/megatron/__init__.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T20:01:06,573 copying ./verl/single_controller/base/megatron/worker.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T20:01:06,575 copying ./verl/single_controller/base/megatron/worker_group.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T20:01:06,577 creating build/lib/verl/single_controller/base/register_center 2024-12-11T20:01:06,578 copying ./verl/single_controller/base/register_center/__init__.py -> build/lib/verl/single_controller/base/register_center 2024-12-11T20:01:06,580 copying ./verl/single_controller/base/register_center/ray.py -> build/lib/verl/single_controller/base/register_center 2024-12-11T20:01:06,582 running egg_info 2024-12-11T20:01:06,612 writing verl.egg-info/PKG-INFO 2024-12-11T20:01:06,618 writing dependency_links to verl.egg-info/dependency_links.txt 2024-12-11T20:01:06,621 writing requirements to verl.egg-info/requires.txt 2024-12-11T20:01:06,623 writing top-level names to verl.egg-info/top_level.txt 2024-12-11T20:01:06,690 reading manifest file 'verl.egg-info/SOURCES.txt' 2024-12-11T20:01:06,712 adding license file 'LICENSE' 2024-12-11T20:01:06,727 writing manifest file 'verl.egg-info/SOURCES.txt' 2024-12-11T20:01:06,730 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.single_controller.version' is absent from the `packages` configuration. 2024-12-11T20:01:06,730 !! 2024-12-11T20:01:06,731 ******************************************************************************** 2024-12-11T20:01:06,732 ############################ 2024-12-11T20:01:06,732 # Package would be ignored # 2024-12-11T20:01:06,732 ############################ 2024-12-11T20:01:06,733 Python recognizes 'verl.single_controller.version' as an importable package[^1], 2024-12-11T20:01:06,733 but it is absent from setuptools' `packages` configuration. 2024-12-11T20:01:06,734 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T20:01:06,734 package, please make sure that 'verl.single_controller.version' is explicitly added 2024-12-11T20:01:06,735 to the `packages` configuration field. 2024-12-11T20:01:06,736 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T20:01:06,736 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T20:01:06,736 instead of `find_packages(...)`/`find:`). 2024-12-11T20:01:06,737 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T20:01:06,738 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T20:01:06,739 If you don't want 'verl.single_controller.version' to be distributed and are 2024-12-11T20:01:06,739 already explicitly excluding 'verl.single_controller.version' via 2024-12-11T20:01:06,739 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T20:01:06,740 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T20:01:06,740 combination with a more fine grained `package-data` configuration. 2024-12-11T20:01:06,742 You can read more about "package data files" on setuptools documentation page: 2024-12-11T20:01:06,743 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T20:01:06,745 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T20:01:06,745 even if it does not contain any `.py` files. 2024-12-11T20:01:06,746 On the other hand, currently there is no concept of package data 2024-12-11T20:01:06,746 directory, all directories are treated like packages. 2024-12-11T20:01:06,747 ******************************************************************************** 2024-12-11T20:01:06,748 !! 2024-12-11T20:01:06,749 check.warn(importable) 2024-12-11T20:01:06,749 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.trainer.config' is absent from the `packages` configuration. 2024-12-11T20:01:06,750 !! 2024-12-11T20:01:06,751 ******************************************************************************** 2024-12-11T20:01:06,752 ############################ 2024-12-11T20:01:06,752 # Package would be ignored # 2024-12-11T20:01:06,753 ############################ 2024-12-11T20:01:06,753 Python recognizes 'verl.trainer.config' as an importable package[^1], 2024-12-11T20:01:06,754 but it is absent from setuptools' `packages` configuration. 2024-12-11T20:01:06,755 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T20:01:06,756 package, please make sure that 'verl.trainer.config' is explicitly added 2024-12-11T20:01:06,756 to the `packages` configuration field. 2024-12-11T20:01:06,757 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T20:01:06,758 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T20:01:06,759 instead of `find_packages(...)`/`find:`). 2024-12-11T20:01:06,760 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T20:01:06,760 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T20:01:06,761 If you don't want 'verl.trainer.config' to be distributed and are 2024-12-11T20:01:06,762 already explicitly excluding 'verl.trainer.config' via 2024-12-11T20:01:06,762 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T20:01:06,763 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T20:01:06,763 combination with a more fine grained `package-data` configuration. 2024-12-11T20:01:06,764 You can read more about "package data files" on setuptools documentation page: 2024-12-11T20:01:06,765 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T20:01:06,767 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T20:01:06,767 even if it does not contain any `.py` files. 2024-12-11T20:01:06,768 On the other hand, currently there is no concept of package data 2024-12-11T20:01:06,768 directory, all directories are treated like packages. 2024-12-11T20:01:06,769 ******************************************************************************** 2024-12-11T20:01:06,770 !! 2024-12-11T20:01:06,770 check.warn(importable) 2024-12-11T20:01:06,770 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.version' is absent from the `packages` configuration. 2024-12-11T20:01:06,771 !! 2024-12-11T20:01:06,772 ******************************************************************************** 2024-12-11T20:01:06,772 ############################ 2024-12-11T20:01:06,773 # Package would be ignored # 2024-12-11T20:01:06,773 ############################ 2024-12-11T20:01:06,774 Python recognizes 'verl.version' as an importable package[^1], 2024-12-11T20:01:06,774 but it is absent from setuptools' `packages` configuration. 2024-12-11T20:01:06,775 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T20:01:06,776 package, please make sure that 'verl.version' is explicitly added 2024-12-11T20:01:06,777 to the `packages` configuration field. 2024-12-11T20:01:06,777 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T20:01:06,778 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T20:01:06,778 instead of `find_packages(...)`/`find:`). 2024-12-11T20:01:06,779 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T20:01:06,780 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T20:01:06,781 If you don't want 'verl.version' to be distributed and are 2024-12-11T20:01:06,782 already explicitly excluding 'verl.version' via 2024-12-11T20:01:06,782 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T20:01:06,783 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T20:01:06,783 combination with a more fine grained `package-data` configuration. 2024-12-11T20:01:06,784 You can read more about "package data files" on setuptools documentation page: 2024-12-11T20:01:06,785 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T20:01:06,787 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T20:01:06,788 even if it does not contain any `.py` files. 2024-12-11T20:01:06,788 On the other hand, currently there is no concept of package data 2024-12-11T20:01:06,789 directory, all directories are treated like packages. 2024-12-11T20:01:06,790 ******************************************************************************** 2024-12-11T20:01:06,791 !! 2024-12-11T20:01:06,791 check.warn(importable) 2024-12-11T20:01:06,792 creating build/lib/verl/version 2024-12-11T20:01:06,793 copying ./verl/version/version -> build/lib/verl/version 2024-12-11T20:01:06,793 creating build/lib/verl/trainer/config 2024-12-11T20:01:06,794 copying ./verl/trainer/config/ppo_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T20:01:06,794 copying ./verl/trainer/config/evaluation.yaml -> build/lib/verl/trainer/config 2024-12-11T20:01:06,795 copying ./verl/trainer/config/sft_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T20:01:06,795 copying ./verl/trainer/config/ppo_megatron_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T20:01:06,796 copying ./verl/trainer/config/generation.yaml -> build/lib/verl/trainer/config 2024-12-11T20:01:06,796 creating build/lib/verl/single_controller/version 2024-12-11T20:01:06,797 copying ./verl/single_controller/version/version -> build/lib/verl/single_controller/version 2024-12-11T20:01:06,859 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-11T20:01:06,860 !! 2024-12-11T20:01:06,861 ******************************************************************************** 2024-12-11T20:01:06,862 Please avoid running ``setup.py`` directly. 2024-12-11T20:01:06,862 Instead, use pypa/build, pypa/installer or other 2024-12-11T20:01:06,863 standards-based tools. 2024-12-11T20:01:06,864 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-11T20:01:06,865 ******************************************************************************** 2024-12-11T20:01:06,866 !! 2024-12-11T20:01:06,867 self.initialize_options() 2024-12-11T20:01:06,894 installing to build/bdist.linux-armv7l/wheel 2024-12-11T20:01:06,895 running install 2024-12-11T20:01:06,919 running install_lib 2024-12-11T20:01:06,946 creating build/bdist.linux-armv7l/wheel 2024-12-11T20:01:06,949 creating build/bdist.linux-armv7l/wheel/verl 2024-12-11T20:01:06,951 creating build/bdist.linux-armv7l/wheel/verl/models 2024-12-11T20:01:06,952 copying build/lib/verl/models/registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T20:01:06,954 copying build/lib/verl/models/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T20:01:06,956 creating build/bdist.linux-armv7l/wheel/verl/models/llama 2024-12-11T20:01:06,957 copying build/lib/verl/models/llama/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama 2024-12-11T20:01:06,960 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron 2024-12-11T20:01:06,961 copying build/lib/verl/models/llama/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-12-11T20:01:06,963 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/layers 2024-12-11T20:01:06,965 copying build/lib/verl/models/llama/megatron/layers/parallel_attention.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,968 copying build/lib/verl/models/llama/megatron/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,969 copying build/lib/verl/models/llama/megatron/layers/parallel_mlp.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,971 copying build/lib/verl/models/llama/megatron/layers/parallel_linear.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,973 copying build/lib/verl/models/llama/megatron/layers/parallel_decoder.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,976 copying build/lib/verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T20:01:06,978 copying build/lib/verl/models/llama/megatron/modeling_llama_megatron.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-12-11T20:01:06,981 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,982 copying build/lib/verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,984 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,986 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T20:01:06,989 copying build/lib/verl/models/weight_loader_registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T20:01:06,991 copying build/lib/verl/__init__.py -> build/bdist.linux-armv7l/wheel/./verl 2024-12-11T20:01:06,993 creating build/bdist.linux-armv7l/wheel/verl/third_party 2024-12-11T20:01:06,994 copying build/lib/verl/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party 2024-12-11T20:01:06,997 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm 2024-12-11T20:01:06,999 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,000 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,002 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,004 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,006 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,008 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,010 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,012 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,014 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,016 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,019 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,021 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,024 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,027 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,029 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T20:01:07,031 copying build/lib/verl/third_party/vllm/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm 2024-12-11T20:01:07,034 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,035 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,037 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,039 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,041 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,043 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,045 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,047 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,050 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,052 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,055 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,057 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,060 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,062 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,064 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T20:01:07,068 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,069 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,071 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,073 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,076 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,078 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,080 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,082 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,085 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,087 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,089 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,092 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,094 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,096 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,099 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T20:01:07,101 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,103 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,105 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,107 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,109 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,111 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,113 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,116 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,118 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,121 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,123 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,126 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T20:01:07,129 creating build/bdist.linux-armv7l/wheel/verl/trainer 2024-12-11T20:01:07,131 creating build/bdist.linux-armv7l/wheel/verl/trainer/config 2024-12-11T20:01:07,132 copying build/lib/verl/trainer/config/ppo_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T20:01:07,134 copying build/lib/verl/trainer/config/evaluation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T20:01:07,136 copying build/lib/verl/trainer/config/sft_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T20:01:07,138 copying build/lib/verl/trainer/config/ppo_megatron_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T20:01:07,140 copying build/lib/verl/trainer/config/generation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T20:01:07,142 copying build/lib/verl/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T20:01:07,144 copying build/lib/verl/trainer/main_generation.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T20:01:07,146 copying build/lib/verl/trainer/main_eval.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T20:01:07,148 copying build/lib/verl/trainer/main_ppo.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T20:01:07,150 copying build/lib/verl/trainer/fsdp_sft_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T20:01:07,153 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo 2024-12-11T20:01:07,155 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/actor 2024-12-11T20:01:07,156 copying build/lib/verl/trainer/ppo/actor/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T20:01:07,157 copying build/lib/verl/trainer/ppo/actor/dp_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T20:01:07,160 copying build/lib/verl/trainer/ppo/actor/megatron_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T20:01:07,162 copying build/lib/verl/trainer/ppo/actor/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T20:01:07,164 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout 2024-12-11T20:01:07,166 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/naive 2024-12-11T20:01:07,167 copying build/lib/verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-12-11T20:01:07,170 copying build/lib/verl/trainer/ppo/rollout/naive/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-12-11T20:01:07,172 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:07,173 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:07,175 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T20:01:07,177 copying build/lib/verl/trainer/ppo/rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T20:01:07,179 copying build/lib/verl/trainer/ppo/rollout/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T20:01:07,182 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/megatron 2024-12-11T20:01:07,183 copying build/lib/verl/trainer/ppo/rollout/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/megatron 2024-12-11T20:01:07,185 copying build/lib/verl/trainer/ppo/rollout/hf_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T20:01:07,187 copying build/lib/verl/trainer/ppo/rollout/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T20:01:07,188 copying build/lib/verl/trainer/ppo/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T20:01:07,191 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/workers 2024-12-11T20:01:07,192 copying build/lib/verl/trainer/ppo/workers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T20:01:07,194 copying build/lib/verl/trainer/ppo/workers/megatron_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T20:01:07,197 copying build/lib/verl/trainer/ppo/workers/fsdp_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T20:01:07,199 copying build/lib/verl/trainer/ppo/ray_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T20:01:07,203 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/critic 2024-12-11T20:01:07,204 copying build/lib/verl/trainer/ppo/critic/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T20:01:07,206 copying build/lib/verl/trainer/ppo/critic/dp_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T20:01:07,208 copying build/lib/verl/trainer/ppo/critic/megatron_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T20:01:07,211 copying build/lib/verl/trainer/ppo/critic/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T20:01:07,213 copying build/lib/verl/trainer/ppo/core_algos.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T20:01:07,216 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model 2024-12-11T20:01:07,217 copying build/lib/verl/trainer/ppo/reward_model/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-12-11T20:01:07,219 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:07,220 copying build/lib/verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:07,223 copying build/lib/verl/trainer/ppo/reward_model/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-12-11T20:01:07,225 copying build/lib/verl/trainer/ppo/reward_model/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-12-11T20:01:07,228 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:07,229 copying build/lib/verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:07,232 copying build/lib/verl/trainer/ppo/hybrid_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:07,233 copying build/lib/verl/trainer/ppo/hybrid_engine/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:07,235 copying build/lib/verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T20:01:07,238 creating build/bdist.linux-armv7l/wheel/verl/utils 2024-12-11T20:01:07,239 copying build/lib/verl/utils/fsdp_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,241 copying build/lib/verl/utils/model.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,244 copying build/lib/verl/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,246 copying build/lib/verl/utils/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,248 copying build/lib/verl/utils/distributed.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,250 creating build/bdist.linux-armv7l/wheel/verl/utils/debug 2024-12-11T20:01:07,251 copying build/lib/verl/utils/debug/performance.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T20:01:07,253 copying build/lib/verl/utils/debug/trajectory_tracker.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T20:01:07,255 copying build/lib/verl/utils/debug/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T20:01:07,257 creating build/bdist.linux-armv7l/wheel/verl/utils/megatron 2024-12-11T20:01:07,258 copying build/lib/verl/utils/megatron/optimizer.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,261 copying build/lib/verl/utils/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,262 copying build/lib/verl/utils/megatron/tensor_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,265 copying build/lib/verl/utils/megatron/optimizer_config.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,267 copying build/lib/verl/utils/megatron/sequence_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,269 copying build/lib/verl/utils/megatron/memory.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,270 copying build/lib/verl/utils/megatron/pipeline_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T20:01:07,272 copying build/lib/verl/utils/py_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,274 copying build/lib/verl/utils/tracking.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,277 creating build/bdist.linux-armv7l/wheel/verl/utils/reward_score 2024-12-11T20:01:07,278 copying build/lib/verl/utils/reward_score/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T20:01:07,280 copying build/lib/verl/utils/reward_score/gsm8k.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T20:01:07,282 copying build/lib/verl/utils/reward_score/math.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T20:01:07,285 creating build/bdist.linux-armv7l/wheel/verl/utils/dataset 2024-12-11T20:01:07,286 copying build/lib/verl/utils/dataset/rm_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T20:01:07,288 copying build/lib/verl/utils/dataset/rl_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T20:01:07,291 copying build/lib/verl/utils/dataset/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T20:01:07,293 copying build/lib/verl/utils/dataset/sft_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T20:01:07,295 copying build/lib/verl/utils/ray_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,297 creating build/bdist.linux-armv7l/wheel/verl/utils/rendezvous 2024-12-11T20:01:07,298 copying build/lib/verl/utils/rendezvous/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-12-11T20:01:07,300 copying build/lib/verl/utils/rendezvous/ray_backend.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-12-11T20:01:07,302 copying build/lib/verl/utils/memory_buffer.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,304 copying build/lib/verl/utils/fs.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,306 copying build/lib/verl/utils/megatron_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,308 copying build/lib/verl/utils/import_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,310 copying build/lib/verl/utils/hdfs_io.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,312 copying build/lib/verl/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,314 copying build/lib/verl/utils/torch_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,316 copying build/lib/verl/utils/config.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,318 copying build/lib/verl/utils/torch_dtypes.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T20:01:07,321 creating build/bdist.linux-armv7l/wheel/verl/utils/logger 2024-12-11T20:01:07,322 copying build/lib/verl/utils/logger/aggregate_logger.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-12-11T20:01:07,324 copying build/lib/verl/utils/logger/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-12-11T20:01:07,326 creating build/bdist.linux-armv7l/wheel/verl/version 2024-12-11T20:01:07,327 copying build/lib/verl/version/version -> build/bdist.linux-armv7l/wheel/./verl/version 2024-12-11T20:01:07,329 creating build/bdist.linux-armv7l/wheel/verl/single_controller 2024-12-11T20:01:07,331 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base 2024-12-11T20:01:07,332 copying build/lib/verl/single_controller/base/decorator.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T20:01:07,335 copying build/lib/verl/single_controller/base/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T20:01:07,337 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base/megatron 2024-12-11T20:01:07,339 copying build/lib/verl/single_controller/base/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T20:01:07,341 copying build/lib/verl/single_controller/base/megatron/worker.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T20:01:07,342 copying build/lib/verl/single_controller/base/megatron/worker_group.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T20:01:07,344 copying build/lib/verl/single_controller/base/worker.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T20:01:07,348 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base/register_center 2024-12-11T20:01:07,349 copying build/lib/verl/single_controller/base/register_center/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/register_center 2024-12-11T20:01:07,351 copying build/lib/verl/single_controller/base/register_center/ray.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/register_center 2024-12-11T20:01:07,352 copying build/lib/verl/single_controller/base/dp.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T20:01:07,354 copying build/lib/verl/single_controller/base/worker_group.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T20:01:07,356 copying build/lib/verl/single_controller/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller 2024-12-11T20:01:07,358 creating build/bdist.linux-armv7l/wheel/verl/single_controller/ray 2024-12-11T20:01:07,360 copying build/lib/verl/single_controller/ray/decorator.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,361 copying build/lib/verl/single_controller/ray/dist_data_pass_protocol.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,363 copying build/lib/verl/single_controller/ray/megatron.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,365 copying build/lib/verl/single_controller/ray/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,367 copying build/lib/verl/single_controller/ray/base.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,369 copying build/lib/verl/single_controller/ray/dp.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T20:01:07,372 creating build/bdist.linux-armv7l/wheel/verl/single_controller/version 2024-12-11T20:01:07,373 copying build/lib/verl/single_controller/version/version -> build/bdist.linux-armv7l/wheel/./verl/single_controller/version 2024-12-11T20:01:07,375 copying build/lib/verl/protocol.py -> build/bdist.linux-armv7l/wheel/./verl 2024-12-11T20:01:07,377 running install_egg_info 2024-12-11T20:01:07,410 Copying verl.egg-info to build/bdist.linux-armv7l/wheel/./verl-0.1-py3.11.egg-info 2024-12-11T20:01:07,421 running install_scripts 2024-12-11T20:01:07,438 creating build/bdist.linux-armv7l/wheel/verl-0.1.dist-info/WHEEL 2024-12-11T20:01:07,441 creating '/tmp/pip-wheel-x6bibpl_/verl-0.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-11T20:01:07,443 adding 'verl/__init__.py' 2024-12-11T20:01:07,446 adding 'verl/protocol.py' 2024-12-11T20:01:07,448 adding 'verl/models/__init__.py' 2024-12-11T20:01:07,449 adding 'verl/models/registry.py' 2024-12-11T20:01:07,450 adding 'verl/models/weight_loader_registry.py' 2024-12-11T20:01:07,452 adding 'verl/models/llama/__init__.py' 2024-12-11T20:01:07,454 adding 'verl/models/llama/megatron/__init__.py' 2024-12-11T20:01:07,457 adding 'verl/models/llama/megatron/modeling_llama_megatron.py' 2024-12-11T20:01:07,459 adding 'verl/models/llama/megatron/checkpoint_utils/__init__.py' 2024-12-11T20:01:07,461 adding 'verl/models/llama/megatron/checkpoint_utils/llama_loader.py' 2024-12-11T20:01:07,464 adding 'verl/models/llama/megatron/checkpoint_utils/llama_saver.py' 2024-12-11T20:01:07,466 adding 'verl/models/llama/megatron/layers/__init__.py' 2024-12-11T20:01:07,468 adding 'verl/models/llama/megatron/layers/parallel_attention.py' 2024-12-11T20:01:07,470 adding 'verl/models/llama/megatron/layers/parallel_decoder.py' 2024-12-11T20:01:07,472 adding 'verl/models/llama/megatron/layers/parallel_linear.py' 2024-12-11T20:01:07,473 adding 'verl/models/llama/megatron/layers/parallel_mlp.py' 2024-12-11T20:01:07,475 adding 'verl/models/llama/megatron/layers/parallel_rmsnorm.py' 2024-12-11T20:01:07,476 adding 'verl/single_controller/__init__.py' 2024-12-11T20:01:07,478 adding 'verl/single_controller/base/__init__.py' 2024-12-11T20:01:07,480 adding 'verl/single_controller/base/decorator.py' 2024-12-11T20:01:07,481 adding 'verl/single_controller/base/dp.py' 2024-12-11T20:01:07,482 adding 'verl/single_controller/base/worker.py' 2024-12-11T20:01:07,484 adding 'verl/single_controller/base/worker_group.py' 2024-12-11T20:01:07,486 adding 'verl/single_controller/base/megatron/__init__.py' 2024-12-11T20:01:07,487 adding 'verl/single_controller/base/megatron/worker.py' 2024-12-11T20:01:07,488 adding 'verl/single_controller/base/megatron/worker_group.py' 2024-12-11T20:01:07,490 adding 'verl/single_controller/base/register_center/__init__.py' 2024-12-11T20:01:07,491 adding 'verl/single_controller/base/register_center/ray.py' 2024-12-11T20:01:07,493 adding 'verl/single_controller/ray/__init__.py' 2024-12-11T20:01:07,495 adding 'verl/single_controller/ray/base.py' 2024-12-11T20:01:07,497 adding 'verl/single_controller/ray/decorator.py' 2024-12-11T20:01:07,498 adding 'verl/single_controller/ray/dist_data_pass_protocol.py' 2024-12-11T20:01:07,499 adding 'verl/single_controller/ray/dp.py' 2024-12-11T20:01:07,501 adding 'verl/single_controller/ray/megatron.py' 2024-12-11T20:01:07,502 adding 'verl/single_controller/version/version' 2024-12-11T20:01:07,504 adding 'verl/third_party/__init__.py' 2024-12-11T20:01:07,506 adding 'verl/third_party/vllm/__init__.py' 2024-12-11T20:01:07,507 adding 'verl/third_party/vllm/vllm_v_0_3_1/__init__.py' 2024-12-11T20:01:07,509 adding 'verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py' 2024-12-11T20:01:07,512 adding 'verl/third_party/vllm/vllm_v_0_3_1/config.py' 2024-12-11T20:01:07,514 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm.py' 2024-12-11T20:01:07,519 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py' 2024-12-11T20:01:07,521 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_loader.py' 2024-12-11T20:01:07,523 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_runner.py' 2024-12-11T20:01:07,524 adding 'verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py' 2024-12-11T20:01:07,526 adding 'verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py' 2024-12-11T20:01:07,527 adding 'verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py' 2024-12-11T20:01:07,529 adding 'verl/third_party/vllm/vllm_v_0_3_1/worker.py' 2024-12-11T20:01:07,531 adding 'verl/third_party/vllm/vllm_v_0_4_2/__init__.py' 2024-12-11T20:01:07,533 adding 'verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py' 2024-12-11T20:01:07,535 adding 'verl/third_party/vllm/vllm_v_0_4_2/config.py' 2024-12-11T20:01:07,537 adding 'verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py' 2024-12-11T20:01:07,539 adding 'verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py' 2024-12-11T20:01:07,541 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm.py' 2024-12-11T20:01:07,544 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py' 2024-12-11T20:01:07,546 adding 'verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py' 2024-12-11T20:01:07,548 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_loader.py' 2024-12-11T20:01:07,550 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_runner.py' 2024-12-11T20:01:07,552 adding 'verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py' 2024-12-11T20:01:07,554 adding 'verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py' 2024-12-11T20:01:07,555 adding 'verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py' 2024-12-11T20:01:07,557 adding 'verl/third_party/vllm/vllm_v_0_4_2/worker.py' 2024-12-11T20:01:07,559 adding 'verl/third_party/vllm/vllm_v_0_5_4/__init__.py' 2024-12-11T20:01:07,562 adding 'verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py' 2024-12-11T20:01:07,564 adding 'verl/third_party/vllm/vllm_v_0_5_4/config.py' 2024-12-11T20:01:07,566 adding 'verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py' 2024-12-11T20:01:07,568 adding 'verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py' 2024-12-11T20:01:07,570 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm.py' 2024-12-11T20:01:07,572 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py' 2024-12-11T20:01:07,574 adding 'verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py' 2024-12-11T20:01:07,576 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_loader.py' 2024-12-11T20:01:07,577 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_runner.py' 2024-12-11T20:01:07,579 adding 'verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py' 2024-12-11T20:01:07,581 adding 'verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py' 2024-12-11T20:01:07,582 adding 'verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py' 2024-12-11T20:01:07,585 adding 'verl/third_party/vllm/vllm_v_0_5_4/worker.py' 2024-12-11T20:01:07,586 adding 'verl/third_party/vllm/vllm_v_0_6_3/__init__.py' 2024-12-11T20:01:07,588 adding 'verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py' 2024-12-11T20:01:07,589 adding 'verl/third_party/vllm/vllm_v_0_6_3/config.py' 2024-12-11T20:01:07,591 adding 'verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py' 2024-12-11T20:01:07,592 adding 'verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py' 2024-12-11T20:01:07,594 adding 'verl/third_party/vllm/vllm_v_0_6_3/llm.py' 2024-12-11T20:01:07,597 adding 'verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py' 2024-12-11T20:01:07,598 adding 'verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py' 2024-12-11T20:01:07,600 adding 'verl/third_party/vllm/vllm_v_0_6_3/model_loader.py' 2024-12-11T20:01:07,602 adding 'verl/third_party/vllm/vllm_v_0_6_3/model_runner.py' 2024-12-11T20:01:07,604 adding 'verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py' 2024-12-11T20:01:07,606 adding 'verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py' 2024-12-11T20:01:07,607 adding 'verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py' 2024-12-11T20:01:07,609 adding 'verl/third_party/vllm/vllm_v_0_6_3/worker.py' 2024-12-11T20:01:07,611 adding 'verl/trainer/__init__.py' 2024-12-11T20:01:07,613 adding 'verl/trainer/fsdp_sft_trainer.py' 2024-12-11T20:01:07,615 adding 'verl/trainer/main_eval.py' 2024-12-11T20:01:07,617 adding 'verl/trainer/main_generation.py' 2024-12-11T20:01:07,618 adding 'verl/trainer/main_ppo.py' 2024-12-11T20:01:07,620 adding 'verl/trainer/config/evaluation.yaml' 2024-12-11T20:01:07,621 adding 'verl/trainer/config/generation.yaml' 2024-12-11T20:01:07,622 adding 'verl/trainer/config/ppo_megatron_trainer.yaml' 2024-12-11T20:01:07,624 adding 'verl/trainer/config/ppo_trainer.yaml' 2024-12-11T20:01:07,625 adding 'verl/trainer/config/sft_trainer.yaml' 2024-12-11T20:01:07,627 adding 'verl/trainer/ppo/__init__.py' 2024-12-11T20:01:07,629 adding 'verl/trainer/ppo/core_algos.py' 2024-12-11T20:01:07,631 adding 'verl/trainer/ppo/ray_trainer.py' 2024-12-11T20:01:07,633 adding 'verl/trainer/ppo/actor/__init__.py' 2024-12-11T20:01:07,635 adding 'verl/trainer/ppo/actor/base.py' 2024-12-11T20:01:07,636 adding 'verl/trainer/ppo/actor/dp_actor.py' 2024-12-11T20:01:07,639 adding 'verl/trainer/ppo/actor/megatron_actor.py' 2024-12-11T20:01:07,640 adding 'verl/trainer/ppo/critic/__init__.py' 2024-12-11T20:01:07,642 adding 'verl/trainer/ppo/critic/base.py' 2024-12-11T20:01:07,644 adding 'verl/trainer/ppo/critic/dp_critic.py' 2024-12-11T20:01:07,646 adding 'verl/trainer/ppo/critic/megatron_critic.py' 2024-12-11T20:01:07,648 adding 'verl/trainer/ppo/hybrid_engine/__init__.py' 2024-12-11T20:01:07,649 adding 'verl/trainer/ppo/hybrid_engine/base.py' 2024-12-11T20:01:07,650 adding 'verl/trainer/ppo/hybrid_engine/fsdp_vllm.py' 2024-12-11T20:01:07,653 adding 'verl/trainer/ppo/hybrid_engine/megatron_vllm.py' 2024-12-11T20:01:07,655 adding 'verl/trainer/ppo/reward_model/__init__.py' 2024-12-11T20:01:07,656 adding 'verl/trainer/ppo/reward_model/base.py' 2024-12-11T20:01:07,658 adding 'verl/trainer/ppo/reward_model/megatron/__init__.py' 2024-12-11T20:01:07,660 adding 'verl/trainer/ppo/reward_model/megatron/reward_model.py' 2024-12-11T20:01:07,662 adding 'verl/trainer/ppo/rollout/__init__.py' 2024-12-11T20:01:07,663 adding 'verl/trainer/ppo/rollout/base.py' 2024-12-11T20:01:07,665 adding 'verl/trainer/ppo/rollout/hf_rollout.py' 2024-12-11T20:01:07,666 adding 'verl/trainer/ppo/rollout/tokenizer.py' 2024-12-11T20:01:07,668 adding 'verl/trainer/ppo/rollout/megatron/__init__.py' 2024-12-11T20:01:07,669 adding 'verl/trainer/ppo/rollout/naive/__init__.py' 2024-12-11T20:01:07,671 adding 'verl/trainer/ppo/rollout/naive/naive_rollout.py' 2024-12-11T20:01:07,672 adding 'verl/trainer/ppo/rollout/vllm_rollout/__init__.py' 2024-12-11T20:01:07,674 adding 'verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py' 2024-12-11T20:01:07,676 adding 'verl/trainer/ppo/workers/__init__.py' 2024-12-11T20:01:07,679 adding 'verl/trainer/ppo/workers/fsdp_workers.py' 2024-12-11T20:01:07,682 adding 'verl/trainer/ppo/workers/megatron_workers.py' 2024-12-11T20:01:07,684 adding 'verl/utils/__init__.py' 2024-12-11T20:01:07,686 adding 'verl/utils/config.py' 2024-12-11T20:01:07,687 adding 'verl/utils/distributed.py' 2024-12-11T20:01:07,688 adding 'verl/utils/fs.py' 2024-12-11T20:01:07,690 adding 'verl/utils/fsdp_utils.py' 2024-12-11T20:01:07,691 adding 'verl/utils/hdfs_io.py' 2024-12-11T20:01:07,692 adding 'verl/utils/import_utils.py' 2024-12-11T20:01:07,694 adding 'verl/utils/logging_utils.py' 2024-12-11T20:01:07,695 adding 'verl/utils/megatron_utils.py' 2024-12-11T20:01:07,697 adding 'verl/utils/memory_buffer.py' 2024-12-11T20:01:07,699 adding 'verl/utils/model.py' 2024-12-11T20:01:07,701 adding 'verl/utils/py_functional.py' 2024-12-11T20:01:07,702 adding 'verl/utils/ray_utils.py' 2024-12-11T20:01:07,703 adding 'verl/utils/tokenizer.py' 2024-12-11T20:01:07,704 adding 'verl/utils/torch_dtypes.py' 2024-12-11T20:01:07,707 adding 'verl/utils/torch_functional.py' 2024-12-11T20:01:07,708 adding 'verl/utils/tracking.py' 2024-12-11T20:01:07,710 adding 'verl/utils/dataset/__init__.py' 2024-12-11T20:01:07,712 adding 'verl/utils/dataset/rl_dataset.py' 2024-12-11T20:01:07,713 adding 'verl/utils/dataset/rm_dataset.py' 2024-12-11T20:01:07,715 adding 'verl/utils/dataset/sft_dataset.py' 2024-12-11T20:01:07,717 adding 'verl/utils/debug/__init__.py' 2024-12-11T20:01:07,718 adding 'verl/utils/debug/performance.py' 2024-12-11T20:01:07,719 adding 'verl/utils/debug/trajectory_tracker.py' 2024-12-11T20:01:07,721 adding 'verl/utils/logger/__init__.py' 2024-12-11T20:01:07,722 adding 'verl/utils/logger/aggregate_logger.py' 2024-12-11T20:01:07,724 adding 'verl/utils/megatron/__init__.py' 2024-12-11T20:01:07,725 adding 'verl/utils/megatron/memory.py' 2024-12-11T20:01:07,727 adding 'verl/utils/megatron/optimizer.py' 2024-12-11T20:01:07,728 adding 'verl/utils/megatron/optimizer_config.py' 2024-12-11T20:01:07,729 adding 'verl/utils/megatron/pipeline_parallel.py' 2024-12-11T20:01:07,731 adding 'verl/utils/megatron/sequence_parallel.py' 2024-12-11T20:01:07,732 adding 'verl/utils/megatron/tensor_parallel.py' 2024-12-11T20:01:07,734 adding 'verl/utils/rendezvous/__init__.py' 2024-12-11T20:01:07,735 adding 'verl/utils/rendezvous/ray_backend.py' 2024-12-11T20:01:07,737 adding 'verl/utils/reward_score/__init__.py' 2024-12-11T20:01:07,738 adding 'verl/utils/reward_score/gsm8k.py' 2024-12-11T20:01:07,740 adding 'verl/utils/reward_score/math.py' 2024-12-11T20:01:07,741 adding 'verl/version/version' 2024-12-11T20:01:07,744 adding 'verl-0.1.dist-info/LICENSE' 2024-12-11T20:01:07,746 adding 'verl-0.1.dist-info/METADATA' 2024-12-11T20:01:07,747 adding 'verl-0.1.dist-info/WHEEL' 2024-12-11T20:01:07,748 adding 'verl-0.1.dist-info/top_level.txt' 2024-12-11T20:01:07,751 adding 'verl-0.1.dist-info/RECORD' 2024-12-11T20:01:07,758 removing build/bdist.linux-armv7l/wheel 2024-12-11T20:01:07,925 Building wheel for verl (setup.py): finished with status 'done' 2024-12-11T20:01:07,932 Created wheel for verl: filename=verl-0.1-py3-none-any.whl size=371460 sha256=177438b82ac0f29bd23daf0c03a6d3689dc2cf5b0bd103d8fb4143558caaf8dd 2024-12-11T20:01:07,933 Stored in directory: /tmp/pip-ephem-wheel-cache-m4ejc4zg/wheels/f7/d4/80/7f0fd98de4a1f01d4ed2e0d9b71e37d28ac38d4f0afaf57c70 2024-12-11T20:01:07,950 Successfully built verl 2024-12-11T20:01:07,966 Removed build tracker: '/tmp/pip-build-tracker-wv8eh6sv'