2024-12-11T19:59:13,977 Created temporary directory: /tmp/pip-build-tracker-00n69ypk 2024-12-11T19:59:13,979 Initialized build tracking at /tmp/pip-build-tracker-00n69ypk 2024-12-11T19:59:13,979 Created build tracker: /tmp/pip-build-tracker-00n69ypk 2024-12-11T19:59:13,980 Entered build tracker: /tmp/pip-build-tracker-00n69ypk 2024-12-11T19:59:13,981 Created temporary directory: /tmp/pip-wheel-yzrybtmo 2024-12-11T19:59:13,984 Created temporary directory: /tmp/pip-ephem-wheel-cache-se7zk664 2024-12-11T19:59:14,031 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-11T19:59:14,034 2 location(s) to search for versions of verl: 2024-12-11T19:59:14,034 * https://pypi.org/simple/verl/ 2024-12-11T19:59:14,034 * https://www.piwheels.org/simple/verl/ 2024-12-11T19:59:14,034 Fetching project page and analyzing links: https://pypi.org/simple/verl/ 2024-12-11T19:59:14,035 Getting page https://pypi.org/simple/verl/ 2024-12-11T19:59:14,037 Found index url https://pypi.org/simple/ 2024-12-11T19:59:14,260 Fetched page https://pypi.org/simple/verl/ as application/vnd.pypi.simple.v1+json 2024-12-11T19:59:14,262 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/9f/86/496edb88346dafe6a0476247aae75f6ec1662af25c077d03026dc7cd9edf/verl-0.1rc0-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T19:59:14,262 Found link https://files.pythonhosted.org/packages/c3/1e/f08abc3db1fade00aac8797d5e21bbc3f198cc91d64772ba219cea0d9a3a/verl-0.1rc0.tar.gz (from https://pypi.org/simple/verl/), version: 0.1rc0 2024-12-11T19:59:14,263 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/b9/b3/f9912b1e4a833dfe0e83f99088f7ea530a593d98f47eecb3bd091ec77137/verl-0.1rc2-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T19:59:14,264 Found link https://files.pythonhosted.org/packages/49/9f/d2ab2587b09b449b792db6975fe499724b79bea47213a76729cdd5efa112/verl-0.1rc2.tar.gz (from https://pypi.org/simple/verl/), version: 0.1rc2 2024-12-11T19:59:14,264 Skipping link: No binaries permitted for verl: https://files.pythonhosted.org/packages/6f/70/86b0ed59aec2376ac9c0ee6bf11a364212b657b1489080d495a7e904fe14/verl-0.1-py2.py3-none-any.whl (from https://pypi.org/simple/verl/) 2024-12-11T19:59:14,265 Found link https://files.pythonhosted.org/packages/0d/75/9566144efde887c1eb88874e4952b70fc0491345cc75dd6da12217d0a053/verl-0.1.tar.gz (from https://pypi.org/simple/verl/), version: 0.1 2024-12-11T19:59:14,265 Fetching project page and analyzing links: https://www.piwheels.org/simple/verl/ 2024-12-11T19:59:14,266 Getting page https://www.piwheels.org/simple/verl/ 2024-12-11T19:59:14,268 Found index url https://www.piwheels.org/simple/ 2024-12-11T19:59:14,453 Fetched page https://www.piwheels.org/simple/verl/ as text/html 2024-12-11T19:59:14,455 Skipping link: No binaries permitted for verl: https://www.piwheels.org/simple/verl/verl-0.1rc0-py3-none-any.whl#sha256=62d25a38487e84cf2bdd4add756e1011e625dfccbee891d4e8ee0f78a3a7508e (from https://www.piwheels.org/simple/verl/) 2024-12-11T19:59:14,456 Skipping link: not a file: https://www.piwheels.org/simple/verl/ 2024-12-11T19:59:14,457 Skipping link: not a file: https://pypi.org/simple/verl/ 2024-12-11T19:59:14,477 Given no hashes to check 1 links for project 'verl': discarding no candidates 2024-12-11T19:59:14,479 Collecting verl==0.1rc2 2024-12-11T19:59:14,482 Created temporary directory: /tmp/pip-unpack-w631r80a 2024-12-11T19:59:14,809 Downloading verl-0.1rc2.tar.gz (249 kB) 2024-12-11T19:59:15,248 Added verl==0.1rc2 from https://files.pythonhosted.org/packages/49/9f/d2ab2587b09b449b792db6975fe499724b79bea47213a76729cdd5efa112/verl-0.1rc2.tar.gz to build tracker '/tmp/pip-build-tracker-00n69ypk' 2024-12-11T19:59:15,250 Running setup.py (path:/tmp/pip-wheel-yzrybtmo/verl_e1ef487e3b3447deb3863b6f5702872b/setup.py) egg_info for package verl 2024-12-11T19:59:15,251 Created temporary directory: /tmp/pip-pip-egg-info-7f1tyma2 2024-12-11T19:59:15,252 Preparing metadata (setup.py): started 2024-12-11T19:59:15,253 Running command python setup.py egg_info 2024-12-11T19:59:16,333 running egg_info 2024-12-11T19:59:16,361 creating /tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info 2024-12-11T19:59:16,362 writing /tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/PKG-INFO 2024-12-11T19:59:16,368 writing dependency_links to /tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/dependency_links.txt 2024-12-11T19:59:16,372 writing requirements to /tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/requires.txt 2024-12-11T19:59:16,373 writing top-level names to /tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/top_level.txt 2024-12-11T19:59:16,375 writing manifest file '/tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/SOURCES.txt' 2024-12-11T19:59:16,510 reading manifest file '/tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/SOURCES.txt' 2024-12-11T19:59:16,512 adding license file 'LICENSE' 2024-12-11T19:59:16,520 writing manifest file '/tmp/pip-pip-egg-info-7f1tyma2/verl.egg-info/SOURCES.txt' 2024-12-11T19:59:16,629 Preparing metadata (setup.py): finished with status 'done' 2024-12-11T19:59:16,633 Source in /tmp/pip-wheel-yzrybtmo/verl_e1ef487e3b3447deb3863b6f5702872b has version 0.1rc2, which satisfies requirement verl==0.1rc2 from https://files.pythonhosted.org/packages/49/9f/d2ab2587b09b449b792db6975fe499724b79bea47213a76729cdd5efa112/verl-0.1rc2.tar.gz 2024-12-11T19:59:16,634 Removed verl==0.1rc2 from https://files.pythonhosted.org/packages/49/9f/d2ab2587b09b449b792db6975fe499724b79bea47213a76729cdd5efa112/verl-0.1rc2.tar.gz from build tracker '/tmp/pip-build-tracker-00n69ypk' 2024-12-11T19:59:16,644 Created temporary directory: /tmp/pip-unpack-mpp6371p 2024-12-11T19:59:16,645 Created temporary directory: /tmp/pip-unpack-kxxss6zk 2024-12-11T19:59:16,645 Building wheels for collected packages: verl 2024-12-11T19:59:16,649 Created temporary directory: /tmp/pip-wheel-rgbwzt5x 2024-12-11T19:59:16,650 Building wheel for verl (setup.py): started 2024-12-11T19:59:16,651 Destination directory: /tmp/pip-wheel-rgbwzt5x 2024-12-11T19:59:16,652 Running command python setup.py bdist_wheel 2024-12-11T19:59:17,677 running bdist_wheel 2024-12-11T19:59:17,806 running build 2024-12-11T19:59:17,806 running build_py 2024-12-11T19:59:17,836 creating build/lib/verl 2024-12-11T19:59:17,839 copying ./verl/protocol.py -> build/lib/verl 2024-12-11T19:59:17,841 copying ./verl/__init__.py -> build/lib/verl 2024-12-11T19:59:17,844 creating build/lib/verl/models 2024-12-11T19:59:17,845 copying ./verl/models/__init__.py -> build/lib/verl/models 2024-12-11T19:59:17,847 copying ./verl/models/weight_loader_registry.py -> build/lib/verl/models 2024-12-11T19:59:17,849 copying ./verl/models/registry.py -> build/lib/verl/models 2024-12-11T19:59:17,852 creating build/lib/verl/trainer 2024-12-11T19:59:17,853 copying ./verl/trainer/fsdp_sft_trainer.py -> build/lib/verl/trainer 2024-12-11T19:59:17,855 copying ./verl/trainer/__init__.py -> build/lib/verl/trainer 2024-12-11T19:59:17,857 copying ./verl/trainer/main_generation.py -> build/lib/verl/trainer 2024-12-11T19:59:17,860 copying ./verl/trainer/main_ppo.py -> build/lib/verl/trainer 2024-12-11T19:59:17,862 copying ./verl/trainer/main_eval.py -> build/lib/verl/trainer 2024-12-11T19:59:17,864 creating build/lib/verl/single_controller 2024-12-11T19:59:17,865 copying ./verl/single_controller/__init__.py -> build/lib/verl/single_controller 2024-12-11T19:59:17,868 creating build/lib/verl/utils 2024-12-11T19:59:17,869 copying ./verl/utils/fs.py -> build/lib/verl/utils 2024-12-11T19:59:17,871 copying ./verl/utils/tracking.py -> build/lib/verl/utils 2024-12-11T19:59:17,873 copying ./verl/utils/config.py -> build/lib/verl/utils 2024-12-11T19:59:17,875 copying ./verl/utils/logging_utils.py -> build/lib/verl/utils 2024-12-11T19:59:17,877 copying ./verl/utils/tokenizer.py -> build/lib/verl/utils 2024-12-11T19:59:17,879 copying ./verl/utils/torch_dtypes.py -> build/lib/verl/utils 2024-12-11T19:59:17,880 copying ./verl/utils/__init__.py -> build/lib/verl/utils 2024-12-11T19:59:17,882 copying ./verl/utils/memory_buffer.py -> build/lib/verl/utils 2024-12-11T19:59:17,885 copying ./verl/utils/py_functional.py -> build/lib/verl/utils 2024-12-11T19:59:17,887 copying ./verl/utils/ray_utils.py -> build/lib/verl/utils 2024-12-11T19:59:17,889 copying ./verl/utils/distributed.py -> build/lib/verl/utils 2024-12-11T19:59:17,891 copying ./verl/utils/megatron_utils.py -> build/lib/verl/utils 2024-12-11T19:59:17,893 copying ./verl/utils/import_utils.py -> build/lib/verl/utils 2024-12-11T19:59:17,895 copying ./verl/utils/fsdp_utils.py -> build/lib/verl/utils 2024-12-11T19:59:17,897 copying ./verl/utils/hdfs_io.py -> build/lib/verl/utils 2024-12-11T19:59:17,899 copying ./verl/utils/torch_functional.py -> build/lib/verl/utils 2024-12-11T19:59:17,901 copying ./verl/utils/model.py -> build/lib/verl/utils 2024-12-11T19:59:17,904 creating build/lib/verl/third_party 2024-12-11T19:59:17,905 copying ./verl/third_party/__init__.py -> build/lib/verl/third_party 2024-12-11T19:59:17,907 creating build/lib/verl/models/llama 2024-12-11T19:59:17,908 copying ./verl/models/llama/__init__.py -> build/lib/verl/models/llama 2024-12-11T19:59:17,911 creating build/lib/verl/models/llama/megatron 2024-12-11T19:59:17,912 copying ./verl/models/llama/megatron/__init__.py -> build/lib/verl/models/llama/megatron 2024-12-11T19:59:17,914 copying ./verl/models/llama/megatron/modeling_llama_megatron.py -> build/lib/verl/models/llama/megatron 2024-12-11T19:59:17,917 creating build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:17,918 copying ./verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:17,920 copying ./verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:17,922 copying ./verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/lib/verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:17,925 creating build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,926 copying ./verl/models/llama/megatron/layers/parallel_attention.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,929 copying ./verl/models/llama/megatron/layers/parallel_linear.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,931 copying ./verl/models/llama/megatron/layers/__init__.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,933 copying ./verl/models/llama/megatron/layers/parallel_mlp.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,935 copying ./verl/models/llama/megatron/layers/parallel_decoder.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,937 copying ./verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/lib/verl/models/llama/megatron/layers 2024-12-11T19:59:17,940 creating build/lib/verl/trainer/ppo 2024-12-11T19:59:17,941 copying ./verl/trainer/ppo/ray_trainer.py -> build/lib/verl/trainer/ppo 2024-12-11T19:59:17,943 copying ./verl/trainer/ppo/__init__.py -> build/lib/verl/trainer/ppo 2024-12-11T19:59:17,945 copying ./verl/trainer/ppo/core_algos.py -> build/lib/verl/trainer/ppo 2024-12-11T19:59:17,948 creating build/lib/verl/trainer/ppo/reward_model 2024-12-11T19:59:17,949 copying ./verl/trainer/ppo/reward_model/__init__.py -> build/lib/verl/trainer/ppo/reward_model 2024-12-11T19:59:17,951 copying ./verl/trainer/ppo/reward_model/base.py -> build/lib/verl/trainer/ppo/reward_model 2024-12-11T19:59:17,953 creating build/lib/verl/trainer/ppo/actor 2024-12-11T19:59:17,954 copying ./verl/trainer/ppo/actor/__init__.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T19:59:17,956 copying ./verl/trainer/ppo/actor/dp_actor.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T19:59:17,958 copying ./verl/trainer/ppo/actor/base.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T19:59:17,960 copying ./verl/trainer/ppo/actor/megatron_actor.py -> build/lib/verl/trainer/ppo/actor 2024-12-11T19:59:17,963 creating build/lib/verl/trainer/ppo/workers 2024-12-11T19:59:17,964 copying ./verl/trainer/ppo/workers/__init__.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T19:59:17,966 copying ./verl/trainer/ppo/workers/megatron_workers.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T19:59:17,969 copying ./verl/trainer/ppo/workers/fsdp_workers.py -> build/lib/verl/trainer/ppo/workers 2024-12-11T19:59:17,972 creating build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:17,973 copying ./verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:17,976 copying ./verl/trainer/ppo/hybrid_engine/__init__.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:17,977 copying ./verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:17,980 copying ./verl/trainer/ppo/hybrid_engine/base.py -> build/lib/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:17,982 creating build/lib/verl/trainer/ppo/critic 2024-12-11T19:59:17,983 copying ./verl/trainer/ppo/critic/__init__.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T19:59:17,985 copying ./verl/trainer/ppo/critic/dp_critic.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T19:59:17,987 copying ./verl/trainer/ppo/critic/base.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T19:59:17,989 copying ./verl/trainer/ppo/critic/megatron_critic.py -> build/lib/verl/trainer/ppo/critic 2024-12-11T19:59:17,992 creating build/lib/verl/trainer/ppo/rollout 2024-12-11T19:59:17,993 copying ./verl/trainer/ppo/rollout/tokenizer.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T19:59:17,995 copying ./verl/trainer/ppo/rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T19:59:17,997 copying ./verl/trainer/ppo/rollout/base.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T19:59:17,999 copying ./verl/trainer/ppo/rollout/hf_rollout.py -> build/lib/verl/trainer/ppo/rollout 2024-12-11T19:59:18,002 creating build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,003 copying ./verl/trainer/ppo/reward_model/megatron/__init__.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,005 copying ./verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/lib/verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,008 creating build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,009 copying ./verl/trainer/ppo/rollout/naive/__init__.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,011 copying ./verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/lib/verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,014 creating build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,015 copying ./verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,018 copying ./verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/lib/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,020 creating build/lib/verl/trainer/ppo/rollout/megatron 2024-12-11T19:59:18,021 copying ./verl/trainer/ppo/rollout/megatron/__init__.py -> build/lib/verl/trainer/ppo/rollout/megatron 2024-12-11T19:59:18,023 creating build/lib/verl/single_controller/ray 2024-12-11T19:59:18,025 copying ./verl/single_controller/ray/decorator.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,027 copying ./verl/single_controller/ray/__init__.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,028 copying ./verl/single_controller/ray/dist_data_pass_protocol.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,031 copying ./verl/single_controller/ray/dp.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,032 copying ./verl/single_controller/ray/base.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,035 copying ./verl/single_controller/ray/megatron.py -> build/lib/verl/single_controller/ray 2024-12-11T19:59:18,038 creating build/lib/verl/single_controller/base 2024-12-11T19:59:18,039 copying ./verl/single_controller/base/decorator.py -> build/lib/verl/single_controller/base 2024-12-11T19:59:18,042 copying ./verl/single_controller/base/__init__.py -> build/lib/verl/single_controller/base 2024-12-11T19:59:18,043 copying ./verl/single_controller/base/worker_group.py -> build/lib/verl/single_controller/base 2024-12-11T19:59:18,046 copying ./verl/single_controller/base/dp.py -> build/lib/verl/single_controller/base 2024-12-11T19:59:18,047 copying ./verl/single_controller/base/worker.py -> build/lib/verl/single_controller/base 2024-12-11T19:59:18,050 creating build/lib/verl/single_controller/base/megatron 2024-12-11T19:59:18,051 copying ./verl/single_controller/base/megatron/__init__.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T19:59:18,053 copying ./verl/single_controller/base/megatron/worker_group.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T19:59:18,055 copying ./verl/single_controller/base/megatron/worker.py -> build/lib/verl/single_controller/base/megatron 2024-12-11T19:59:18,057 creating build/lib/verl/single_controller/base/register_center 2024-12-11T19:59:18,058 copying ./verl/single_controller/base/register_center/__init__.py -> build/lib/verl/single_controller/base/register_center 2024-12-11T19:59:18,060 copying ./verl/single_controller/base/register_center/ray.py -> build/lib/verl/single_controller/base/register_center 2024-12-11T19:59:18,063 creating build/lib/verl/utils/rendezvous 2024-12-11T19:59:18,064 copying ./verl/utils/rendezvous/ray_backend.py -> build/lib/verl/utils/rendezvous 2024-12-11T19:59:18,066 copying ./verl/utils/rendezvous/__init__.py -> build/lib/verl/utils/rendezvous 2024-12-11T19:59:18,068 creating build/lib/verl/utils/debug 2024-12-11T19:59:18,069 copying ./verl/utils/debug/__init__.py -> build/lib/verl/utils/debug 2024-12-11T19:59:18,071 copying ./verl/utils/debug/trajectory_tracker.py -> build/lib/verl/utils/debug 2024-12-11T19:59:18,073 copying ./verl/utils/debug/performance.py -> build/lib/verl/utils/debug 2024-12-11T19:59:18,076 creating build/lib/verl/utils/dataset 2024-12-11T19:59:18,077 copying ./verl/utils/dataset/rl_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T19:59:18,080 copying ./verl/utils/dataset/__init__.py -> build/lib/verl/utils/dataset 2024-12-11T19:59:18,082 copying ./verl/utils/dataset/sft_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T19:59:18,084 copying ./verl/utils/dataset/rm_dataset.py -> build/lib/verl/utils/dataset 2024-12-11T19:59:18,087 creating build/lib/verl/utils/megatron 2024-12-11T19:59:18,088 copying ./verl/utils/megatron/memory.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,090 copying ./verl/utils/megatron/pipeline_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,091 copying ./verl/utils/megatron/optimizer_config.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,093 copying ./verl/utils/megatron/__init__.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,095 copying ./verl/utils/megatron/optimizer.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,097 copying ./verl/utils/megatron/sequence_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,099 copying ./verl/utils/megatron/tensor_parallel.py -> build/lib/verl/utils/megatron 2024-12-11T19:59:18,102 creating build/lib/verl/utils/logger 2024-12-11T19:59:18,103 copying ./verl/utils/logger/__init__.py -> build/lib/verl/utils/logger 2024-12-11T19:59:18,104 copying ./verl/utils/logger/aggregate_logger.py -> build/lib/verl/utils/logger 2024-12-11T19:59:18,107 creating build/lib/verl/utils/reward_score 2024-12-11T19:59:18,108 copying ./verl/utils/reward_score/math.py -> build/lib/verl/utils/reward_score 2024-12-11T19:59:18,111 copying ./verl/utils/reward_score/__init__.py -> build/lib/verl/utils/reward_score 2024-12-11T19:59:18,112 copying ./verl/utils/reward_score/gsm8k.py -> build/lib/verl/utils/reward_score 2024-12-11T19:59:18,115 creating build/lib/verl/third_party/vllm 2024-12-11T19:59:18,116 copying ./verl/third_party/vllm/__init__.py -> build/lib/verl/third_party/vllm 2024-12-11T19:59:18,119 creating build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,120 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,122 copying ./verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,124 copying ./verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,126 copying ./verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,128 copying ./verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,130 copying ./verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,132 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,134 copying ./verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,137 copying ./verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,139 copying ./verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,141 copying ./verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,144 copying ./verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,146 copying ./verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,148 copying ./verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,152 creating build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,153 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,155 copying ./verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,158 copying ./verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,160 copying ./verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,162 copying ./verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,164 copying ./verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,166 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,168 copying ./verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,171 copying ./verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,173 copying ./verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,175 copying ./verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,178 copying ./verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,180 copying ./verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,183 copying ./verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,186 creating build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,187 copying ./verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,190 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,192 copying ./verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,195 copying ./verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,196 copying ./verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,198 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,201 copying ./verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,203 copying ./verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,205 copying ./verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,208 copying ./verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,211 copying ./verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,214 creating build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,215 copying ./verl/third_party/vllm/vllm_v_0_6_3/model_runner.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,217 copying ./verl/third_party/vllm/vllm_v_0_6_3/config.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,219 copying ./verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,221 copying ./verl/third_party/vllm/vllm_v_0_6_3/__init__.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,223 copying ./verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,226 copying ./verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,228 copying ./verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,230 copying ./verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,233 copying ./verl/third_party/vllm/vllm_v_0_6_3/llm.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,235 copying ./verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,238 copying ./verl/third_party/vllm/vllm_v_0_6_3/model_loader.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,241 copying ./verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,244 copying ./verl/third_party/vllm/vllm_v_0_6_3/worker.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,246 copying ./verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py -> build/lib/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,249 running egg_info 2024-12-11T19:59:18,279 writing verl.egg-info/PKG-INFO 2024-12-11T19:59:18,285 writing dependency_links to verl.egg-info/dependency_links.txt 2024-12-11T19:59:18,288 writing requirements to verl.egg-info/requires.txt 2024-12-11T19:59:18,289 writing top-level names to verl.egg-info/top_level.txt 2024-12-11T19:59:18,353 reading manifest file 'verl.egg-info/SOURCES.txt' 2024-12-11T19:59:18,375 adding license file 'LICENSE' 2024-12-11T19:59:18,390 writing manifest file 'verl.egg-info/SOURCES.txt' 2024-12-11T19:59:18,393 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.single_controller.version' is absent from the `packages` configuration. 2024-12-11T19:59:18,394 !! 2024-12-11T19:59:18,395 ******************************************************************************** 2024-12-11T19:59:18,395 ############################ 2024-12-11T19:59:18,396 # Package would be ignored # 2024-12-11T19:59:18,396 ############################ 2024-12-11T19:59:18,396 Python recognizes 'verl.single_controller.version' as an importable package[^1], 2024-12-11T19:59:18,397 but it is absent from setuptools' `packages` configuration. 2024-12-11T19:59:18,398 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T19:59:18,398 package, please make sure that 'verl.single_controller.version' is explicitly added 2024-12-11T19:59:18,398 to the `packages` configuration field. 2024-12-11T19:59:18,399 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T19:59:18,399 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T19:59:18,400 instead of `find_packages(...)`/`find:`). 2024-12-11T19:59:18,401 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T19:59:18,402 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T19:59:18,403 If you don't want 'verl.single_controller.version' to be distributed and are 2024-12-11T19:59:18,403 already explicitly excluding 'verl.single_controller.version' via 2024-12-11T19:59:18,403 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T19:59:18,404 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T19:59:18,405 combination with a more fine grained `package-data` configuration. 2024-12-11T19:59:18,406 You can read more about "package data files" on setuptools documentation page: 2024-12-11T19:59:18,407 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T19:59:18,408 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T19:59:18,409 even if it does not contain any `.py` files. 2024-12-11T19:59:18,410 On the other hand, currently there is no concept of package data 2024-12-11T19:59:18,410 directory, all directories are treated like packages. 2024-12-11T19:59:18,411 ******************************************************************************** 2024-12-11T19:59:18,412 !! 2024-12-11T19:59:18,412 check.warn(importable) 2024-12-11T19:59:18,413 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.trainer.config' is absent from the `packages` configuration. 2024-12-11T19:59:18,414 !! 2024-12-11T19:59:18,415 ******************************************************************************** 2024-12-11T19:59:18,415 ############################ 2024-12-11T19:59:18,416 # Package would be ignored # 2024-12-11T19:59:18,416 ############################ 2024-12-11T19:59:18,417 Python recognizes 'verl.trainer.config' as an importable package[^1], 2024-12-11T19:59:18,418 but it is absent from setuptools' `packages` configuration. 2024-12-11T19:59:18,419 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T19:59:18,419 package, please make sure that 'verl.trainer.config' is explicitly added 2024-12-11T19:59:18,420 to the `packages` configuration field. 2024-12-11T19:59:18,421 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T19:59:18,422 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T19:59:18,422 instead of `find_packages(...)`/`find:`). 2024-12-11T19:59:18,424 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T19:59:18,424 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T19:59:18,425 If you don't want 'verl.trainer.config' to be distributed and are 2024-12-11T19:59:18,426 already explicitly excluding 'verl.trainer.config' via 2024-12-11T19:59:18,426 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T19:59:18,426 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T19:59:18,427 combination with a more fine grained `package-data` configuration. 2024-12-11T19:59:18,428 You can read more about "package data files" on setuptools documentation page: 2024-12-11T19:59:18,429 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T19:59:18,430 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T19:59:18,430 even if it does not contain any `.py` files. 2024-12-11T19:59:18,431 On the other hand, currently there is no concept of package data 2024-12-11T19:59:18,431 directory, all directories are treated like packages. 2024-12-11T19:59:18,432 ******************************************************************************** 2024-12-11T19:59:18,433 !! 2024-12-11T19:59:18,433 check.warn(importable) 2024-12-11T19:59:18,434 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:220: _Warning: Package 'verl.version' is absent from the `packages` configuration. 2024-12-11T19:59:18,434 !! 2024-12-11T19:59:18,435 ******************************************************************************** 2024-12-11T19:59:18,435 ############################ 2024-12-11T19:59:18,436 # Package would be ignored # 2024-12-11T19:59:18,436 ############################ 2024-12-11T19:59:18,437 Python recognizes 'verl.version' as an importable package[^1], 2024-12-11T19:59:18,438 but it is absent from setuptools' `packages` configuration. 2024-12-11T19:59:18,438 This leads to an ambiguous overall configuration. If you want to distribute this 2024-12-11T19:59:18,439 package, please make sure that 'verl.version' is explicitly added 2024-12-11T19:59:18,440 to the `packages` configuration field. 2024-12-11T19:59:18,441 Alternatively, you can also rely on setuptools' discovery methods 2024-12-11T19:59:18,441 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-12-11T19:59:18,442 instead of `find_packages(...)`/`find:`). 2024-12-11T19:59:18,443 You can read more about "package discovery" on setuptools documentation page: 2024-12-11T19:59:18,444 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-12-11T19:59:18,445 If you don't want 'verl.version' to be distributed and are 2024-12-11T19:59:18,446 already explicitly excluding 'verl.version' via 2024-12-11T19:59:18,446 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-12-11T19:59:18,446 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-12-11T19:59:18,447 combination with a more fine grained `package-data` configuration. 2024-12-11T19:59:18,448 You can read more about "package data files" on setuptools documentation page: 2024-12-11T19:59:18,449 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-12-11T19:59:18,451 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-12-11T19:59:18,451 even if it does not contain any `.py` files. 2024-12-11T19:59:18,452 On the other hand, currently there is no concept of package data 2024-12-11T19:59:18,452 directory, all directories are treated like packages. 2024-12-11T19:59:18,453 ******************************************************************************** 2024-12-11T19:59:18,454 !! 2024-12-11T19:59:18,455 check.warn(importable) 2024-12-11T19:59:18,455 creating build/lib/verl/version 2024-12-11T19:59:18,455 copying ./verl/version/version -> build/lib/verl/version 2024-12-11T19:59:18,456 creating build/lib/verl/trainer/config 2024-12-11T19:59:18,456 copying ./verl/trainer/config/sft_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T19:59:18,456 copying ./verl/trainer/config/ppo_megatron_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T19:59:18,457 copying ./verl/trainer/config/ppo_trainer.yaml -> build/lib/verl/trainer/config 2024-12-11T19:59:18,457 copying ./verl/trainer/config/evaluation.yaml -> build/lib/verl/trainer/config 2024-12-11T19:59:18,458 copying ./verl/trainer/config/generation.yaml -> build/lib/verl/trainer/config 2024-12-11T19:59:18,458 creating build/lib/verl/single_controller/version 2024-12-11T19:59:18,459 copying ./verl/single_controller/version/version -> build/lib/verl/single_controller/version 2024-12-11T19:59:18,497 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-12-11T19:59:18,498 !! 2024-12-11T19:59:18,499 ******************************************************************************** 2024-12-11T19:59:18,500 Please avoid running ``setup.py`` directly. 2024-12-11T19:59:18,500 Instead, use pypa/build, pypa/installer or other 2024-12-11T19:59:18,501 standards-based tools. 2024-12-11T19:59:18,502 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-12-11T19:59:18,502 ******************************************************************************** 2024-12-11T19:59:18,503 !! 2024-12-11T19:59:18,504 self.initialize_options() 2024-12-11T19:59:18,525 installing to build/bdist.linux-armv7l/wheel 2024-12-11T19:59:18,525 running install 2024-12-11T19:59:18,549 running install_lib 2024-12-11T19:59:18,576 creating build/bdist.linux-armv7l/wheel 2024-12-11T19:59:18,578 creating build/bdist.linux-armv7l/wheel/verl 2024-12-11T19:59:18,580 copying build/lib/verl/protocol.py -> build/bdist.linux-armv7l/wheel/./verl 2024-12-11T19:59:18,583 creating build/bdist.linux-armv7l/wheel/verl/models 2024-12-11T19:59:18,585 copying build/lib/verl/models/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T19:59:18,588 copying build/lib/verl/models/weight_loader_registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T19:59:18,590 copying build/lib/verl/models/registry.py -> build/bdist.linux-armv7l/wheel/./verl/models 2024-12-11T19:59:18,593 creating build/bdist.linux-armv7l/wheel/verl/models/llama 2024-12-11T19:59:18,594 copying build/lib/verl/models/llama/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama 2024-12-11T19:59:18,596 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron 2024-12-11T19:59:18,598 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:18,599 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_saver.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:18,602 copying build/lib/verl/models/llama/megatron/checkpoint_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:18,604 copying build/lib/verl/models/llama/megatron/checkpoint_utils/llama_loader.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/checkpoint_utils 2024-12-11T19:59:18,607 copying build/lib/verl/models/llama/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-12-11T19:59:18,608 copying build/lib/verl/models/llama/megatron/modeling_llama_megatron.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron 2024-12-11T19:59:18,611 creating build/bdist.linux-armv7l/wheel/verl/models/llama/megatron/layers 2024-12-11T19:59:18,613 copying build/lib/verl/models/llama/megatron/layers/parallel_attention.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,615 copying build/lib/verl/models/llama/megatron/layers/parallel_linear.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,617 copying build/lib/verl/models/llama/megatron/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,619 copying build/lib/verl/models/llama/megatron/layers/parallel_mlp.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,621 copying build/lib/verl/models/llama/megatron/layers/parallel_decoder.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,623 copying build/lib/verl/models/llama/megatron/layers/parallel_rmsnorm.py -> build/bdist.linux-armv7l/wheel/./verl/models/llama/megatron/layers 2024-12-11T19:59:18,625 creating build/bdist.linux-armv7l/wheel/verl/trainer 2024-12-11T19:59:18,626 copying build/lib/verl/trainer/fsdp_sft_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T19:59:18,629 copying build/lib/verl/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T19:59:18,631 copying build/lib/verl/trainer/main_generation.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T19:59:18,633 copying build/lib/verl/trainer/main_ppo.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T19:59:18,635 creating build/bdist.linux-armv7l/wheel/verl/trainer/config 2024-12-11T19:59:18,636 copying build/lib/verl/trainer/config/sft_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T19:59:18,638 copying build/lib/verl/trainer/config/ppo_megatron_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T19:59:18,640 copying build/lib/verl/trainer/config/ppo_trainer.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T19:59:18,642 copying build/lib/verl/trainer/config/evaluation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T19:59:18,644 copying build/lib/verl/trainer/config/generation.yaml -> build/bdist.linux-armv7l/wheel/./verl/trainer/config 2024-12-11T19:59:18,647 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo 2024-12-11T19:59:18,648 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model 2024-12-11T19:59:18,650 copying build/lib/verl/trainer/ppo/reward_model/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-12-11T19:59:18,652 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,653 copying build/lib/verl/trainer/ppo/reward_model/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,655 copying build/lib/verl/trainer/ppo/reward_model/megatron/reward_model.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model/megatron 2024-12-11T19:59:18,658 copying build/lib/verl/trainer/ppo/reward_model/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/reward_model 2024-12-11T19:59:18,660 copying build/lib/verl/trainer/ppo/ray_trainer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T19:59:18,663 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/actor 2024-12-11T19:59:18,664 copying build/lib/verl/trainer/ppo/actor/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T19:59:18,666 copying build/lib/verl/trainer/ppo/actor/dp_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T19:59:18,668 copying build/lib/verl/trainer/ppo/actor/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T19:59:18,670 copying build/lib/verl/trainer/ppo/actor/megatron_actor.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/actor 2024-12-11T19:59:18,673 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/workers 2024-12-11T19:59:18,675 copying build/lib/verl/trainer/ppo/workers/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T19:59:18,677 copying build/lib/verl/trainer/ppo/workers/megatron_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T19:59:18,679 copying build/lib/verl/trainer/ppo/workers/fsdp_workers.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/workers 2024-12-11T19:59:18,682 copying build/lib/verl/trainer/ppo/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T19:59:18,684 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:18,685 copying build/lib/verl/trainer/ppo/hybrid_engine/megatron_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:18,688 copying build/lib/verl/trainer/ppo/hybrid_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:18,690 copying build/lib/verl/trainer/ppo/hybrid_engine/fsdp_vllm.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:18,692 copying build/lib/verl/trainer/ppo/hybrid_engine/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/hybrid_engine 2024-12-11T19:59:18,694 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/critic 2024-12-11T19:59:18,695 copying build/lib/verl/trainer/ppo/critic/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T19:59:18,697 copying build/lib/verl/trainer/ppo/critic/dp_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T19:59:18,699 copying build/lib/verl/trainer/ppo/critic/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T19:59:18,701 copying build/lib/verl/trainer/ppo/critic/megatron_critic.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/critic 2024-12-11T19:59:18,704 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout 2024-12-11T19:59:18,706 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,707 copying build/lib/verl/trainer/ppo/rollout/naive/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,709 copying build/lib/verl/trainer/ppo/rollout/naive/naive_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/naive 2024-12-11T19:59:18,711 copying build/lib/verl/trainer/ppo/rollout/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T19:59:18,714 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,715 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,718 copying build/lib/verl/trainer/ppo/rollout/vllm_rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/vllm_rollout 2024-12-11T19:59:18,720 copying build/lib/verl/trainer/ppo/rollout/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T19:59:18,722 creating build/bdist.linux-armv7l/wheel/verl/trainer/ppo/rollout/megatron 2024-12-11T19:59:18,723 copying build/lib/verl/trainer/ppo/rollout/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout/megatron 2024-12-11T19:59:18,725 copying build/lib/verl/trainer/ppo/rollout/base.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T19:59:18,727 copying build/lib/verl/trainer/ppo/rollout/hf_rollout.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo/rollout 2024-12-11T19:59:18,729 copying build/lib/verl/trainer/ppo/core_algos.py -> build/bdist.linux-armv7l/wheel/./verl/trainer/ppo 2024-12-11T19:59:18,731 copying build/lib/verl/trainer/main_eval.py -> build/bdist.linux-armv7l/wheel/./verl/trainer 2024-12-11T19:59:18,734 copying build/lib/verl/__init__.py -> build/bdist.linux-armv7l/wheel/./verl 2024-12-11T19:59:18,736 creating build/bdist.linux-armv7l/wheel/verl/version 2024-12-11T19:59:18,737 copying build/lib/verl/version/version -> build/bdist.linux-armv7l/wheel/./verl/version 2024-12-11T19:59:18,740 creating build/bdist.linux-armv7l/wheel/verl/single_controller 2024-12-11T19:59:18,741 copying build/lib/verl/single_controller/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller 2024-12-11T19:59:18,743 creating build/bdist.linux-armv7l/wheel/verl/single_controller/version 2024-12-11T19:59:18,744 copying build/lib/verl/single_controller/version/version -> build/bdist.linux-armv7l/wheel/./verl/single_controller/version 2024-12-11T19:59:18,746 creating build/bdist.linux-armv7l/wheel/verl/single_controller/ray 2024-12-11T19:59:18,747 copying build/lib/verl/single_controller/ray/decorator.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,749 copying build/lib/verl/single_controller/ray/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,751 copying build/lib/verl/single_controller/ray/dist_data_pass_protocol.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,753 copying build/lib/verl/single_controller/ray/dp.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,755 copying build/lib/verl/single_controller/ray/base.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,757 copying build/lib/verl/single_controller/ray/megatron.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/ray 2024-12-11T19:59:18,760 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base 2024-12-11T19:59:18,761 copying build/lib/verl/single_controller/base/decorator.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T19:59:18,763 copying build/lib/verl/single_controller/base/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T19:59:18,765 copying build/lib/verl/single_controller/base/worker_group.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T19:59:18,768 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base/megatron 2024-12-11T19:59:18,769 copying build/lib/verl/single_controller/base/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T19:59:18,771 copying build/lib/verl/single_controller/base/megatron/worker_group.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T19:59:18,773 copying build/lib/verl/single_controller/base/megatron/worker.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/megatron 2024-12-11T19:59:18,775 copying build/lib/verl/single_controller/base/dp.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T19:59:18,776 copying build/lib/verl/single_controller/base/worker.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base 2024-12-11T19:59:18,780 creating build/bdist.linux-armv7l/wheel/verl/single_controller/base/register_center 2024-12-11T19:59:18,781 copying build/lib/verl/single_controller/base/register_center/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/register_center 2024-12-11T19:59:18,783 copying build/lib/verl/single_controller/base/register_center/ray.py -> build/bdist.linux-armv7l/wheel/./verl/single_controller/base/register_center 2024-12-11T19:59:18,785 creating build/bdist.linux-armv7l/wheel/verl/utils 2024-12-11T19:59:18,787 creating build/bdist.linux-armv7l/wheel/verl/utils/rendezvous 2024-12-11T19:59:18,788 copying build/lib/verl/utils/rendezvous/ray_backend.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-12-11T19:59:18,790 copying build/lib/verl/utils/rendezvous/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/rendezvous 2024-12-11T19:59:18,792 copying build/lib/verl/utils/fs.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,794 copying build/lib/verl/utils/tracking.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,796 copying build/lib/verl/utils/config.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,797 copying build/lib/verl/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,799 copying build/lib/verl/utils/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,800 copying build/lib/verl/utils/torch_dtypes.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,803 creating build/bdist.linux-armv7l/wheel/verl/utils/debug 2024-12-11T19:59:18,804 copying build/lib/verl/utils/debug/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T19:59:18,806 copying build/lib/verl/utils/debug/trajectory_tracker.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T19:59:18,807 copying build/lib/verl/utils/debug/performance.py -> build/bdist.linux-armv7l/wheel/./verl/utils/debug 2024-12-11T19:59:18,809 copying build/lib/verl/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,817 copying build/lib/verl/utils/memory_buffer.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,820 creating build/bdist.linux-armv7l/wheel/verl/utils/dataset 2024-12-11T19:59:18,821 copying build/lib/verl/utils/dataset/rl_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T19:59:18,823 copying build/lib/verl/utils/dataset/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T19:59:18,825 copying build/lib/verl/utils/dataset/sft_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T19:59:18,827 copying build/lib/verl/utils/dataset/rm_dataset.py -> build/bdist.linux-armv7l/wheel/./verl/utils/dataset 2024-12-11T19:59:18,829 copying build/lib/verl/utils/py_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,832 creating build/bdist.linux-armv7l/wheel/verl/utils/megatron 2024-12-11T19:59:18,833 copying build/lib/verl/utils/megatron/memory.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,835 copying build/lib/verl/utils/megatron/pipeline_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,837 copying build/lib/verl/utils/megatron/optimizer_config.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,839 copying build/lib/verl/utils/megatron/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,841 copying build/lib/verl/utils/megatron/optimizer.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,844 copying build/lib/verl/utils/megatron/sequence_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,846 copying build/lib/verl/utils/megatron/tensor_parallel.py -> build/bdist.linux-armv7l/wheel/./verl/utils/megatron 2024-12-11T19:59:18,848 copying build/lib/verl/utils/ray_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,850 copying build/lib/verl/utils/distributed.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,852 copying build/lib/verl/utils/megatron_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,855 copying build/lib/verl/utils/import_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,857 creating build/bdist.linux-armv7l/wheel/verl/utils/logger 2024-12-11T19:59:18,858 copying build/lib/verl/utils/logger/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-12-11T19:59:18,860 copying build/lib/verl/utils/logger/aggregate_logger.py -> build/bdist.linux-armv7l/wheel/./verl/utils/logger 2024-12-11T19:59:18,862 copying build/lib/verl/utils/fsdp_utils.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,864 copying build/lib/verl/utils/hdfs_io.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,867 creating build/bdist.linux-armv7l/wheel/verl/utils/reward_score 2024-12-11T19:59:18,868 copying build/lib/verl/utils/reward_score/math.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T19:59:18,871 copying build/lib/verl/utils/reward_score/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T19:59:18,872 copying build/lib/verl/utils/reward_score/gsm8k.py -> build/bdist.linux-armv7l/wheel/./verl/utils/reward_score 2024-12-11T19:59:18,874 copying build/lib/verl/utils/torch_functional.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,877 copying build/lib/verl/utils/model.py -> build/bdist.linux-armv7l/wheel/./verl/utils 2024-12-11T19:59:18,881 creating build/bdist.linux-armv7l/wheel/verl/third_party 2024-12-11T19:59:18,882 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm 2024-12-11T19:59:18,884 copying build/lib/verl/third_party/vllm/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm 2024-12-11T19:59:18,886 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,888 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,891 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,893 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,895 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,897 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,899 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,901 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,904 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,906 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,909 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,911 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,914 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,916 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,918 copying build/lib/verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_4_2 2024-12-11T19:59:18,922 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,923 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,925 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,928 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,930 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,931 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,934 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,935 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,938 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,940 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,943 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,945 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,947 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,950 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,952 copying build/lib/verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_5_4 2024-12-11T19:59:18,955 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,956 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,959 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,961 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,964 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,966 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,968 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,971 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,973 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,976 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,979 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,981 copying build/lib/verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_3_1 2024-12-11T19:59:18,984 creating build/bdist.linux-armv7l/wheel/verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,985 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/model_runner.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,988 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/config.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,990 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,992 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,993 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,995 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:18,997 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,000 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,002 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/llm.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,004 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,007 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/model_loader.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,009 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,012 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/worker.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,014 copying build/lib/verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py -> build/bdist.linux-armv7l/wheel/./verl/third_party/vllm/vllm_v_0_6_3 2024-12-11T19:59:19,016 copying build/lib/verl/third_party/__init__.py -> build/bdist.linux-armv7l/wheel/./verl/third_party 2024-12-11T19:59:19,018 running install_egg_info 2024-12-11T19:59:19,050 Copying verl.egg-info to build/bdist.linux-armv7l/wheel/./verl-0.1rc2-py3.11.egg-info 2024-12-11T19:59:19,061 running install_scripts 2024-12-11T19:59:19,079 creating build/bdist.linux-armv7l/wheel/verl-0.1rc2.dist-info/WHEEL 2024-12-11T19:59:19,082 creating '/tmp/pip-wheel-rgbwzt5x/verl-0.1rc2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-11T19:59:19,084 adding 'verl/__init__.py' 2024-12-11T19:59:19,086 adding 'verl/protocol.py' 2024-12-11T19:59:19,088 adding 'verl/models/__init__.py' 2024-12-11T19:59:19,090 adding 'verl/models/registry.py' 2024-12-11T19:59:19,091 adding 'verl/models/weight_loader_registry.py' 2024-12-11T19:59:19,093 adding 'verl/models/llama/__init__.py' 2024-12-11T19:59:19,095 adding 'verl/models/llama/megatron/__init__.py' 2024-12-11T19:59:19,097 adding 'verl/models/llama/megatron/modeling_llama_megatron.py' 2024-12-11T19:59:19,099 adding 'verl/models/llama/megatron/checkpoint_utils/__init__.py' 2024-12-11T19:59:19,102 adding 'verl/models/llama/megatron/checkpoint_utils/llama_loader.py' 2024-12-11T19:59:19,104 adding 'verl/models/llama/megatron/checkpoint_utils/llama_saver.py' 2024-12-11T19:59:19,106 adding 'verl/models/llama/megatron/layers/__init__.py' 2024-12-11T19:59:19,108 adding 'verl/models/llama/megatron/layers/parallel_attention.py' 2024-12-11T19:59:19,110 adding 'verl/models/llama/megatron/layers/parallel_decoder.py' 2024-12-11T19:59:19,111 adding 'verl/models/llama/megatron/layers/parallel_linear.py' 2024-12-11T19:59:19,112 adding 'verl/models/llama/megatron/layers/parallel_mlp.py' 2024-12-11T19:59:19,114 adding 'verl/models/llama/megatron/layers/parallel_rmsnorm.py' 2024-12-11T19:59:19,115 adding 'verl/single_controller/__init__.py' 2024-12-11T19:59:19,117 adding 'verl/single_controller/base/__init__.py' 2024-12-11T19:59:19,119 adding 'verl/single_controller/base/decorator.py' 2024-12-11T19:59:19,120 adding 'verl/single_controller/base/dp.py' 2024-12-11T19:59:19,122 adding 'verl/single_controller/base/worker.py' 2024-12-11T19:59:19,123 adding 'verl/single_controller/base/worker_group.py' 2024-12-11T19:59:19,125 adding 'verl/single_controller/base/megatron/__init__.py' 2024-12-11T19:59:19,126 adding 'verl/single_controller/base/megatron/worker.py' 2024-12-11T19:59:19,127 adding 'verl/single_controller/base/megatron/worker_group.py' 2024-12-11T19:59:19,129 adding 'verl/single_controller/base/register_center/__init__.py' 2024-12-11T19:59:19,130 adding 'verl/single_controller/base/register_center/ray.py' 2024-12-11T19:59:19,132 adding 'verl/single_controller/ray/__init__.py' 2024-12-11T19:59:19,134 adding 'verl/single_controller/ray/base.py' 2024-12-11T19:59:19,136 adding 'verl/single_controller/ray/decorator.py' 2024-12-11T19:59:19,137 adding 'verl/single_controller/ray/dist_data_pass_protocol.py' 2024-12-11T19:59:19,138 adding 'verl/single_controller/ray/dp.py' 2024-12-11T19:59:19,140 adding 'verl/single_controller/ray/megatron.py' 2024-12-11T19:59:19,141 adding 'verl/single_controller/version/version' 2024-12-11T19:59:19,143 adding 'verl/third_party/__init__.py' 2024-12-11T19:59:19,144 adding 'verl/third_party/vllm/__init__.py' 2024-12-11T19:59:19,146 adding 'verl/third_party/vllm/vllm_v_0_3_1/__init__.py' 2024-12-11T19:59:19,148 adding 'verl/third_party/vllm/vllm_v_0_3_1/arg_utils.py' 2024-12-11T19:59:19,151 adding 'verl/third_party/vllm/vllm_v_0_3_1/config.py' 2024-12-11T19:59:19,153 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm.py' 2024-12-11T19:59:19,157 adding 'verl/third_party/vllm/vllm_v_0_3_1/llm_engine_sp.py' 2024-12-11T19:59:19,160 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_loader.py' 2024-12-11T19:59:19,162 adding 'verl/third_party/vllm/vllm_v_0_3_1/model_runner.py' 2024-12-11T19:59:19,164 adding 'verl/third_party/vllm/vllm_v_0_3_1/parallel_state.py' 2024-12-11T19:59:19,165 adding 'verl/third_party/vllm/vllm_v_0_3_1/tokenizer.py' 2024-12-11T19:59:19,166 adding 'verl/third_party/vllm/vllm_v_0_3_1/weight_loaders.py' 2024-12-11T19:59:19,168 adding 'verl/third_party/vllm/vllm_v_0_3_1/worker.py' 2024-12-11T19:59:19,170 adding 'verl/third_party/vllm/vllm_v_0_4_2/__init__.py' 2024-12-11T19:59:19,172 adding 'verl/third_party/vllm/vllm_v_0_4_2/arg_utils.py' 2024-12-11T19:59:19,174 adding 'verl/third_party/vllm/vllm_v_0_4_2/config.py' 2024-12-11T19:59:19,176 adding 'verl/third_party/vllm/vllm_v_0_4_2/dtensor_weight_loaders.py' 2024-12-11T19:59:19,177 adding 'verl/third_party/vllm/vllm_v_0_4_2/hf_weight_loader.py' 2024-12-11T19:59:19,180 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm.py' 2024-12-11T19:59:19,182 adding 'verl/third_party/vllm/vllm_v_0_4_2/llm_engine_sp.py' 2024-12-11T19:59:19,184 adding 'verl/third_party/vllm/vllm_v_0_4_2/megatron_weight_loaders.py' 2024-12-11T19:59:19,186 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_loader.py' 2024-12-11T19:59:19,188 adding 'verl/third_party/vllm/vllm_v_0_4_2/model_runner.py' 2024-12-11T19:59:19,190 adding 'verl/third_party/vllm/vllm_v_0_4_2/parallel_state.py' 2024-12-11T19:59:19,192 adding 'verl/third_party/vllm/vllm_v_0_4_2/spmd_gpu_executor.py' 2024-12-11T19:59:19,193 adding 'verl/third_party/vllm/vllm_v_0_4_2/tokenizer.py' 2024-12-11T19:59:19,196 adding 'verl/third_party/vllm/vllm_v_0_4_2/worker.py' 2024-12-11T19:59:19,197 adding 'verl/third_party/vllm/vllm_v_0_5_4/__init__.py' 2024-12-11T19:59:19,200 adding 'verl/third_party/vllm/vllm_v_0_5_4/arg_utils.py' 2024-12-11T19:59:19,202 adding 'verl/third_party/vllm/vllm_v_0_5_4/config.py' 2024-12-11T19:59:19,204 adding 'verl/third_party/vllm/vllm_v_0_5_4/dtensor_weight_loaders.py' 2024-12-11T19:59:19,206 adding 'verl/third_party/vllm/vllm_v_0_5_4/hf_weight_loader.py' 2024-12-11T19:59:19,208 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm.py' 2024-12-11T19:59:19,211 adding 'verl/third_party/vllm/vllm_v_0_5_4/llm_engine_sp.py' 2024-12-11T19:59:19,213 adding 'verl/third_party/vllm/vllm_v_0_5_4/megatron_weight_loaders.py' 2024-12-11T19:59:19,215 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_loader.py' 2024-12-11T19:59:19,216 adding 'verl/third_party/vllm/vllm_v_0_5_4/model_runner.py' 2024-12-11T19:59:19,218 adding 'verl/third_party/vllm/vllm_v_0_5_4/parallel_state.py' 2024-12-11T19:59:19,220 adding 'verl/third_party/vllm/vllm_v_0_5_4/spmd_gpu_executor.py' 2024-12-11T19:59:19,222 adding 'verl/third_party/vllm/vllm_v_0_5_4/tokenizer.py' 2024-12-11T19:59:19,224 adding 'verl/third_party/vllm/vllm_v_0_5_4/worker.py' 2024-12-11T19:59:19,226 adding 'verl/third_party/vllm/vllm_v_0_6_3/__init__.py' 2024-12-11T19:59:19,227 adding 'verl/third_party/vllm/vllm_v_0_6_3/arg_utils.py' 2024-12-11T19:59:19,228 adding 'verl/third_party/vllm/vllm_v_0_6_3/config.py' 2024-12-11T19:59:19,230 adding 'verl/third_party/vllm/vllm_v_0_6_3/dtensor_weight_loaders.py' 2024-12-11T19:59:19,231 adding 'verl/third_party/vllm/vllm_v_0_6_3/hf_weight_loader.py' 2024-12-11T19:59:19,233 adding 'verl/third_party/vllm/vllm_v_0_6_3/llm.py' 2024-12-11T19:59:19,236 adding 'verl/third_party/vllm/vllm_v_0_6_3/llm_engine_sp.py' 2024-12-11T19:59:19,237 adding 'verl/third_party/vllm/vllm_v_0_6_3/megatron_weight_loaders.py' 2024-12-11T19:59:19,239 adding 'verl/third_party/vllm/vllm_v_0_6_3/model_loader.py' 2024-12-11T19:59:19,241 adding 'verl/third_party/vllm/vllm_v_0_6_3/model_runner.py' 2024-12-11T19:59:19,243 adding 'verl/third_party/vllm/vllm_v_0_6_3/parallel_state.py' 2024-12-11T19:59:19,245 adding 'verl/third_party/vllm/vllm_v_0_6_3/spmd_gpu_executor.py' 2024-12-11T19:59:19,246 adding 'verl/third_party/vllm/vllm_v_0_6_3/tokenizer.py' 2024-12-11T19:59:19,248 adding 'verl/third_party/vllm/vllm_v_0_6_3/worker.py' 2024-12-11T19:59:19,250 adding 'verl/trainer/__init__.py' 2024-12-11T19:59:19,252 adding 'verl/trainer/fsdp_sft_trainer.py' 2024-12-11T19:59:19,253 adding 'verl/trainer/main_eval.py' 2024-12-11T19:59:19,255 adding 'verl/trainer/main_generation.py' 2024-12-11T19:59:19,256 adding 'verl/trainer/main_ppo.py' 2024-12-11T19:59:19,258 adding 'verl/trainer/config/evaluation.yaml' 2024-12-11T19:59:19,260 adding 'verl/trainer/config/generation.yaml' 2024-12-11T19:59:19,261 adding 'verl/trainer/config/ppo_megatron_trainer.yaml' 2024-12-11T19:59:19,262 adding 'verl/trainer/config/ppo_trainer.yaml' 2024-12-11T19:59:19,264 adding 'verl/trainer/config/sft_trainer.yaml' 2024-12-11T19:59:19,265 adding 'verl/trainer/ppo/__init__.py' 2024-12-11T19:59:19,267 adding 'verl/trainer/ppo/core_algos.py' 2024-12-11T19:59:19,270 adding 'verl/trainer/ppo/ray_trainer.py' 2024-12-11T19:59:19,272 adding 'verl/trainer/ppo/actor/__init__.py' 2024-12-11T19:59:19,273 adding 'verl/trainer/ppo/actor/base.py' 2024-12-11T19:59:19,275 adding 'verl/trainer/ppo/actor/dp_actor.py' 2024-12-11T19:59:19,277 adding 'verl/trainer/ppo/actor/megatron_actor.py' 2024-12-11T19:59:19,279 adding 'verl/trainer/ppo/critic/__init__.py' 2024-12-11T19:59:19,280 adding 'verl/trainer/ppo/critic/base.py' 2024-12-11T19:59:19,282 adding 'verl/trainer/ppo/critic/dp_critic.py' 2024-12-11T19:59:19,284 adding 'verl/trainer/ppo/critic/megatron_critic.py' 2024-12-11T19:59:19,285 adding 'verl/trainer/ppo/hybrid_engine/__init__.py' 2024-12-11T19:59:19,287 adding 'verl/trainer/ppo/hybrid_engine/base.py' 2024-12-11T19:59:19,288 adding 'verl/trainer/ppo/hybrid_engine/fsdp_vllm.py' 2024-12-11T19:59:19,291 adding 'verl/trainer/ppo/hybrid_engine/megatron_vllm.py' 2024-12-11T19:59:19,292 adding 'verl/trainer/ppo/reward_model/__init__.py' 2024-12-11T19:59:19,294 adding 'verl/trainer/ppo/reward_model/base.py' 2024-12-11T19:59:19,295 adding 'verl/trainer/ppo/reward_model/megatron/__init__.py' 2024-12-11T19:59:19,297 adding 'verl/trainer/ppo/reward_model/megatron/reward_model.py' 2024-12-11T19:59:19,299 adding 'verl/trainer/ppo/rollout/__init__.py' 2024-12-11T19:59:19,300 adding 'verl/trainer/ppo/rollout/base.py' 2024-12-11T19:59:19,302 adding 'verl/trainer/ppo/rollout/hf_rollout.py' 2024-12-11T19:59:19,304 adding 'verl/trainer/ppo/rollout/tokenizer.py' 2024-12-11T19:59:19,305 adding 'verl/trainer/ppo/rollout/megatron/__init__.py' 2024-12-11T19:59:19,307 adding 'verl/trainer/ppo/rollout/naive/__init__.py' 2024-12-11T19:59:19,308 adding 'verl/trainer/ppo/rollout/naive/naive_rollout.py' 2024-12-11T19:59:19,310 adding 'verl/trainer/ppo/rollout/vllm_rollout/__init__.py' 2024-12-11T19:59:19,311 adding 'verl/trainer/ppo/rollout/vllm_rollout/vllm_rollout.py' 2024-12-11T19:59:19,313 adding 'verl/trainer/ppo/workers/__init__.py' 2024-12-11T19:59:19,317 adding 'verl/trainer/ppo/workers/fsdp_workers.py' 2024-12-11T19:59:19,320 adding 'verl/trainer/ppo/workers/megatron_workers.py' 2024-12-11T19:59:19,323 adding 'verl/utils/__init__.py' 2024-12-11T19:59:19,324 adding 'verl/utils/config.py' 2024-12-11T19:59:19,325 adding 'verl/utils/distributed.py' 2024-12-11T19:59:19,327 adding 'verl/utils/fs.py' 2024-12-11T19:59:19,328 adding 'verl/utils/fsdp_utils.py' 2024-12-11T19:59:19,330 adding 'verl/utils/hdfs_io.py' 2024-12-11T19:59:19,331 adding 'verl/utils/import_utils.py' 2024-12-11T19:59:19,332 adding 'verl/utils/logging_utils.py' 2024-12-11T19:59:19,334 adding 'verl/utils/megatron_utils.py' 2024-12-11T19:59:19,336 adding 'verl/utils/memory_buffer.py' 2024-12-11T19:59:19,338 adding 'verl/utils/model.py' 2024-12-11T19:59:19,339 adding 'verl/utils/py_functional.py' 2024-12-11T19:59:19,340 adding 'verl/utils/ray_utils.py' 2024-12-11T19:59:19,342 adding 'verl/utils/tokenizer.py' 2024-12-11T19:59:19,343 adding 'verl/utils/torch_dtypes.py' 2024-12-11T19:59:19,345 adding 'verl/utils/torch_functional.py' 2024-12-11T19:59:19,347 adding 'verl/utils/tracking.py' 2024-12-11T19:59:19,348 adding 'verl/utils/dataset/__init__.py' 2024-12-11T19:59:19,350 adding 'verl/utils/dataset/rl_dataset.py' 2024-12-11T19:59:19,351 adding 'verl/utils/dataset/rm_dataset.py' 2024-12-11T19:59:19,353 adding 'verl/utils/dataset/sft_dataset.py' 2024-12-11T19:59:19,355 adding 'verl/utils/debug/__init__.py' 2024-12-11T19:59:19,356 adding 'verl/utils/debug/performance.py' 2024-12-11T19:59:19,358 adding 'verl/utils/debug/trajectory_tracker.py' 2024-12-11T19:59:19,359 adding 'verl/utils/logger/__init__.py' 2024-12-11T19:59:19,361 adding 'verl/utils/logger/aggregate_logger.py' 2024-12-11T19:59:19,363 adding 'verl/utils/megatron/__init__.py' 2024-12-11T19:59:19,364 adding 'verl/utils/megatron/memory.py' 2024-12-11T19:59:19,365 adding 'verl/utils/megatron/optimizer.py' 2024-12-11T19:59:19,367 adding 'verl/utils/megatron/optimizer_config.py' 2024-12-11T19:59:19,368 adding 'verl/utils/megatron/pipeline_parallel.py' 2024-12-11T19:59:19,369 adding 'verl/utils/megatron/sequence_parallel.py' 2024-12-11T19:59:19,371 adding 'verl/utils/megatron/tensor_parallel.py' 2024-12-11T19:59:19,373 adding 'verl/utils/rendezvous/__init__.py' 2024-12-11T19:59:19,374 adding 'verl/utils/rendezvous/ray_backend.py' 2024-12-11T19:59:19,376 adding 'verl/utils/reward_score/__init__.py' 2024-12-11T19:59:19,377 adding 'verl/utils/reward_score/gsm8k.py' 2024-12-11T19:59:19,379 adding 'verl/utils/reward_score/math.py' 2024-12-11T19:59:19,381 adding 'verl/version/version' 2024-12-11T19:59:19,384 adding 'verl-0.1rc2.dist-info/LICENSE' 2024-12-11T19:59:19,386 adding 'verl-0.1rc2.dist-info/METADATA' 2024-12-11T19:59:19,387 adding 'verl-0.1rc2.dist-info/WHEEL' 2024-12-11T19:59:19,388 adding 'verl-0.1rc2.dist-info/top_level.txt' 2024-12-11T19:59:19,391 adding 'verl-0.1rc2.dist-info/RECORD' 2024-12-11T19:59:19,398 removing build/bdist.linux-armv7l/wheel 2024-12-11T19:59:19,556 Building wheel for verl (setup.py): finished with status 'done' 2024-12-11T19:59:19,563 Created wheel for verl: filename=verl-0.1rc2-py3-none-any.whl size=371498 sha256=4af932cb33e77dda2ebe245544a30268aade2d61b7f65f116a9aadd0727bd36a 2024-12-11T19:59:19,564 Stored in directory: /tmp/pip-ephem-wheel-cache-se7zk664/wheels/36/5a/54/44921b17a2fc6afd87a433589f0b4b4b3a2bf487c127805dec 2024-12-11T19:59:19,580 Successfully built verl 2024-12-11T19:59:19,598 Removed build tracker: '/tmp/pip-build-tracker-00n69ypk'