Merge 138c367ddb into bdee223036

[fix] inference bug
2026-05-04 23:51:33 +08:00 · 2026-05-03 20:48:48 +08:00
1 changed files with 1 additions and 1 deletions
--- a/trainer/rollout_engine.py
+++ b/trainer/rollout_engine.py
@ -81,7 +81,7 @@ class TorchRolloutEngine(RolloutEngine):
                num_return_sequences=1,
                pad_token_id=self.tokenizer.pad_token_id,
                eos_token_id=self.tokenizer.eos_token_id,
-            )  # [B*num_gen, P+R]
+            ).clone()  # [B*num_gen, P+R]
            prompt_len = prompt_ids.size(1)
            completion_ids = output_ids[:, prompt_len:]  # [B*num_gen, R]
            full_mask = (output_ids != self.tokenizer.pad_token_id).long()
Author	SHA1	Message	Date
Yixian Chen	2847ca6f70	Merge `138c367ddb` into `bdee223036`	2026-05-04 23:51:33 +08:00
jingyaogong	bdee223036	[fix] inference bug	2026-05-03 20:48:48 +08:00