When a batch contains only text samples (pixel_values is None), vision_proj parameters do not participate in the forward pass, causing DDP to raise: 'Expected to have finished reduction in the prior iteration' Adding find_unused_parameters=True resolves this. |
||
|---|---|---|
| .. | ||
| train_pretrain_vlm.py | ||
| train_sft_vlm.py | ||
| trainer_utils.py | ||