Use PyTorch's fused AdamW implementation to reduce optimizer kernel launch overhead and speed up the training step on CUDA devices. Guard with device check so the CPU-only fallback path is unaffected. Co-authored-by: TRAE CLI <traecli@bytedance.com>