github
/
minimind
mirror of https://github.com/jingyaogong/minimind.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #571 from dyhuachi/dyhuachi-patch-1 

[fix] Refactor get_lr function to include min_lr calculation
pull/507/merge
jingyaogong 2025-12-09 12:59:11 +08:00 committed by GitHub
parent ecd1ae1563 bf3878ace8
commit aa7dc0f61e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
trainer/trainer_utils.py
View File

@ -23,7 +23,8 @@ def Logger(content):
def get_lr(current_step, total_steps, lr): def get_lr(current_step, total_steps, lr):
return lr / 10 + 0.5 * lr * (1 + math.cos(math.pi * current_step / total_steps)) min_lr = lr / 10
return min_lr + 0.5 * (lr - min_lr) * (1 + math.cos(math.pi * current_step / total_steps))
def init_distributed_mode(): def init_distributed_mode():