Skip to content

docs: 补充学习率过高可能导致 loss 发散的风险说明#6856

Open
XIAOYANGTO wants to merge 12 commits into
OpenHUTB:mainfrom
XIAOYANGTO:improve-doc-02
Open

docs: 补充学习率过高可能导致 loss 发散的风险说明#6856
XIAOYANGTO wants to merge 12 commits into
OpenHUTB:mainfrom
XIAOYANGTO:improve-doc-02

Conversation

@XIAOYANGTO
Copy link
Copy Markdown

修改内容

在"2.3 学习率固定且偏高"节的问题分析中,补充了固定高学习率在复杂数据分布下可能导致 loss 发散的风险说明。

改动

  • 新增:在复杂数据分布下,固定的高学习率还可能导致 loss 直接发散,训练彻底失败

测试

文档修改,无代码变更。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants