Skip to content

docs: 补充 Xavier 初始化公式的推导说明#6858

Open
XIAOYANGTO wants to merge 12 commits into
OpenHUTB:mainfrom
XIAOYANGTO:improve-doc-04
Open

docs: 补充 Xavier 初始化公式的推导说明#6858
XIAOYANGTO wants to merge 12 commits into
OpenHUTB:mainfrom
XIAOYANGTO:improve-doc-04

Conversation

@XIAOYANGTO
Copy link
Copy Markdown

修改内容

在"3.1 Xavier 参数初始化"节的原理部分,补充了 √(6/n_in) 公式的数学推导来源,说明其来自均匀分布方差公式的推导过程。

改动

  • 新增公式推导:该公式来源于均匀分布方差公式:若 U[-a, a] 则方差为 a²/3,令其等于 2/(n_in + n_out) 解得 a = √(6/(n_in + n_out));单层情形下 n_in = n_out 简化为 √(6/n_in)

测试

文档修改,无代码变更。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants