Skip to content

Factor permutation management in a class#558

Open
mtrofin wants to merge 1 commit into
google:mainfrom
mtrofin:main
Open

Factor permutation management in a class#558
mtrofin wants to merge 1 commit into
google:mainfrom
mtrofin:main

Conversation

@mtrofin
Copy link
Copy Markdown
Collaborator

@mtrofin mtrofin commented May 21, 2026

Besides factoring, this also addresses 2 problems:

  • when pruning, in the antithetic case, we need to prune the pair. The optimizers expect that
  • adjusting weights by the same distribution misses the scale of the weight. this favors, then, tuning small weights.

@mtrofin mtrofin requested a review from boomanaiden154 May 21, 2026 16:51
@mtrofin mtrofin force-pushed the main branch 3 times, most recently from 301aad4 to e0b1cfc Compare May 21, 2026 16:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant