Increase several test tolerances to ensure tests pass on more computers#411
Increase several test tolerances to ensure tests pass on more computers#411martinholmer merged 2 commits intomasterfrom
Conversation
|
Not surprisingly, it passes all tests on my gpu. I will not be able to run it on my cpu until tomorrow. However, I neglected to run test on my cpu before doing my final pr. I got the following errors last night. While it's not a problem for me because I will use gpu, it suggests that others with different cpu setups might get slightly different results. It might make sense to expand bounds slightly for these variables. I hope to have a chance to look for ways to tighten up cross-machine differences further but it will be awhile before I can do that. I can send cpu results tomorrow if you want. Personally I think it would be fine to merge as or with additional tolerance increases to deal with the cases below. |
|
@martinholmer, I ended up getting a chance to run it cpu-only on my machine. I had one test failure, below. It looks like loosening the tolerance on |
|
@donboyd5 reported these seemingly contradictory CPU-based test differences an hour apart: and then @donboyd5, I completely confused. Why the difference in these two sets of results? |
|
@martinholmer, sorry for the confusion. The 2nd one is the correct one. After updating to commit 0f9dc5d all non-skipped tests pass when running on cpu-only. |
Even after the substantial reweighting improvements in PR #407, the reweighting results are not exactly the same on all computers. The changes in this pull request increase some of the
numpy.allclosetolerances so that the tests also pass when the reweighting is done on Apple M4 CPU chips.