You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Additive error tolerance fails to follow expected behavior at limits. This especially becomes an issue when we enforce a sizable scaling factor multiplier, so we should switch our error tolerance to be geometric.
Suggested Design
Replace additive tolerance with 10^-24 multiplicative tolerance
Acceptance Criteria
All existing tests should pass
The text was updated successfully, but these errors were encountered:
Background
Additive error tolerance fails to follow expected behavior at limits. This especially becomes an issue when we enforce a sizable scaling factor multiplier, so we should switch our error tolerance to be geometric.
Suggested Design
10^-24
multiplicative toleranceAcceptance Criteria
The text was updated successfully, but these errors were encountered: