You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
even though a more accurate Double representation exists:
> 5 / 1000000 :: Double
5.0e-6
This can result in an error larger than 0.5us when calling toSeconds with durations of greater than microseconds # (2^32 * 1000000) (assuming 64-bit Double with 52 bits of mantissa), which is a little over 136 years. (Not entirely unreasonable; the first discrepancy is at 11us later.)
Won't fix for now as FDIV is significantly slower than FMUL: check the instruction tables PDF. Comment below if this causes any problems.
The text was updated successfully, but these errors were encountered:
Currently implemented as:
rather than
such that
even though a more accurate
Double
representation exists:This can result in an error larger than 0.5us when calling
toSeconds
with durations of greater thanmicroseconds # (2^32 * 1000000)
(assuming 64-bitDouble
with 52 bits of mantissa), which is a little over 136 years. (Not entirely unreasonable; the first discrepancy is at 11us later.)Won't fix for now as
FDIV
is significantly slower thanFMUL
: check the instruction tables PDF. Comment below if this causes any problems.The text was updated successfully, but these errors were encountered: