Rounding and Float to Integer Errors (Solved)
Posted: Mon Nov 15, 2010 9:17 pm
There appears to be a rounding error were a conversion from a float calculation that results is a whole number is then connected to an integer data element. The result of the float multiply is display as a whole number - which I believe is rounded up - but results in a different integer value.
Attached is the schematic that seems to not make sense other than it being a bug.
I think we need a rounding primitive to be able to control results.
Attached is the schematic that seems to not make sense other than it being a bug.
I think we need a rounding primitive to be able to control results.