Page 1 of 1

Rounding and Float to Integer Errors (Solved)

PostPosted: Mon Nov 15, 2010 9:17 pm
by boris
There appears to be a rounding error were a conversion from a float calculation that results is a whole number is then connected to an integer data element. The result of the float multiply is display as a whole number - which I believe is rounded up - but results in a different integer value.

Attached is the schematic that seems to not make sense other than it being a bug.

I think we need a rounding primitive to be able to control results.

Re: Rounding and Float to Integer Errors

PostPosted: Mon Nov 15, 2010 11:00 pm
by Exo
Hey and welcome boris :)

This is not a bug. The float is rounded up for display purposes only, the underlying float is unchanged.

If you go into options under "Advanced" there is an option to turn "display floats as 32bit binary representations" on.

Switch that option on for the true value.

Cheers ;)

Exo

Re: Rounding and Float to Integer Errors

PostPosted: Mon Nov 15, 2010 11:10 pm
by boris
Ok Thanks