PRB: Setting DECIMALS to 15 or More Produces Incorrect ResultLast reviewed: April 30, 1996Article ID: Q131003 |
The information in this article applies to:
SYMPTOMSWhen you use SET DECIMAL to set DECIMAL to 15 or more, certain mathematical calculations produce an incorrect result.
CAUSESome numbers when represented in a floating point format have no exact representation. For example, this is 1/3 where as .33333333 is in fact slightly less than 1/3. However, some numbers that do have exact floating point representations still exhibit this behavior. See the "Steps to Reproduce Behavior" section for an example.
STATUSMicrosoft is researching this issue and will post new information here in the Microsoft Knowledge Base as it becomes available.
Steps to Reproduce Problem
|
Additional reference words: 3.00 VFoxWin
© 1998 Microsoft Corporation. All rights reserved. Terms of Use. |