Rounding Errors In Visual Basic For Applications

Last reviewed: August 28, 1997
Article ID: Q165373
The information in this article applies to:
  • Microsoft Visual Basic for Applications included with: - Microsoft Word 97 for Windows - Microsoft PowerPoint 97 for Windows - Microsoft Excel 97 for Windows

SYMPTOMS

When you run a Visual Basic for Applications macro that performs numeric calculations that result in a decimal value, the result that is returned may be incorrect. For example, for the following calculation

   n = 301.84 - 301

Visual Basic for Applications returns 0.839999999999975. The correct result is 0.84.

WORKAROUND

Microsoft provides examples of Visual Basic for Applications procedures for illustration only, without warranty either expressed or implied, including, but not limited to the implied warranties of merchantability and/or fitness for a particular purpose. The Visual Basic procedures in this article are provided 'as is' and Microsoft does not guarantee that they can be used in all situations. While Microsoft support engineers can help explain the functionality of a particular macro, they will not modify these examples to provide added functionality, nor will they help you construct macros to meet your specific needs. If you have limited programming experience, you may want to consult one of the Microsoft Solution Providers. Solution Providers offer a wide range of fee-based services, including creating custom macros. For more information about Microsoft Solution Providers, call Microsoft Customer Information Service at (800) 426-9400.

To return the correct result rounded to a specific decimal place, use the Format function.

The following example macro returns the correct result (.84) for the calculation in this article:

   n = CDbl(Format(301.84 - 301, "0.00"))

For more information about using the Format function, click the Office Assistant in the Visual Basic Editor, type "Format Function," (without the quotation marks), click Search, and then click to view the "Format Function" topic.

NOTE: If the Assistant is hidden, click the Office Assistant button on the Standard toolbar. If Visual Basic for Applications Help is not installed on your computer, please see the following article in the Microsoft Knowledge Base:

   ARTICLE-ID: Q120802
   TITLE     : Office: How to Add/Remove a Single Office
               Program or Component

STATUS

Microsoft is researching this problem and will post new information here in the Microsoft Knowledge Base as it becomes available.

MORE INFORMATION

For additional information, please see the following articles in the Microsoft Knowledge Base:

   ARTICLE-ID: Q126455
   TITLE     : How to Avoid Rounding & Overflow Probs on Pentium
               Processors

   ARTICLE-ID: Q42980
   TITLE     : (Complete) Tutorial to Understand IEEE Floating-Point Errors

   ARTICLE-ID: Q69333
   TITLE     : How to Work Around Floating-Point Accuracy/Comparison
               Problems


Additional query words: word8 word97 8.00 8.0 vb vbe vba kbwordvba xlvbainfo
Keywords : kbprg PgmOthr
Platform : NT WINDOWS


THE INFORMATION PROVIDED IN THE MICROSOFT KNOWLEDGE BASE IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. MICROSOFT DISCLAIMS ALL WARRANTIES, EITHER EXPRESS OR IMPLIED, INCLUDING THE WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. IN NO EVENT SHALL MICROSOFT CORPORATION OR ITS SUPPLIERS BE LIABLE FOR ANY DAMAGES WHATSOEVER INCLUDING DIRECT, INDIRECT, INCIDENTAL, CONSEQUENTIAL, LOSS OF BUSINESS PROFITS OR SPECIAL DAMAGES, EVEN IF MICROSOFT CORPORATION OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. SOME STATES DO NOT ALLOW THE EXCLUSION OR LIMITATION OF LIABILITY FOR CONSEQUENTIAL OR INCIDENTAL DAMAGES SO THE FOREGOING LIMITATION MAY NOT APPLY.

Last reviewed: August 28, 1997
© 1998 Microsoft Corporation. All rights reserved. Terms of Use.