All, we have fields for a graphic’s width and height. In the results grid I have a formula to calculate the Square Inches; however, it’s rounding to 0 precision (no decimal places). How do I extend this Square inches calculation to 3 places?
=CInt([InventoryItem.UsrCFCHeight] * [InventoryItem.UsrCFCWidth])
Best answer by Naveen Boga
If you still need to perform a conversion for some reason, please use the CDEC/CDBL function instead and check the results.
Below is the screenshot for reference.
+19If you still need to perform a conversion for some reason, please use the CDEC/CDBL function instead and check the results.
Below is the screenshot for reference.
Try CDbl instead of CInt. Integers don’t like dots.
You could also try the Round function under Math. Round( [insert calculation] , 2 ) should give you at least a precision of two.
Try CDbl instead of CInt. Integers don’t like dots.
You could also try the Round function under Math. Round( [insert calculation] , 2 ) should give you at least a precision of two.
Thank you Naveen and Martin, CDbl worked! (I should’ve known this, Data Types 101!)
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.