Joined: 15 Nov 2011
Online Status: Offline
Posts: 3
Topic: Large numbers not properly represented Posted: 22 Nov 2021 at 8:21am
I have two reports pulling data from SQL Server. The data field in SQL Server is datatype "real". The value is represented as 5.593069E+07 on the server. One report is translating this value to 55930690, which is what it was typed in as on the application that created the record. However, the other report is translating this to 55930688. I've checked the number formatting and the settings of the Details section, and I can't find a difference that accounts for the discrepancy.
Joined: 21 Dec 2007
Online Status: Offline
Posts: 4372
Posted: 22 Nov 2021 at 1:02pm
Silly question...
Are they for the same value?
55930688, I can see rounding up to 53593069E+07.
Technically, 55930690 is the best that you can do given the notation displayed...but it seems that SQL might store more digits.
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum