Texas Instruments TI-30XIIB Owners Manual - Page 26
Accuracy, Rounding
View all Texas Instruments TI-30XIIB manuals
Add to My Manuals
Save this manual to your list of manuals |
Page 26 highlights
Example: [valuate (3.75) -12. (.1066) 3.2. (.0692) 3.2 Enter 3.2 3.75 .1066 .0692 Press Lte..=.1 FiAr Cg r=1 Display -3 2 .01455794 1291.7455 5148.2603 Accuracy and Rounding Each calculation produces an 11-digit result. These 11 digits are more than are displayed. The result is therefore rounded to a 8-digit standard display or to 5 digits for scientific notation The 5/4 rounding technique built into this calculator adds 1to the least significant digit of the display if the next, non-displayed digit is five or more. If this digit is less than five. no rounding is applied. In the absence of these extra digits, Inaccurate results would frequently be displayed, such as • 1/3 K 3 = .99999999 The example shows 1 ÷ 3 = .33333333 when multiplied by 3 produces this answer. The internal 11-digit string of nines in your calculator is rounded to 1. The higher order mathematical functions use iterative calculations. The cumulative error from these calculations in most cases is maintained beyond the eight-digit display so that no inaccuracy is displayed. Most calculations are accurate to 1in the eighth digit as long as the calculator is not in scientific notation The only exceptions are the tangent function as it approaches undefined limits and y` where y is within 10 6 of 1 24