Texas Instruments TI-30XIIB Owners Manual - Page 26

Accuracy, Rounding

Page 26 highlights

Example: [valuate (3.75) -12. (.1066) 3.2. (.0692) 3.2 Enter 3.2 3.75 .1066 .0692 Press Lte..=.1 FiAr Cg r=1 Display -3 2 .01455794 1291.7455 5148.2603 Accuracy and Rounding Each calculation produces an 11-digit result. These 11 digits are more than are displayed. The result is therefore rounded to a 8-digit standard display or to 5 digits for scientific notation The 5/4 rounding technique built into this calculator adds 1to the least significant digit of the display if the next, non-displayed digit is five or more. If this digit is less than five. no rounding is applied. In the absence of these extra digits, Inaccurate results would frequently be displayed, such as • 1/3 K 3 = .99999999 The example shows 1 ÷ 3 = .33333333 when multiplied by 3 produces this answer. The internal 11-digit string of nines in your calculator is rounded to 1. The higher order mathematical functions use iterative calculations. The cumulative error from these calculations in most cases is maintained beyond the eight-digit display so that no inaccuracy is displayed. Most calculations are accurate to 1in the eighth digit as long as the calculator is not in scientific notation The only exceptions are the tangent function as it approaches undefined limits and y` where y is within 10 6 of 1 24

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52

Example:
[valuate
(3.75)
-12
.
(.1066)
3
.
2
.
(.0692)
3.2
Enter
Press
Display
3.2
Lte..=.1
Fi
r
A
Cg
-3
2
3.75
.01455794
.1066
1291.7455
.0692
r=1
5148.2603
Accuracy
and
Rounding
Each
calculation
produces
an
11
-digit
result.
These
11
digits
are
more
than
are
displayed.
The
result
is
therefore
rounded
to
a
8
-digit
standard
display
or
to
5
digits
for
scientific
notation
The
5/4
rounding
technique
built
into
this
calculator
adds
1
to
the
least
significant
digit
of
the
display
if
the
next,
non
-displayed
digit
is
five
or
more.
If
this
digit
is
less
than
five.
no
rounding
is
applied.
In
the
absence
of
these
extra
digits,
Inaccurate
results
would
frequently
be
displayed,
such
as
1/3
K
3
=
.99999999
The
example
shows
1
÷
3
=
.33333333
when
multiplied
by
3
produces
this
answer.
The
internal
11
-digit
string
of
nines
in
your
calculator
is
rounded
to
1.
The
higher
order
mathematical
functions
use
iterative
calculations.
The
cumulative
error
from
these
calculations
in
most
cases
is
maintained
beyond
the
eight
-digit
display
so
that
no
inaccuracy
is
displayed.
Most
calculations
are
accurate
to
1
in
the
eighth
digit
as
long
as
the
calculator
is
not
in
scientific
notation
The
only
exceptions
are
the
tangent
function
as
it
approaches
undefined
limits
and
y`
where
y
is
within
10
6
of
1
24