Casio FX-991ES User Guide - Page 69

Calculation Ranges, Number of Digits, and, Precision

Page 69 highlights

A Stack ERROR occurs when the calculation you are performing causes the capacity of either stack to be exceeded. Stack Issues to Keep in Mind for Each Mode • In the CMPLX Mode, each input value uses two levels of the numeric stack, regardless of whether the input value is a real number or a complex number. This means that the numeric stack effectively has only five levels in the CMPLX Mode. • The MATRIX Mode uses its own matrix stack, which is used in combination with the general-purpose numeric stack.The matrix stack has three levels. Performing a calculation that involves a matrix causes one level of the matrix stack to be used for storage of the result. Squaring, cubing, or inverting a matrix also uses one level of the matrix stack. • The VECTOR Mode uses its own vector stack, which is used in combination with the general-purpose numeric stack. The vector stack has five levels. Vector stack usage follows the same rules as the matrix stack, described above. k Calculation Ranges, Number of Digits, and Precision The calculation range, number of digits used for internal calculation, and calculation precision depends on the type of calculation you are performing. Calculation Range and Precision Calculation Range ±1 × 10-99 to ±9.999999999 × 1099 or 0 Number of Digits for Internal Calculation 15 digits Precision In general, ±1 at the 10th digit for a single calculation. Precision for exponential display is ±1 at the least significant digit. Errors are cumulative in the case of consecutive calculations. Function Calculation Input Ranges and Precision Functions Input Range sinx DEG 0Ϲ ȊxȊ Ͻ9҂109 RAD 0Ϲ ȊxȊ Ͻ157079632.7 cosx GRA 0Ϲ ȊxȊ Ͻ1҂1010 DEG 0Ϲ ȊxȊ Ͻ9҂109 RAD 0Ϲ ȊxȊ Ͻ157079632.7 GRA 0Ϲ ȊxȊ Ͻ1҂1010 tanx DEG Same as sinx, except when ȊxȊ= (2n-1)҂90. RAD Same as sinx, except when ȊxȊ= (2n-1)҂π/2. sin-1x cos-1x GRA Same as sinx, except when ȊxȊ= (2n-1)҂100. 0Ϲ ȊxȊ Ϲ1 tan-1x 0Ϲ ȊxȊ Ϲ9.999999999҂1099 sinhx coshx sinh-1x cosh-1x 0Ϲ ȊxȊ Ϲ230.2585092 0Ϲ ȊxȊ Ϲ4.999999999҂1099 1Ϲ x Ϲ4.999999999҂1099 E-67

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75

E-67
A Stack ERROR occurs when the calculation you are performing causes the
capacity of either stack to be exceeded.
Stack Issues to Keep in Mind for Each Mode
• In the CMPLX Mode, each input value uses two levels of the numeric stack,
regardless of whether the input value is a real number or a complex number.
This means that the numeric stack effectively has only five levels in the CMPLX
Mode.
The MATRIX Mode uses its own
matrix stack
, which is used in combination with
the general-purpose numeric stack. The matrix stack has three levels. Performing
a calculation that involves a matrix causes one level of the matrix stack to be
used for storage of the result. Squaring, cubing, or inverting a matrix also uses
one level of the matrix stack.
The VECTOR Mode uses its own
vector stack
, which is used in combination
with the general-purpose numeric stack. The vector stack has five levels. Vector
stack usage follows the same rules as the matrix stack, described above.
k
Calculation Ranges, Number of Digits, and
Precision
The calculation range, number of digits used for internal calculation, and calculation
precision depends on the type of calculation you are performing.
Calculation Range and Precision
Calculation Range
±
1
×
10
–99
to
±
9.999999999
×
10
99
or 0
Number of Digits for Internal
Calculation
15 digits
Precision
In general,
±
1 at the 10th digit for a single
calculation. Precision for exponential display
is
±
1 at the least significant digit. Errors are
cumulative in the case of consecutive
calculations.
Function Calculation Input Ranges and Precision
Functions
Input Range
sin
x
DEG
0
±
³
x
³
²
9
±
10
9
RAD
0
±
³
x
³
²
157079632.7
GRA
0
±
³
x
³
²
1
±
10
10
cos
x
DEG
0
±
³
x
³
²
9
±
10
9
RAD
0
±
³
x
³
²
157079632.7
GRA
0
±
³
x
³
²
1
±
10
10
tan
x
DEG
Same as sin
x
,
except when
³
x
³
= (2
n
–1)
±
90
.
RAD
Same as sin
x
,
except when
³
x
³
= (2
n
–1)
±
π
/
2
.
GRA
Same as sin
x
,
except when
³
x
³
= (2
n
–1)
±
100
.
sin
1
x
0
±
³
x
³
±
1
cos
1
x
tan
1
x
0
±
³
x
³
±
9.999999999
±
10
99
sinh
x
0
±
³
x
³
±
230.2585092
cosh
x
sinh
1
x
0
±
³
x
³
±
4.999999999
±
10
99
cosh
1
x
1
±
x
±
4.999999999
±
10
99