rounding

SearchAdvancedHelp

(0.001 seconds)

1—10 of 15 matching pages

1: 27.17 Other Applications

… ►Congruences are used in constructing perpetual calendars, splicing telephone cables, scheduling round-robin tournaments, devising systematic methods for storing computer files, and generating pseudorandom numbers. … …

2: 3.1 Arithmetics and Error Measures

… ►

Rounding

… ►Then rounding by chopping or rounding down of $x$ gives $x_{-}$, with maximum relative error ${ϵ}_M$. Symmetric rounding or rounding to nearest of $x$ gives $x_{-}$ or $x_{+}$, whichever is nearer to $x$, with maximum relative error equal to the machine precision $\frac{1}{2}{ϵ}_M=2^{-p}$. ►Negative numbers $x$ are rounded in the same way as $-x$. … ►Interval arithmetic is intended for bounding the total effect of rounding errors of calculations with machine numbers. …

3: 8.26 Tables

… ►

Pearson (1965) tabulates the function $I(u,p)$ ($=P(p+1,u)$) for $p=-1(.05)0(.1)5(.2)50$, $u=0(.1)u_p$ to 7D, where $I(u,u_p)$ rounds off to 1 to 7D; also $I(u,p)$ for $p=-0.75(.01)-1$, $u=0(.1)6$ to 5D.

…

4: Bibliography Z

… ►

Fast evaluation of elementary mathematical functions with correctly rounded last bit. ACM Trans. Math. Software 17 (3), pp. 410–423.

ⓘ

External Links:

ISSN 0098-3500, Document, ZentralBlatt

Referenced by:

§4.45(i).

Encodings:

BibTeX

…

5: DLMF Project News

error generating summary

6: Mathematical Introduction

… ►Another numerical convention is that decimals followed by dots are unrounded; without the dots they are rounded. …1416 (rounded). …

7: 12.11 Zeros

… ►where the numerical coefficients have been rounded off. …

8: 2.11 Remainder Terms; Stokes Phenomenon

… ►On rounding to 5D, we have $q_1(\pi )=-0.05318$, $q_2(\pi )=0.04791$, $q_3(\pi )=-0.08985$. … ►Taking $x=5$ and rounding to 5D, we obtain … ►We now compute the forward differences ${\mathrm{\Delta }}^j$, $j=0,1,2,\mathrm{\dots }$, of the moduli of the rounded values of the first 6 neglected terms: …

9: 3.2 Linear Algebra

… ►Because of rounding errors, the residual vector $𝐫=𝐛-𝐀𝐱$ is nonzero as a rule. …

10: 3.6 Linear Difference Equations

… ►Unless exact arithmetic is being used, however, each step of the calculation introduces rounding errors. …