Within the Analog to Digital Conversion (ADC), quantization noise is a duplicate of a Quantization Error (QE) which is introduced by quantization. In signal processing and telecommunication systems, the noise is non-linear and depends on the signal type. During the analog, Sine signal converts to the digital (ADC) process, the two methods are used Rounding and Truncating in-order to eliminate the error produced in the digitization process. The rounding method quantize assigns each sample of sine signal to the nearest quantization level. However, making the Truncating would have assigned each sample of sine signal to the quantization level below it. This paper compares the rounding and truncating methods of QE for sine signal, signal to quantization noise ratio, correlation coefficient, and regression equation of a line for both methods. Then, it calculates the residual sum of squares and compares it to the regression equations of the lines.
ADC, SQNR, RSS, Quantization Error, Correlation Coefficient, Regression Equation
- A. V. Oppenheim, “Applications of digital signal processing,” Englewood Cliffs NJ Prentice-Hall Inc 1978 510 P, 1978.
- P. Zador, “Asymptotic quantization error of continuous signals and the quantization dimension,” IEEE Trans. Inf. Theory, vol. 28, no. 2, pp. 139–149, 1982.
- A. Hasso, K. Jacksi, and K. Smith, “Effect of Quantization Error and SQNR on the ADC Using Truncating Method to the Nearest Integer Bit,” presented at the 2019 International Conference on Advanced Science and Engineering (ICOASE), 2019, pp. 112–117.
- S. Pavan, R. Schreier, and G. C. Temes, Understanding delta-sigma data converters. John Wiley & Sons, 2017.
- B. Widrow and I. Kollár, “Quantization noise,” Camb. Univ. Press, vol. 2, p. 5, 2008.
- A. Hasso and S. Mohammed, “The Effect of ADC Quantization Error by rounding to nearest integer bit,” in 1st international conference on Engineering and innovative Technology, SU-ICETT, Salahaddin University, 2016.
- W. M. Mendenhall and T. L. Sincich, Statistics for Engineering and the Sciences. CRC Press, 2016.
- K. C. Pohlmann, Principles of digital audio. McGraw-Hill, Inc., 1995.