From the free course CS323: Numerical Analysis and Computing on Lykke

Error Analysis and Floating-Point Arithmetic

Key concepts: Machine Epsilon · Floating-point Representation · Catastrophic Cancellation · Absolute and Relative Error

Exploration of how computers represent real numbers and the resulting inaccuracies in calculations.

Error Analysis and Floating-Point Arithmetic

Overview

Computers represent real numbers using a finite number of bits, leading to rounding and truncation errors. This section quantifies these errors and identifies operations that compromise numerical stability.

Key Concepts

  • Floating-point System: Numbers are stored using a mantissa and an exponent (Scientific Notation).
  • Machine Epsilon ($\epsilon$): The smallest positive number such that $1 + \epsilon > 1$ in floating-point arithmetic.
  • Catastrophic Cancellation: A significant loss of precision that occurs when subtracting two nearly equal numbers.
  • Error Metrics:
    • Absolute Error: $|x - \hat{x}|$
    • Relative Error: $|x - \hat{x}| / |x|$

Practical Application

Homework #1 tasks students with calculating approximation errors and implementing image blurring algorithms, demonstrating how error propagates in visual data processing.

Source Materials

Study CS323: Numerical Analysis and Computing on Lykke

This course page is free to open: signed out, you can read its first two sections, and signing in, on any plan, opens the rest. The free Lykke Chrome extension syncs your own Canvas courses, so ChatGPT, Claude and Muse can answer from your classes and deadlines. It only reads Canvas.

Add the free extensionSign in to open every section

All sections of CS323: Numerical Analysis and Computing · Browse more course pages

Error Analysis and Floating-Point Arithmetic — CS323: Numerical Analysis and Computing | Lykke