The Precision Gap: Visualizing Floating Point

Exploration of how computers represent numbers and the various types of errors that arise during numerical calculations. The Precision Gap: Visualizing Floating Point turns that idea into something you can manipulate directly and watch respond.

Exploration of how computers represent numbers and the various types of errors that arise during numerical calculations. It focuses on Floating-Point Arithmetic, Truncation Error, Rounding Error, Absolute vs. Relative Error from the “Mathematical Foundations and Error Analysis” section.

This course provides a comprehensive introduction to the development, analysis, and implementation of algorithms for solving mathematical problems numerically. It covers essential topics such as error analysis, root-fin… This demo is the interactive piece for the “Mathematical Foundations and Error Analysis” section. Open the full Numerical Analysis and Computational Methods course wiki at https://www.getlykke.com/explore/public/numerical-analysis-and-computational-methods-6291d550-43fa-4c2d-be17-f8580436eb72 for notes, flashcards, quizzes and the other demos.

You'll build intuition for Floating-Point Arithmetic, Truncation Error, Rounding Error, Absolute vs. Relative Error — and, crucially, see how they behave when you change the inputs, which is hard to get from a textbook or lecture on Numerical Analysis and Computational Methods alone.