Floating point numbers

Related lectures (28)

Page 2 of 3

Provides an overview of fixed and floating-point arithmetic in digital systems, focusing on their representations and practical applications.

Covers the representation of real numbers in a computer using floating point representation and the dangers of significant digit cancellation.

Discusses fixed and floating-point arithmetic in digital systems, covering representations, operations, and rounding techniques.

Explores the representation of real numbers, errors, and precision in information.

Explores the consequences of floating-point representation errors in programming, emphasizing precision and computational costs.

Explores number representation in computers and bitwise operators for practical programming applications.

Covers classic pen-and-paper methods for arithmetic operations and binary representations of numbers.

Covers the representation of positive integers, binary notation, machine limitations, overflow, and floating-point representation.

Explores floating point numbers, LU decomposition, errors, and matrix properties.