On Precision
I recently talked about precision in a lab meeting, where I connected it to Helical semantics. This post summarizes some of the background and observations that informed that chalk talk.
There are three uses of precision that I focused (and will focus on in this post):
- finite precision/floating point representations,
- measurement precision of an instrument, and
- statistical precision (inverse covariance).