Motivated by a relationship between the Zamolodchikov and NLSM metrics to the so-called quantum information metric, I will discuss recent work on understanding infinite distance limits within the context of information theory. I will describe how infinite distance points represent theories that are hyper-distinguishable, in the sense that they can be distinguished from "nearby" theories with certainty in relatively few measurements. I will then discuss necessary and sufficient ingredients for the appearance of these infinite distance points, illustrate these in simple examples, and describe how this perspective can help the swampland program.