This is the field of information geometry: https://en.wikipedia.org/wiki/Information_geometry