In this paper, we discuss various geometrical structures appearing in the study of random linear operators that act between finite-dimensional vector spaces. We show that they are closely connected to the geometry of the jet bundles over a manifold of the extreme probability measures. Thus, the high order phase transitions appear as singularity in prolongations of the state manifolds. 1