The equivalence problem for linear differential operators of the second order, acting in vector bundles, is discussed. The field of rational invariants of symbols is described and connections, naturally associated with differential operators, are found. These geometrical structures are used to solve the problems of local as well as global equivalence of differential operators.