In details, some methods, statements, and theoretical results relating to problems of applying information theoretic approaches within stochastic system identification and robust control are analyzed and investigated. Recently published results on using information theoretic criteria, entropy based robust control are reviewed, with the analysis being shown to lead to unexpected inferences.