We present several identities and congruences involving Bernoulli numbers, Bernoulli polynomials, symmetric polynomials, and arbitrary polynomials and sequences of positive integers. Some recurrence formulas for Bernoulli numbers, which in special cases reduce to the known identities on Bernoulli numbers, are also presented, and possible relations to Fibonacci numbers are outlined.