We study nondiffracting accelerating paraxial optical beams in periodic potentials, in both the linear and the nonlinear domains. In particular, we show that only a unique class of z-dependent lattices can support a true accelerating diffractionless beam. Accelerating lattice solitons, autofocusing beams and accelerating bullets in optical lattices are systematically examined.