We construct a model of even twisted differential K-theory when the underlying topological twist represents a torsion class. We use smooth U(1)-gerbes with connection as differential twists and twisted vector bundles with connection as cycles. The model we construct satisfies the axioms of Kahle and Valentino, including functoriality, naturality of twists, and the hexagon diagram. We also construct an odd twisted Chern character of a twisted vector bundle with an automorphism. In addition to our geometric model of twisted differential K-theory, we introduce a smooth variant of the Hopkins-Singer model of differential K-theory. We prove that our model is naturally isomorphic to the Hopkins-Singer model and also to the Tradler-Wilson-Zeinalia...