This paper describes a novel approach for reducing the processing time of the histogram probabilistic multi-hypothesis tracker (H-PMHT) algorithm in video applications. Video data of flying vehicles is taken from surface to air, and a temporal difference-based technique is applied to video frames for meeting the intensity demands of H-PMHT algorithm. This technique also enables discrimination between objects and eliminates clutter. Variations between the structures of the standard and the improved version of H-PMHT algorithms are described. In addition, the improved H-PMPT is compared with the standard H-PMHT and another approved tracking algorithm to evaluate the performance and processing time reduction ratings