Addressing Scalability of Network Traffic Duplication Mergers in a Simulated Environment

The measurement of wireless traffic through passive data collection is an in-creasingly used tactic to detect malicious network usage. Multiple passive data collectors are likely to have regions of overlapping coverage, and multiple copies of the same network traffic can be detected at several points. In order to effectively operate on the collected data, these duplicate packets must be removed and for active monitoring systems this must be achieved in near real-time. The task of identifying and combining duplicate packets has been addressed by a team at Dartmouth College in New Hampshire, USA, as part of an ongoing project[3]. As the coverage of the collection points expands and the volume of collected data increases the load on the merging utility tasked with removing duplicates can become unwieldy. In order for comprehensive, near real-time monitoring of this traffic a new approach to merging many streams of collected information must be established. The aim of this project is to devise a method for improving the capacity of