A joint project of the Graduate School, Peabody College, and the Jean & Alexander Heard Library

Title page for ETD etd-01292010-143108

Type of Document Dissertation
Author Kushwaha, Manish
Author's Email Address manish.k79@gmail.com
URN etd-01292010-143108
Title Feature-level information fusion methods for urban surveillance using heterogeneous sensor networks
Degree PhD
Department Computer Science
Advisory Committee
Advisor Name Title
Xenofon Koutsoukos Committee Chair
Akos Ledeczi Committee Member
Gautam Biswas Committee Member
Mitch Wilkes Committee Member
Yuan Xue Committee Member
  • information fusion
  • sensor networks
  • heterogeneous networks
  • target tracking
  • video tracking
Date of Defense 2010-01-26
Availability unrestricted
Wireless Sensor Networks (WSNs), with low-power wireless devices integrated with sensors and actuators, are emerging as a new computing paradigm that promise to seamlessly integrate cyberand physical-worlds. WSNs have great potential for many existing and novel application areas such as environmental monitoring, industrial and manufacturing automation, health-care, and military.

Heterogeneous Sensor Networks (HSNs), with heterogeneity in terms of their computation resources, wireless link properties, power capacities or sensing modalities, are the natural step in the evolution of WSNs driven by several factors, such as multiple application support, incorporation of legacy hardware, hierarchical deployment/architecture, and monitoring of multimodal phenomena. HSNs have been increasingly used in surveillance applications such as monitoring and tracking. Such applications require an information fusion framework that incorporates the data from multiple sensors. Classical target tracking approaches, such as probabilistic data association filtering and multiple hypothesis tracking, perform decision-level information fusion, wherein local decisions are made on the sensors which are then fused at a centralized location for global decision and tracking. Such approaches suffer from poor discrimination and exponential complexity, especially for multiple targets. Target tracking approaches based on signal-level information fusion, wherein the entire raw data from sensors are utilized for tracking, are not feasible in WSNs due to limited communication bandwidth.

The goal of this dissertation is to develop feature-level information fusion methods for target tracking in HSNs. Feature-level information fusion, wherein several features that are extracted from the raw data, should be used for tracking due to their lower communication bandwidth requirement, while maintaining good target discrimination capability. We design and implement a multimodal multisensor information fusion system for target tracking in an urban environment using an HSN of audio and video sensors. We demonstrate the system operating online in real-time. Further, we extend the audio sensing component of the multimodal system by including multiple acoustic features. We develop and implement a feature-based approach to collaborative source localization of multiple acoustic sources in WSNs. We also extend the video sensing component of the system to include multiple video features. We develop and implement an approach for collaborative target tracking in 3D space using a wireless network of smart cameras.

  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  dissertation_kushwaha.pdf 7.01 Mb 00:32:26 00:16:41 00:14:35 00:07:17 00:00:37
  experiment_videos.zip 43.03 Mb 03:19:13 01:42:27 01:29:39 00:44:49 00:03:49

Browse All Available ETDs by ( Author | Department )

If you have more questions or technical problems, please Contact LITS.