Araç içi mobil uygulamalar için çok-kipli algılayıcı analiz altyapısı.

The sensing, computing and communicating capabilities of smart phones bring new possibilities for creating remarkable applications increasing the quality, safety, comfort, economy and other capabilities of cars. However, many challenges exist regarding the development of multimodal sensor analysis applications, such as proper collection of sensor values, integration of diverse libraries and tools for sharing the results. This study focuses on these challenges and aims to construct a framework that enables easy, fast and flexible implementations of smart vehicular applications. The goal is to provide capabilities for real-time sensing, signal and multimedia processing, and sharing of information. Hence, the proposed framework provides an abstraction for easy access to sensor readings, and also diverse signal and image processing libraries are integrated and mechanisms are developed and provided with the framework for information sharing. A sample mobile application is also developed in the scope of this study, in order to demonstrate the capabilities and the feasibility of the developed framework. This application is a multimodal sensor analyzer which intends to detect obstacles on the road or critical road surface anomalies (i.e. pothole, speed bump) by measuring and analyzing different sensors of smart phones (GPS, accelerometer, magnetometer and camera) in real-time. First, the detection is performed on one modality by analyzing the motion of the vehicle using the accelerometer sensor and then a second analysis is performed using the camera images to automatically extract the video section and the image of the corresponding road segment containing the defect. Upon such critical hazard detection, the application instantly informs nearby users about the incident with detailed information and image of the scene. The developed mobile application is deployed on multiple devices as part of a test scenario in a chosen location and the outcomes of the test scenario are measured and evaluated as part of the validation.M.S. - Master of Scienc