RAPID UNIFIED HMI AND PHYSICAL AGENT DEVELOPMENT FRAMEWORK FOR A CLASS OF CYBER PHYSICAL SYSTEM

In this dissertation, a novel unified development framework is developed to support multi-systems design, visualization, and integration for Human Machine Interface (HMI) and physical embedded agents, and real-time vision system. We address the open source and platform-independent software architecture, system integration, and communication infrastructures to support rapid design and realization. The proposed strategy is based on the new abstract visual modeling and automatic code generation technique for a class of Cyber Physical System (CPS). Unlike middleware integration approach, the new unified development framework supports the developer\u27s needs by realizing a platform independent development methodology that bases on the model orientation paradigm. It captures the important characteristics of HMI and embedded system domain in abstract and reusable models. The system communication between each application domain is seamless in design perspective. Moreover, it allows multiple communication design flows to be embedded inside a single design diagram. The proposed development framework has the following properties. a) Multi-domain software design and integration framework for HMI system, embedded system, and real-time vision system b) Open source software framework c) New abstract visual modeling technique for unified HMI, embedded agent and vision framework d) Multi-communication infrastructure e) Platform-independent architecture Four different CPS application examples have been carried to verify the performance of the proposed design framework. These include: 1. Telecontrol of robotic system for biomedicine application 2. Real-time supervisory control of mobile robotic system and optimal path planning 3. System analysis, design, and integration for legacy subsystem 4. System analysis, design, and integration for real-time traffic sign detectio