A Mobile Human Computer Interaction System Integrated with Augmented Reality for Education Application

⾏動裝置應⽤在近幾年已經⾮常普及，⾏動⼈機互動介⾯的研究也⾮常蓬 勃的發展。智慧⾏動裝置也可以藉由設計出視覺化且友善的學習⼯具應⽤於教育上。我們的研究在各種不同的⾏動⼈機互動⽅式中設計出可以應⽤於教育、娛樂與運動上不同的互動應⽤。我們設計了⼀個提供⼩朋友可以在平板上畫沙畫的應⽤，不需要複雜的操作介⾯即可培養⼩朋友藝術的創作⼒。此外我們發現⾏動裝置上觀看影⽚的需求是⾮常強烈的，我們提出⼀種新穎的跨屏幕播放技術，讓使⽤者可以輕鬆的將⼿機螢幕播放在⼤屏幕上。虛擬實境與擴增實境的應⽤也⽇漸普及，我們整合擴增實境與⾏動裝置、並結合實體的遙控玩具設計出⼀套互動平台，藉由設計出⼀些富有教育意義的應⽤讓⼩朋友能⼀邊遊玩⼀邊學習。⽽最後我們提出⼀套結合虛擬實境的⾶輪運動遊戲系統，讓規律性的運動不再枯燥乏味。⽽此系統也能達到間歇性運動的效果。藉由研究與整合不同的⾏動互動⽅式我們的⽅法可以讓教育學習與運動可以更加多元有趣。Mobile technology is important recent research interest and trend in HCI (Human Computer Interaction) community. Smartphones have been integrated into education in aiding students to learn with visual and friendly learning tools. Our research focuses on various mobile human computer interaction methods. In order to research about touch gestures and computer graphics, we design and implement a sand drawing APP in iPad, so that users do not need a complex environment to experience the fun of the sand painting that can increase student artistic abilities. In addition, we find that users have higher requirements on video playback. In order to study the user mobile behavior, we proceed to design and implement search engine of VOD (Video On Demand) aggregator for mobile devices and a novel C.F. (Connect-Future) player for multi-screen viewer. However, about the user interaction mode, we would like to present an interesting learning method, thus we design a MAR (Mobile Augmented Reality) game that can help young students learn traffic rules. Through a series of different interactive modes of application, our research focuses on the educational applications of Augmented Reality as a visualization tool