Robotics Artistic Colorful Picture Drawing and Painting Using Visual Feedback Control System

近幾十年來，隨著生活水平的提升，人們開始追求更高層次的精神享受，機器人的應用不再侷限於工業生產線上產值的增加，越來越多研究團隊投入心力於現代化、具高智慧服務型機器人之研發，這些機器人除了能提供人們所需服務之外，也帶來許多附加的娛樂價值。除此之外，部分科學家更進一步打破了科技以往生硬的形象，嘗試將科技與藝術結合，創造出更多驚奇與想像。 本研究的主題在於將藝術繪畫創作的概念融合進機器人，使機器人能夠像人類一樣創作出具有藝術價值的作品。本研究呈現兩種不同的繪畫風格，第一種著重於人類肖像的繪畫，透過不同的媒材的使用，機器人能夠創作出具有手繪風格的作品。我們強調人物肖像中最主要的三個特徵：顏色、輪廓、結構。人像經過不同影像處理的過程後，取出這三種特徵並融合成具有NPR特色的影像。機器人接著便根據此影像，使用彩色蠟筆、油畫筆、松節油、麥克筆與針筆來進行創作。第二種繪畫風格則更進一步導入傳統繪畫技法，透過機器人視覺回授控制系統，使機器人能夠使用五種基本顏色進行混色來調出各式各樣的色彩，繪畫過程中機器人會比較作品與目標的差異性，進行重複補償與修正，使作品更加完善。我們分析系統的表現並證明透過我們的方法能有效的使作品與原圖更加相似，而調色的誤差也能夠控制在10%左右，對於人眼的色彩敏感度而言是相對可接受的範圍。 此研究展現人工智慧在繪畫創作的可能性，我們除了引入藝術創作的記法與觀念到機器人領域中來創作出許多真正被大眾欣賞的藝術作品之外，也提供藝術家不同的觀點，希望透過科學的方法能夠輔助人們學習繪畫的創作並激發對藝術創作新的想法。In the decades, with the improvement of the living standards, people start pursuing high-level mental enjoyment. The applications of robots are not just limited in industrial purpose which aims to enhance the performance of production in factories. More and more research teams are devoted to the developments of modern and high-intelligence service robots. These robots not only provide different kinds of services, but also bring lots of recreational values to people. Moreover, some researches further break the image that science is stiff. They try to combine science and art together and sparkle new imaginations and amazement. The objective of this research is to integrate the idea of art into robotics applications and make a robot that can create artworks with artistic value just like human artists. In this research, we present two different styles of art. First, the Robot Artist uses mixed media to draw portraits which have hand-painted style. We emphasize on three main features of human portraits: color, silhouette and structure. The input image goes through different image processing steps to extract these features and combine together to form a NPR style image. The Robot Artist will draw the portraits based on this image using color crayons, oil painting brushes, turpentine, makers and technical pens. For the other style, the robot is further endowed with the capability of painting colorful pictures with a visual feedback control system. It can use only five basic colors to mix a variety of colors and repeatedly refine its artworks by comparing the current picture with the original image. We analyze the performance of our system and prove that the errors between two images would decrease effectively using our approach. The mixed colors is also limited in the range about 10% compared to the target color, which is acceptable with respect to our visual perception. In this research, the Robot Artist has successfully achieved the very first step of imitating the human artists and blur the line between human and machine creativity. We incorporate the artistic techniques and concept into robotic field and make the robot create artworks that are truly admired by people. More importantly, we not only present the competence of robots in artistic creation, but also provide a scientific perspective on the creation of art, which can help people learn the techniques of painting