3D Facial Animation Controlled by Face Tracking

Kreacija i modifikacija 3D modela pomoću programa VRoidStudio i Blender. Glavni zadatak je bio animirati lice 3D modela pomoću praćenja lica. Zadatak je napravljen koristeći detekciju lica pomoću biblioteke Visage|SDK. Pomoću kamere i Visage|SDK smo dobili razne podatke o licu koje smo na 3D model prenijeli pomoću blend shapes ili morph targets. Blend shapes je tehnika deformiranja jednog mesha kako bi dobili niz izvedbi tog mesha. 3D model ima blend shape lica za većinu pojedinačnih pomaka pravog lica. Rezultat je da 3D model oponaša većinu ekspresija snimljenog lica u pravom vremenu.The creation and modification of 3D models using VRoidStudio and Blender. The main goal was to animate a 3D model's face using face tracking. The task was done by using face detection with the Visage|SDK library. With the camera and Visage|SDK, we obtained various face data that we translated to the 3D model using blend shapes or morph targets. Blend shapes is a technique of deforming one mesh to get various similar meshes. The 3D model's face has a blend shape for most real life face movements. The result is that the 3D model mimics most of the expressions of the captured face in real time