Dissertation > Excellent graduate degree dissertation topics show

Real-time Simulation for3D Subtle Facial Expression Driven by Actions Captured with Kinect

Author: LiangHaiYan
Tutor: TangYong
School: Yanshan University
Course: Applied Computer Technology
Keywords: 3D character animation expressions capture Laplacian deformation action-driven wrinkles function
CLC: TP391.41
Type: Master's thesis
Year: 2013
Downloads: 15
Quote: 0
Read: Download Dissertation


Generating compelling dynamic animated facial expressions is an extremelyimportant and challenging aspect of computer graphics. In recent years, virtual charactershave been well designed and animated in computer games, advertising, and filmproduction, which makes subtle facial expressions of character animation is becomingmore and more important. This paper proposes a new technology which generatedreal-time facial expression animation with subtle facial expressions, so as to drive the3Dfacial mesh model generated virtual3D character animation with subtle movements.Firstly, in order to capture the user’s real-time different expressions, we useMicrosoft’s Kinect3D to track the user’s facial expressions in real-time, then decomposethe motion data into two components: the rigid movement of the head and the change ofthe facial expression. Compared to other human motion capture systems which rely onspecific hardware device, Kinect reduces system hardware and maintenance costs, and forthe natural environments of complex background it has good adaptability.Secondly, by making use of the local-detail preserving property of the Laplaciancoordinate, we clone the captured facial expression and posture onto a neutral3D facialmodel using Laplacian deformation. Eventually produce a virtual3D character animationwith the eyes and mouth movement, and consistent with the expression of the user as well.Thirdly, in order to produce subtle facial expressions such as wrinkles in real-timefacial animation, we generate the coarse skin textures with pore details and those normalmaps, and use blending wrinkle maps to render animated details on a human face based ona GPU shader program. According to the action units captured by the Kinect, we calculatethe dynamic texture mapping and the weight of wrinkles, and apply the wrinkles functionto simulate the motion of wrinkles. As a result, our experiments generate motion-drivenreal-time facial expression animation.Finally, according to professional graphics programming interface OpenGL andadvanced shading language GLSL, we design and implement a real-time subtle facialexpressions simulation system. Experimental results show that our method can generate facial details in real time. The method suits the fields such as digital entertainment andvideo conferencing.

Related Dissertations

  1. Study on the Algorithm of Cranio-facial Reconstruction,TP391.41
  2. Shape Analysis Based on Laplacian Deformation,TP391.72
  3. The Implementation of Plug-in Unit Movement Control Based on 3DS MAX,TP391.41
  4. Application of 3D animation technology in application design with the human body art anatomy,J218.7
  5. Realistic Facial Expression Synthesis,TP391.41
  6. Design and Implementation of Image Authentication on CUDA Platform,TP391.41
  7. Research and System Implementation of Image Retrieval Method Based on Fuzzy Clustering,TP391.41
  8. Research and Application on Detection and Tracking of Object Based on Video Stream,TP391.41
  9. Vehicle Detection and Tracking under Occlusion,TP391.41
  10. Study on the Algorithm of Cranio-facial Reconstruction,TP391.41
  11. The Research of Key Techniques on Computer-Aided Planning before Liver Transplantation,TP391.41
  12. Research and Implementation of Pedestrian Detection in Video Images,TP391.41
  13. Research on Basic Algorithms of Digital Image Processing and Implementation with FPGA,TP391.41
  14. The Research on Moving Object Detection and Tracking Based on Traffic Surveillance Video,TP391.41
  15. A Self-calibration Method of Camera Based on Binocular Stereo Vision,TP391.41
  16. Research on Face Detection System,TP391.41
  17. Research on Moving Object Detection,TP391.41
  18. The Design Research of Visual-Friendly on Digital Interface Icon,TP391.41
  19. Research on Detecting and Tracking of Fish Group Based on Machine Vision,TP391.41
  20. Studies on Preprocessing and Enhancement Algorithm for Fingerprint Image,TP391.41
  21. Gesture Recognition for Traffic Control Based on Thinning Algorithm and Template Matching,TP391.41

CLC: > Industrial Technology > Automation technology,computer technology > Computing technology,computer technology > Computer applications > Information processing (information processing) > Pattern Recognition and devices > Image recognition device
© 2012 www.DissertationTopic.Net  Mobile