Prof. Dr. Marcus Magnor
Photo-realistic modeling and digital editing of image sequences with human actors are common tasks in the movies and games industry. The processes are however still laborious since tools only allow basic manipulations. This project aims to solve this dilemma by providing algorithms and tools for automatic and semi-automatic digital editing of actors in monocular footage. To enable visual convincing renderings, a digital model of the human actor, detailed spatial scene information as well as scene illumination need to be reconstructed. Hereby plausible look and motion of the digital model are crucial.
Motivation
Providing tools for 3D post processing of standard monocular video footage enables a wide range of editing and compositing possibilities. Possible use cases are not limited to professional movie production. Improving personal hardware such as in PCs or mobile devices give users access to technology based on latest research in scene reconstruction. Virtual or augmented reality applications for entertainment or e-commerce for example, benefit from latest scientific findings.
Challenges & Highlights
Providing tools for 3D post processing of standard monocular video footage enables a wide range of editing and compositing possibilities. Possible use cases are not limited to professional movie production. Improving personal hardware such as in PCs or mobile devices give users access to technology based on latest research in scene reconstruction. Virtual or augmented reality applications for entertainment or e-commerce for example, benefit from latest scientific findings.
Potential Applications & Future Issues
Potential applications can be found in the movie industry or in augmented reality applications. Former projects have already investigated how the clothing of an actor can be virtually edited. Use cases can be found in fashion industry, e-commerce or youth protection. The long-term goal is, to lay the foundation for a digital archive of digital actor doubles. The acting performance of current and past artists can so be preserved for the future and may be re-used at any time.
Manager
Begin
End