Skip to main content Skip to page footer

Sebastian Maisel

Title of the PhD thesis:“The ‘Art’ of Video Editing? An Approach to an Artificial Reconstruction of Expert-Controlled Multi-Camera Live Video Editing using Machine Learning”
Degree programme/institute:Institute for Applied Artificial Intelligence
Supervisor:Prof. Dr Johannes Maucher
Description:Real-time video editing in broadcast productions, as well as for live events, comes into play wherever a single sequence of events is to be captured using multiple video cameras, usually from different angles and with varying shot sizes. Depending on the specific action, framing, camera angles and other visual parameters relating to the protagonists, viewers are presented with an edited feed compiled from the available camera signals. As this editing process involves numerous interdependencies and must always be kept engaging yet informative, this task is currently carried out almost exclusively by trained video editing specialists. Due to the high costs, a sector-specific shortage of skilled workers and other operational constraints relating to human resources, I will investigate whether, and to what extent, a (partially) automated solution for real-time video editing using a machine learning approach is feasible and successful. A significant part of this work will also involve preparing and extracting further abstract information from the data (visual aesthetics, temporal context, anomaly detection) in order to provide a solid data foundation for the video editing algorithms. A further part of the work will then focus on optimising the resulting image parameter models. Finally, the added value of these models is to be utilised and evaluated in a (rule-based) editing algorithm, which is yet to be developed. As video editing varies significantly depending on the genre of the live programme, the scope of application is to be clearly limited to discussion programmes (talk shows) and debates.
Key Words:Machine Learning, Computer Vision, Video Editing, Camera
Publications: 

Contact

Sebastian Maisel Institute for Applied Artificial Intelligence maisel@hdm-stuttgart.de +49 711 8923-2474