Bilkent University
Department of Computer Engineering
CS590 SEMINAR
Genre Based Trailer Generation with Deep Multimodal Learning
Irmak Türköz
MS Student
(Supervisor: Asst. Prof. Dr. H. Altay Güvenir)
Computer Engineering Department
Bilkent University
Trailer advertising provides crucial information that can help viewers and investors form expectations about the movie's future success. Recently, there have been few attempts to automatize the trailer generation however, AI-generated trailers were considered less attractive than editors' creation. Fortunately, usage of the most recent advancements in deep learning and greater available datasets can accelerate the automated trailer generation and it is possible to generate multiple trailers to offer personalized advertisements to the audience to provide a drastically improved experience for users and advertisers alike. To the best of our knowledge, personalized advertisements of the movies via genre-specific trailers will be the first research in the automated trailer generation studies. Instead of using long movies, the multimodal network will learn from shorter trailers, with accessing 16 multi-class input of trailers and 16 multi-class output tasks. The feature learning will be made with automatized scene detection of the trailers, and the sound based Mel-frequency cepstral coefficients (MFCCs). Later, this pre-trained model will be used on actual movies in an unsupervised manner to detect the individual segments belongs to each genre. The final result of the model will be cut scenes and these will be sent to post production of the editors and will be evaluated with the surveys presented to the diverse interests groups.
DATE: 02 December 2020, Wednesday @ 13:15