In our project, we present a Web-based working solution for video comixification - a task of converting a video into a comics. We split this task into two separate problems: (a) frame extraction and (b) style transfer. To extract meaningful, representative frames from the video we employ a keyframe extraction algorithm based on Reinforcement Learning, while for transferring the style into comics we implement a generative adversarial network (GANs) model. Since there have been many works published on the so-called neural style transfer, we evaluate them all on the very same task, namely frame comixification and select the most appropriate method. We examined different combinations of Adaptive Instance Normalization, Universal Style Transfer and GAN models and confront them to find their advantages and disadvantages in terms of qualitative and quantitative analysis. In the near future we would like to introduce next two parts: Comic Grid Layout Generation and Speech Extraction.
* Max size of video is 50 MB, max length of the video is 15 minutes.
comic - url to result comics
Please cite the following paper if you use the API:
Comixify: Transform video into a comics
Maciej Pęśko, Adam Svystun, Paweł Andruszkiewicz, Przemysław Rokita, Tomasz Trzciński
We would like to thank Google for granting us free Google Cloud Platform credits that enabled us to develop our project.
Contact us through firstname.lastname@example.org
(If you want to use comixify in your business, send us an email.)
Data processing info:
We do not store your uploaded video. After your video is processed,
it is immediately deleted. We do store the generated comics.