Turn videos into comics, with the power of AI 🎉

About

In our project, we present a Web-based working solution for video comixification - a task of converting a video into a comics. We split this task into two separate problems: (a) frame extraction and (b) style transfer. To extract meaningful, representative frames from the video we employ a keyframe extraction algorithm based on Reinforcement Learning, while for transferring the style into comics we implement a generative adversarial network (GANs) model. Since there have been many works published on the so-called neural style transfer, we evaluate them all on the very same task, namely frame comixification and select the most appropriate method. We examined different combinations of Adaptive Instance Normalization, Universal Style Transfer and GAN models and confront them to find their advantages and disadvantages in terms of qualitative and quantitative analysis. In the near future we would like to introduce next two parts: Comic Grid Layout Generation and Speech Extraction.

Want to cartoonize the whole video? Contact us at contact@comixify.ai with the details!

API

Request:

Path: http://comixify.ai/comixify/

Method: POST

Data:
{
    file: video/*
}

* Max size of video is 100 MB, max length of the video is 25 minutes.

Response:

{
    status: string,
    comic: string
}

comic - url to result comics

Reference

Please cite the following paper if you use the API:

Comixify: Transform video into a comics
Maciej Pęśko, Adam Svystun, Paweł Andruszkiewicz, Przemysław Rokita, Tomasz Trzciński
arXiv:1812.03473, 2018

Acknowledgements

We would like to thank Google for granting us free Google Cloud Platform credits that enabled us to develop our project.

Contact

Contact us through contact@comixify.ai

(If you want to use comixify in your business, send us an email.)

Data processing info:
We do not store your uploaded video. After your video is processed, it is immediately deleted. We do store the generated comics.