SoK/2021/StatusReport/Pranav Gade

Adding support for video annotation to marK

Background

marK(https://invent.kde.org/education/mark) is a scientific tool for data annotation. It currently supports annotating text and images. I am currently working on adding video annotation support to marK. Video annotation would enable users to select and annotate sections of a video by selecting particular frames and drawing to select regions of the frame, just as one would annotate videos. Majority of the user interface would be similar to Image annotation. Alongside that, a timeline/scroll bar will be available to select or seek to the correct frame.

Mentor

Caio Jordão Carvalho

Progress

The work is currently at https://invent.kde.org/pranavgade/mark and is expected to be merged into the main repository at the end SoK.

Right now, the user can open mp4 files and use the UI to go to a particular time in the video. However, this is easily extensible and can be updated to include other video formats by updating the list of mime types accepted. Although annotation is possible, the input is not stored or exported. This is the next stage of the project.

Screenshots

Commits

The up-to-date commits can be found here https://invent.kde.org/pranavgade/mark/-/commits/master

What I've learnt

As I had expected, this was a challenging project. Since I am not used to contributing to a preexisting codebase, a lot of my time was spent on trying to figure out how the existing application worked, and learning what the most appropriate method would be. I wasn't very good at Qt either, but thanks to my mentor, Caio, I was able to figure out and learn a lot of things.

Contact

You can send mea an email at [email protected], or find me on telegram at @pranavgade20