Question: template for video chunks (time codes) classification

[Alex Babrykovich]

Intro

I have a large dataset of gameplay videos, which I would like to classify according to the game state i.e. in-game, menu, lose, win, ad and etc.

Problem

My videos usually have 3 min in length and game state changes during the video ~50 times, so it's not really convenient to split them on 50 different videos

Ideal solution

It will be nice to allow classifying each frames by time codes for example:

00:00 menu # all frames till next timecode are considered as 'menu'
00:05 loading # all frames till next timecode are considered as 'loading'
00:06 play # all frames till next timecode are considered as 'play'
01:23 win # all frames till end are considered as 'menu'

Or maybe there is an approach for annotating individual frames

Any other suggestions to achieve the goal, classify chunks of the video are appreciated