Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this example, you create a video annotation project to identify and label roads and signboards in a video recording.

Project Overview

You want to create a project that enables you to identify and label roads and signboards in a video recording.

...

  1. List out your project requirements.

  2. Identify sample videos that you can use for labelling.

  3. Configure project metadata.

  4. Manage your project input and output fields.

  5. Create the workflow that you want to implement in your project.

  6. Add users to your project and assign them project roles.

  7. Add a dataset to the project.

  8. Start labelling input video.

  9. View batch status reports.

This document explains how you can perform each of the tasks listed above. Specific sections in this document also contain sample data that you can use to easily create and implement this project in Taskmonk.

Listing Project Requirements

In this project, you want to:

  • Identify and label roads and signboards in a video recording.

Sample Input Data

For the purposes of this example, we shall use a stock video recording available here.

You select the stock video recordings that you wish to annotate. You paste the URLs of the recording into a Microsoft Excel sheet under columns labelled MediaUrl. You save the Microsoft Excel sheet as Video_Annotation_Input.xlsx on your hard drive.

 

...

Download Source File

You can follow the steps listed above to create your Microsoft Excel sheet; you can also download and use this file in your project:

...

Each downloadable file is available as a ZIP file. To use it, download the file and unzip its contents.

Configuring Project Metadata

Project Metadata is the first tab that appears when you create a project. The Project Metadata tab enables you to provide basic information, such as the name, process, and project type, associated with your project. You can also upload any documentation that you may want to add to your project.

...

The Task Design tab appears. Use this tab to manage your project input and output fields.

Managing Project Input and Output Fields

Project input and output fields are key elements that determine what happens in your project. The input fields that you specify here will appear as available options for input in your project. Similarly, the output fields that you configure here will appear as output options in your project execution UI. In other words, your project can only uptake and output data associated with the input and output fields that you create here.

...

  • Input Field

    • Field Name: MediaUrl, Field Type: Image

  • Output Field

    • Field Name: Annotations, Field Type: Annotation, Mandatory: False, Disabled: False, Customer Visible: True

    • Field Name: Classes, Field Type: Class, Mandatory: False, Disabled: False, Customer Visible: True

    • Field Name: Scenes, Field Type: Scene, Mandatory: False, Disabled: False, Customer Visible: True

    • Field Name: Segments, Field Type: segment, Mandatory: False, Disabled: False, Customer Visible: True

Updating Input Field Details

  1. Click the Input Field tab to display the Input Field UI.

By default, Taskmonk sets the field type to Image. To edit this, select Field Type > Video.

...

Creating Output Field Details

Click the Output Field tab to display the Output Field UI.

...

To the Classes field, you wish to add two possible values: Road and Signboard. To do so, click Possible Values > Edit Classes. The Manage Possible Values page appears.

Creating Quality Workflows

The Quality Workflow tab enables you to specify how you want to ensure output quality. It also helps you create the execution levels required for your quality workflows. For example, you want to create the following levels for this project:

...

  1. Click Next to move to the next step, Process Logic.

Creating Process Logic

Quality Workflow > Process Logic tab allows you to decide the logic based on which datasets are moved from one execution level to the next. For the current project, you want to enable the following rules:

...

  1. Repeat the above step to add rules for each level change.

...

Managing Users and Role

You must now add users to your project and assign the execution levels you just created to them.

...

  1. Click Add to add the selected users to the project.

  2. Close the modal.
    The Manage Users tab reloads to display the updated user details.

Managing Project Datasets

Your project is now configured. Congratulations!

...

  1. Click Submit. This creates a new batch of data for your project and adds it to the Pending tab of the Datasets page. You can now upload datasets into the batch, as required.

  2. To add a dataset to the batch, click the Import button under the Tasks(Import/Export) column. The Import Task modal appears.

  3. Click Choose Files, select the sample input file from your computer and click Import.

  4. Once the dataset is imported, click Close to exit the modal.

...

Labeling Video Using Taskmonk

Your project is now ready for work.

  1. Log in as a Transcription Analyst and click the My Tasks icon at the top of the page. The Tasks page appears.

...

  1. Click the Get Tasks button. The labelling UI associated with this project appears.

...

  • Batch Name (Batch 1) in the top-left section of the page.

  • A video player with playback controls and a timeline.

  • Toolbox containing various tools for creating annotations.

  • Scenes to classify scenes in a video.

  • Segments - Utilise this feature to further break down the scenes.

  • Classes and objects to classify elements in the video.

  • Audio Waveform for reference.
    For detailed information on working with a typical labelling UI, see Labeling Data.

Viewing Batch Status Report

  1. Go to the Projects page and click Reports > View for the POS Tagging project. The Reports page appears.

  2. Click on Dataset Progress Reports to view the batch status report. This shows the total number of tasks pending and completed at each level for all batches.

...