Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Excerpt

Manage datasets containing the project input and output data.

Use the Datasets tab to manage data that you feed into your project.

...

  • Active: Datasets on which work is currently progressing.

  • Pending: Datasets that have been imported, but on which work is yet to start.

  • Completed: Datasets on which work is completed.

  • Archived: Datasets on which work is completed and which have been archived for long-term storage. You can archive a pending batch, but you cannot archive an active batch. To archive active batches, you must first cancel the active batch and then archive it.

  • Paused: Datasets on which work started but was paused.

  • CanceledCancelled: Datasets that were imported and then canceledcancelled.

Adding Dataset Batches

Any newly-added batch automatically appears in the Pending tab.

...

To export the output created for a project:

  1. Click the Ellipsis (three vertical dots) icon at the top-right corner of the Datasets table and select Export Project Output.

  2. The Export Project Output modal appears.

    Image Removed

  3. Click the radio button corresponding to the format in which you want to download the output.

  4. Enter the Start Date from which you want to download the output. This setting instructs Taskmonk to download all the output created from the start date that you specify.

  5. Enter the End Date for output download. This instructs Taskmonk to download all the output created up to the end date that you specify.

  6. Click to Select Fields to Download or select the Select all check box to download the data associated with all the fields in your project.

...

3. All is selected by default for Select Batch.

4. Select CSV from the list for Select format.

5. Select the field(s) you want to export for Select fields. By default, all the fields will be exported.

6. (Optional) For Select duration, set the Start Date and End Date to specify that you want to download only those outputs in the dataset on which work was done between the specified dates. By default, it would export for the entire lifetime of the project if nothing is selected.

7. Selectthe Completed tasks only checkbox to download the output associated with only the completed tasks in your project. If not selected, all the tasks will be exported.

8. Click Download to trigger the export. Once the export completes, the modal notifies you and offers a link to download the exported content.

...

9. Click Download File to download the exported output.

10. Click Close to return to the Dataset tab.

Configure Cloud Storage

To configure cloud storage options for your project:

...

Expand
titleEdit / Update a Batch

Edit / Update a Batch

To edit or update a batch:

  1. Click the Edit icon in the row representing the batch. This enables all the editable fields associated with the batch.

    Note: All steps in this section are optional.

  2. Update the Name of the batch.

  3. Click to update the Priority of the batch. The higher the priority value of a batch, the earlier it gets routed to labelers for processing.

  4. Click the ETA field and select the date by which work on this batch must be completed. This will be saved as the target date of this batch.

  5. Click the Update icon to save your changes and update the batch.

...

Expand
titleAssign a Batch to Specific Users

Assign a Batch to Specific Users

To assign a batch to specific users, click the Privileged button in the row representing the batch. When you enable this option, the Add Users option is added to the list of Batch Config tasks associated with the batch. For information on working with this option, see Adding Users to a Batch.

Expand
titleImport Tasks into a Batch

Import Tasks into a Batch

To import tasks into a batch:

  1. Click the Import button in the row representing the batch. The Import Task modal appears.

  2. Select the radio button corresponding to the file type that you want to use to import tasks.

  3. Click Choose Files and select the file that contains the tasks that you want to import.

    Note:

    1. The column names in your import file must match your project’s input field names. If you are unsure about the structure of the input file, click the Download Template File link below the radio buttons. Once you download this template, you can update it using the data that you want to import. You must, however, ensure that your data is organized to match the field labels in the template file.

    2. For media file imports, the allowed file type depends on the field type set in the input fields. For example, video field types allow you to upload only MP4 and AVI files.

  4. Click Import. This triggers the import, and the modal informs you once the import is successful.

  5. Click Close to return to the Datasets tab.

Expand
titleExport Tasks from a Batch

Export Tasks from a Batch

You can also download the tasks that you have imported into Taskmonk, regardless of whether they are completed or not.

This does not delete the tasks in Taskmonk.

To download an imported task:

  1. Click the Export button in the row representing the batch. The Import Task Export Batch modal appears.

    Image Removed

  2. Select the radio button corresponding to the format in which you want to download the exported tasks.

  3. Enter

    Image Added

  4. The current Batch name is selected by default for Select batch.

  5. Select CSV for Select format which corresponds to the format in which you want to download the exported tasks.

  6. For Select fields, select the fields to be exported. By default, all the fields will be exported.

  7. (Optional) For Select duration, select the Start Date and End Date to specify that you want to download only those items in the dataset on which work was done between the specified dates (optional).Click Select Columns to choose the columns whose data you want to download. If that you want to download the data only those outputs in all the columns, select the Select All Fields check boxthe dataset on which work was done between the specified dates.

  8. Select Completed Tasks Only to download only those tasks that are complete.

  9. Click Download to export the file.

  10. Once the file is exported, click Download File to save the exported file to your machine.

    Image Added
  11. Click Close to exit the modal and return to the Datasets tab.

...

Expand
titleView Batch Documents

View Batch Documents

To view the documents associated with a batch:

  1. Click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click View Batch Documents. The View Batch Documents modal appears.

  2. Click the View Item icon to view the document in a separate modal. You can even download the uploaded file by clicking the Download Item icon.

  3. To delete an uploaded item, click the Delete Item icon.

  4. Click Close once you are done.

Expand
titleImport Output

Import Output

If you have already done some annotation, you may want to include it into a batch by importing it. To import project output into a batch:

  1. Click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click Import Output. The Import Output modal appears.

  2. Click to select the format in which you want to import the output. You can choose between Excel and CSV.

  3. Click Choose Files to select the files that you want to import.

  4. Click the Select Level field and choose the output levels that you want to import.

  5. Click Import. The data in the files you selected will now be imported into the task execution levels of your choice. When team members working on the next level log in, they will find that the batch is ready for their work, as the work associated with the previous level is already complete.

Expand
titleExport to Customer

Export to Customer

To export the output of a batch to a customer:

  1. Click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click Export to Customer. The Export to Customer modal appears.

  2. Click to select the format in which you want to export the output. Choose from the available options, CSV and Excel.

  3. Use the Start Date and End Date fields to select the start and end dates between which the data that you want to export was created.

  4. Click the Select Column field to select the fields that contain the data that you want to export. If you want to export the data in all the fields, choose Select all fields.Note

    This will include only those fields for which Customer Visible is marked as True in the Task Design > Field Settings page.

  5. Select the Completed Tasks Only check box to indicate that you want to export only completed tasks.

  6. Click Download to create the exported file.

  7. Once the file is ready, the Download File link appears. Click this link to download the exported file.

  8. Click Close to return to the Datasets page.

Expand
titleChange State

Change State

To change the status of a batch:

  1. Click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click Change State. The Change Batch State modal appears.


    The Change Batch State modal displays the current status of the batch and enables you to change it as required.

  2. Click the Change State to drop-down list and choose the new state that you want to assign to the batch.

Depending on the initial state of the batch, the target states change. For details on the options available to you in each state, see the table below:

Current State

Target State Options

Comments

Active

Pause, Canceled

When an active batch is paused, tasks from the batch are no longer passed to team members; but the progress made is saved.

Pending

Pause, Canceled

When a pending batch is paused, the batch is taken off the queue and does not automatically become active until its status is changed to Resume.

When a batch is canceled, it is taken off the queue and can only be moved to Pending. The progress made, however, is saved.

Completed

Archived

Archived

Pending

When an archived batch is moved to Pending status, it is reintroduced into the queue. The progress made before archival is retained.

Paused

Resume, Canceled

Canceled

Pending

When a canceled batch is moved to Pending, the batch rejoins the queue. All the progress made before cancelation is retained.

Expand
titleAdd Users to a Batch

Add Users to a Batch

To add specific users to a batch:

  1. Enable the Privileged toggle in the batch where you want to add users.

  2. Click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click Add Users. The User Allocation to Privileged Batch modal appears.

    The User Allocation to Privileged Batch modal enables you to add specific users to a batch. The users listed here must have been previously added to the project.

  3. Click the Assign Users to Batch drop-down list and select the users whom you want to assign to the batch.

  4. Click Save.

...

Expand
titleView as Gallery

View as Gallery

If you are working on an image-related project, the Gallery View enables you to view the images that you imported in a batch, and perform specific tasks related to the images in the batch.

To access the gallery view, click the Batch Config Settings icon in the row representing the batch and, from the menu options that appear, click Gallery View. The Gallery View modal appears.

The Gallery View modal offers controls that enable you to perform the following tasks:

  1. Search for specific images

  2. View labeling input and output

  3. Revalidate completed labeling

  4. Download the dataset

  5. Regenerate output for completed tasks

Search for Images

To search for an image in the Gallery, enter any part of the name of the image in the Search field. The modal displays a filtered list of images in real time.

View labeling input and output

The Gallery View modal displays both input images and the output that labelers created for them.

Viewing Labeling Input

The input images appear by default when the Gallery View modal appears. To redisplay the input view if you are viewing the output, click the View drop-down list and select Input.

Viewing Labeling Output

To view the output view and related details:

  1. Click the View drop-down list and select Output. The modal now displays the images that have been labeled while displaying placeholder images for those that haven’t been labeled yet.

  2. To view the labeling details associated with an image, click it. The image opens in a new modal named after the image, and you can see both the input image, output labels /or segmentation, and the overlapped visualization view.

  3. To download the JSON file generated by the labeling, click Download JSON.

  4. Click Regenerate Output to regenerate the labeling output. This is especially useful if you decide to change the output format of the labeling data. For example, if you changed the output format from COCO to Pascal VOC, or any other custom format, click this button to regenerate the labeling data in the new preferred format.

  5. Click OK to close the modal and return to the Gallery View modal.

Revalidate completed labeling

UI not there yet
  1. .

Download the dataset

To download the dataset, complete with the labels, visualizations, and so on, click the Download Dataset button. All the data associated with the batch downloads on to your computer as a ZIP file.

Regenerate output for completed tasks

If you change the output format settings associated with your project mid-way into a batch, you may want to regenerate the output to match the new format requirements. To do so, click Regenerate Output for Completed Tasks and click Yes in the confirmation modal that appears.

...