The Task System is is used to pipeline data from its initial raw form into a final labelled dataset. It has 3 stages: Annotate, Review, Verify. These stages are used to ensure only high quality data enters the final dataset while allowing managers to verify progress and quality as work is completed.
Prerequisite:
- Task’s for a project have been created (Learn More)
Getting Started
To open the task system click on the task icon from anywhere in the annotator.
You now are in the task dashboard. This Board is split into 3 sections.
- Tasks you own
- Tasks delegated to you
- Tasks completed
Tasks you own
The main functionality on this tile is in the top right statistic symbol which will take you to the task overview and give you access to more functionality.
Tasks delegated to you.
There there are 3 actions you can take. Open the task system as an annotator, reviewer or validator.Only the jobs that are available to you will be available. A task that you have access to but does not yet have allocated to it will appear as greyed out. For example if no images have been sent to be reviewed yet then the review stage is not accessible. The 3 portals purpose and differences are as described
- Annotator – Create the raw polygon and initial classification of each polygon
- Reviewer – Review polygon and classification and ensure annotation high quality
- Validator – Final check to confirm data is correct and polygon is high quality. Image is now validated
The 3 portals can be seen and are accessible on each task tile delegated to you under the “Tasks you are assigned to” title.
Annotator Mode
The Annotator’s role is to create the polygons and set a class for each. Once completed the image is sent to the Review stage
Special Functionality:
- Directed Polygon Validation Mode
- Send to Reviewer
Reviewer Mode
The Reviewer role is a middleman step to check polygon quality and label accuracy. Small changes are ofter made here as this role is often taken by an expert in the related dataset field. Once completed the image is sent to the Validation stage
Special Functionality:
- Directed Polygon Validation Mode
- Send back to annotator
- Send to Verifier
Validator Mode
The Validator role is to provide the final check on each image and validate it. This the equivalent of clicking the “tick” icon for an image in the default annotation portal. At this point the images will be added into the training pool.
Special Functionality:
- Directed Polygon Validation Mode
- Send back to annotator
- Send back to reviewer
- Validate Image