QA

Customize your job settings Save settings Start data routing Test Question Settings Customize your test question settings. JobMode Select the mode that you will run your job in. Quiz Mode Only Work Mode Only Quiz + Work Mode Minimum Accuracy Contributors must maintain this accuracy throughout the job. % Rows Settings Customize your rows settings Judgments per Row This setting can not be modified once you start routing data to this job Unit Group Options This setting can not be modified once you start routing data to this job Retain Grouping Ignore Grouping Rows per Page Set the number of rows of data to be displayed on a page of work Assignment Lease Expiry min Timelimit Alert Threshold % Allow Contributors to QA Their Own Work Allow Abandon Units Max Number of Abandons This is the maximum number of times a unit can be abandoned and go back to the job. After this limit is reached the unit will be given the status ABANDONED in the dataset. times Dynamic Judgments Customize your dynamic judgments settings Dynamically Collect Judgments If contributors disagree on an answer, the job will automatically request additional judgments. Max Judgments per Row This is the max judgments a row will collect. We recommend 2-5 judgments per row. Enabled Questions Select the questions that determine if more judgments are needed. AVAILABLE QUESTIONS SELECTED QUESTIONS Criteria to Stop Collecting Judgments Please select one of the two options to stop collecting judgments: Minimum Confidence We'll stop collecting judgments on a row when the row's confidence score is above this value or when max judgments is reached Recommended: at least 0.7 Matching Judgments Contributor Settings Setup your contributor channel and target settings EXTERNAL Choose your External Contributor Channel. You will not be able to change this selection once data has started routing to your job, however you can update the configuration within your selection at any time. INTERNAL Leverage your own in-house workforce MANAGE CONTRIBUTORS Click the Manage Contributors' button to assign individuals to the project Manage Contributors PUBLIC LINK Anyone with this link can work on the task. Share Link is disabled Copy Link