Crowd markets have traditionally limited workers by not provid-ing transparency information concerning which tasks pay fairlyor which requesters are unreliable. Researchers believe that a keyreason why crowd workers earn low wages is due to this lack oftransparency. As a result, tools have been developed to providemore transparency within crowd markets to help workers. How-ever, while most workers use these tools, they still earn less thanminimum wage. We argue that the missing element is guidance onhow to use transparency information. In this paper, we explore hownovice workers can improve their earnings by following the trans-parency criteria of Super Turkers, i.e., crowd workers who earnhigher salaries on Amazon Mechanical Turk (MTurk). We believethat Super Turkers have developed effective processes for usingtransparency information. Therefore, by having novices follow aSuper Turker criteria (one that is simple and popular among SuperTurkers), we can help novices increase their wages. For this purpose,we:(i)conducted a survey and data analysis to computationallyidentify a simple yet common criteria that Super Turkers use forhandling transparency tools;(ii)deployed a two-week field experi-ment with novices who followed this Super Turker criteria to findbetter work on MTurk. Novices in our study viewed over 25,000tasks by 1,394 requesters. We found that novices who utilized thisSuper Turkers’ criteria earned better wages than other novices. Ourresults highlight that tool development to support crowd workersshould be paired with educational opportunities that teach work-ers how to effectively use the tools and their related metrics (e.g.,transparency values). We finish with design recommendations forempowering crowd workers to earn higher salaries.
You can download the research paper from this link.
You can find the code of the Goohle Chrome extension on this link
You can find the code of the server side code on this link
Becoming the Super Turker: Following Transparency Criteria for Higher Wages
Saiph Savage, Chun Wei Chiang, Susumu Saito, Carlos Toxtli and Jeffrey Bigham
The Web Conferece (WWW) 2020, Taipei, Taiwan