A. G. Mariani-j, Language resources and amazon mechanical turk : legal, ethical and other issues, LISLR2010, " Legal Issues for Sharing Language Resources workshop, p.2010, 2010.

B. D. , R. N. , N. J. , and M. T. Curran-j, Named entity recognition in wikipedia. In People's Web '09 : Proceedings of the 2009 Workshop on The People's Web Meets NLP, pp.10-18, 2009.

B. V. Passonneau-r, . A. Salleb-aouissi, and . Ide-n, Anveshan : A tool for analysis of multiple annotators' labeling behavior, Proceedings of The fourth linguistic annotation workshop (LAW IV), 2010.

B. A. Mitchell-t, Combining labeled and unlabeled data with co-training, COLT : Proceedings of the Workshop on Computational Learning Theory, 1998.

C. Dredze-m, Creating speech and language data with amazon's mechanical turk, CSLDAMT '10 : Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, 2010.

C. J. and P. M. Kruschwitz-u, Phrase Detectives : a Web-based Collaborative Annotation Game, Proceedings of the International Conference on Semantic Systems (I-Semantics'08), 2008.

C. D. and G. Z. Jordan-m, Active learning with statistical models, 1995.

C. P. Stevenson-s, Automatically identifying changes in the semantic orientation of words, 2010.

E. K. Kowalski-a and . Pado-s, The salsa annotation tool, Proceedings of the Workshop on Prospects and Advances in the Syntax/Semantics Interface, 2003.

F. T. , M. W. , K. A. Keller-n, and M. J. Dredze-m, Annotating named entities in twitter data with crowdsourcing, Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, CSLDAMT '10, pp.80-88, 2010.

F. K. and A. G. Cohen-k, Amazon mechanical turk : Gold mine or coal mine ? Computational Linguistics, p.37, 2011.

F. K. Sagot-b, Influence of Pre-annotation on POS-tagged Corpus Development, Proc. of the Fourth ACL Linguistic Annotation Workshop, 2010.

G. Q. Vogel-s, Consensus versus expertise : A case study of word alignment with mechanical turk, Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, CSLDAMT '10, pp.30-34, 2010.

G. D. Liu-y, Non-expert evaluation of summarization systems is risky, Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, CSLDAMT '10, pp.148-151, 2010.

G. S. Griffiths-t, A fully bayesian approach to unsupervised part-of-speech tagging, Proceedings of ACL, 2007.

H. T. Nakajima-k, H. L. Vasu-a, . Moreno-p, and . Lebeau-m, Building transcribed speech corpora quickly and cheaply for many languages, Proceedings of Interspeech, pp.1914-1917, 2010.

K. M. Lowe-j, Creating a research collection of question answer sentence pairs with amazon's mechanical turk, Proceedings of the International Language Resources and Evaluation, 2008.

K. S. and M. S. Paritosh-p, The anatomy of a large-scale human computation engine, Proceedings of Human Computation Workshop at the 16th ACM SIKDD Conference on Knowledge Discovery and Data Mining, 2010.

L. M. Joubert-a, JeuxDeMots : un prototype ludique pour l'émergence de relations entre termes, JADT'08 : Journées internationales d'Analyse statistiques des Données Textuelles, pp.657-666, 2008.

L. B. Singh-r and . B. Raj, Creating a linguistic plausibility dataset with non-expert annotators, Proceedings of Interspeech, pp.1906-1909, 2010.

L. N. Eustice-k and P. M. Yetisgen-yildiz, Annotating large email datasets for named entity recognition with mechanical turk, Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, CSLDAMT '10, pp.71-79, 2010.

M. M. Banerjee-s and . I. Rudnicky-a, Using the amazon mechanical turk for transcription of spoken language, IEEE International Conference on Acoustics Speech and Signal Processing, pp.5270-5273, 2010.

M. I. , Y. C. Lee, S. S. Hetherington-l, and . Glass-j, Collecting voices from the cloud, Proceedings of the International Language Resources and Evaluation (LREC-2010), pp.1576-1583, 2010.

N. V. Cardie-c, Bootstrapping coreference classifiers with multiple machine learning algorithms, Proceedings of EMNLP 2003, 2003.

N. J. and C. J. Murphy-t, Transforming Wikipedia into Named Entity Training Data, Proceedings of the Australian Language Technology Workshop, pp.124-132, 2008.

N. S. Callison-burch-c, Cheap, fast and good enough : automatic speech recognition with non-expert transcription, Human Language Technologies : The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp.207-215, 2010.

P. A. Paroubek-p, Twitter as a corpus for sentiment analysis and opinion mining, Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) European Language Resources Association (ELRA), 2010.

R. J. Irani-l, Z. S. Silberman-m, and . Tomlinson-b, Who are the crowdworkers ? : shifting demographics in mechanical turk, Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems, CHI EA '10, pp.2863-2872, 2010.

R. J. , Z. A. Irani-l, and . Tomlinson-b, Who are the turkers ? worker demographics in amazon mechanical turk, 2009.

S. N. Eisner-j, Contrastive estimation : Training log-linear models on unlabeled data, Proceedings of the 43th Annual Meeting of the Association for Computational Linguistics (ACL'05), pp.354-362, 2005.

S. R. , O. , C. B. , and J. D. Ng, Cheap and fast -but is it good ? evaluating non-expert annotations for natural language tasks, Proceedings of EMNLP 2008, pp.254-263, 2008.

S. M. , G. D. Die-wald, and C. I. Mehler-a, Web-based annotation of anaphoric relations and lexical chains, ACL Workshop on Linguistic Annotation Workshop (LAW), 2007.

T. S. Hovy-e, A taxonomy, dataset, and classifier for automatic noun compound interpretation, Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp.678-687, 2010.

V. Ahn and L. , Games with a Purpose, Computer, vol.39, issue.6, pp.96-98, 2006.
DOI : 10.1109/MC.2006.196

V. Ahn and L. Dabbish-l, General techniques for designing games with a purpose, Communications of the ACM, pp.58-67, 2008.

W. P. , L. S. Cook-d, . Fennell-j, L. D. Goldenberg-b, and M. D. Simons-h, Towards building a high-qualityworkforce with mechanical turk, Proceedings of Computational Social Science and the Wisdom of Crowds (NIPS), 2010.

W. R. Briscoe-t and . J. Carroll, Semi-supervised training of a statistical parser from unlabeled partially-bracketed data, Proceedings of the 10th International Conference on Parsing Technologies, IWPT '07, pp.23-32, 2007.

X. F. Klakow-d, Paragraph acquisition and selection for list question using amazon's mechanical turk, Proceedings of the International Language Resources and Evaluation (LREC-2010), pp.2340-2345, 2010.

Y. D. Cambridge, M. M. Yetisgen-yildiz, X. F. Solti-i, and . R. Halgrim-s, Unsupervised word sense disambiguation rivaling supervised methods Preliminary experience with amazon's mechanical turk for annotating medical named entities, Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, CSLDAMT '10, pp.189-196, 1995.