IBM Tech Report: Harnessing Disagreement in Crowdsourcing a Relation Extraction Gold Standard

Posted on March 9, 2013 by Lora Aroyo

The initial results from our October 2012 experiments got accepted as IBM technical report. We have presented updated results at the Web Science 2013 Conference, which cover also experiments until March 2013. Soon we will be publishing a new sets of results for the experiments performed between mainly in the period March – May 2013, which will also include a full set of metrics on them. [link]

About Lora Aroyo

I am Research Scientist at Google working in the area of Responsible AI specifically focussing on responsible data for AI. Previously, I was a full professor in Computer Science, head of the Web and Media Group, Department of Computer Science, VU University of Amsterdam, The Netherlands, where I was scientific coordinator of the EU Integrated Project: NoTube: Integration of Web and TV Data with the Help of Semantics, http://notube.tv Go to my web page for more details: http://lora-aroyo.org

View all posts by Lora Aroyo →

This entry was posted in paper and tagged Crowdsourcing, gold standard, IBM, NLP, Watson. Bookmark the permalink.