01390nas a2200145   4500008004100000245007500041210006900116260001600185520084500201100002001046700002301066700002001089700002401109856011101133       2016                        eng d00aTowards Best Practices for Crowdsourcing Ontology Alignment Benchmarks0 aTowards Best Practices for Crowdsourcing Ontology Alignment Benc  aKobe, Japan3 a<p>Ontology alignment systems establish the links between ontologies that enable knowledge from various sources and domains to be used by applications in many different ways. Unfortunately, these systems are not perfect. Currently, the results of even the best-performing alignment systems need to be manually verified in order to be fully trusted. Ontology alignment researchers have turned to crowdsourcing platforms such as Amazon's Mechanical Turk to accomplish this. However, there has been little systematic analysis of the accuracy of crowdsourcing for alignment verification and the establishment of best practices. In this work, we analyze the impact of the presentation of the context of potential matches and the way in which the question is presented to workers on the accuracy of crowdsourcing for alignment verification.</p>
1 aAmini, Reihaneh1 aCheatham, Michelle1 aGrzebala, Pawel1 aMcCurdy, Helena, B.  uhttps://daselab.cs.ksu.edu/publications/towards-best-practices-crowdsourcing-ontology-alignment-benchmarks