Publication Details

WTF-LOD - A New Resource for Large-Scale NER Evaluation

OTRUSINA Lubomír and SMRŽ Pavel. WTF-LOD - A New Resource for Large-Scale NER Evaluation. In: Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16). Portorož: European Language Resources Association, 2016, pp. 3299-3302. ISBN 978-2-9517408-9-1.
Czech title
WTF-LOD - Nový zdroj pro vyhodnocování NER systémů
Type
conference paper
Language
english
Authors
Otrusina Lubomír, Ing. (DCGM FIT BUT)
Smrž Pavel, doc. RNDr., Ph.D. (DCGM FIT BUT)
Keywords

named entity evaluation, linked open data, CommonCrawl, ClueWeb, Wikipedia

Abstract

This paper introduces the Web TextFull linkage to Linked Open Data (WTF-LOD) dataset intended for large-scale evaluation of named entity recognition (NER) systems. First, we present the process of collecting data from the largest publically-available textual corpora, including Wikipedia dumps, monthly runs of the CommonCrawl, and ClueWeb09/12. We discuss similarities and differences of related initiatives such as WikiLinks and WikiReverse. Our work primarily focuses on links from "textfull" documents (links surrounded by a text that provides a useful context for entity linking), de-duplication of the data and advanced cleaning procedures. Presented statistics demonstrate that the collected data forms one of the largest available resource of its kind. They also prove suitability of the result for complex NER evaluation campaigns, including an analysis of the most ambiguous name mentions appearing in the data.

Published
2016
Pages
3299-3302
Proceedings
Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)
Conference
Language Resources and Evaluation Conference 2016, Portorož, SI
ISBN
978-2-9517408-9-1
Publisher
European Language Resources Association
Place
Portorož, SI
UT WoS
000526952503084
EID Scopus
2-s2.0-85037060832
BibTeX 
@INPROCEEDINGS{FITPUB11119,
   author = "Lubom\'{i}r Otrusina and Pavel Smr\v{z}",
   title = "WTF-LOD - A New Resource for Large-Scale NER Evaluation",
   pages = "3299--3302",
   booktitle = "Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)",
   year = 2016,
   location = "Portoro\v{z}, SI",
   publisher = "European Language Resources Association",
   ISBN = "978-2-9517408-9-1",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/11119"
}
Back to top