On the Evaluation of Entity Profiles

Research output: Contribution to conference › Paper › Research › peer-review

Standard

On the Evaluation of Entity Profiles. / de Rijke, Maarten; Balog, Krisztian; Bogers, Toine; van den Bosch, Antal.

2010. Paper presented at Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010), Padua, Italy.

Research output: Contribution to conference › Paper › Research › peer-review

Harvard

de Rijke, M, Balog, K, Bogers, T & van den Bosch, A 2010, 'On the Evaluation of Entity Profiles', Paper presented at Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010), Padua, Italy, 20/09/2010 - 23/09/2010.

APA

de Rijke, M., Balog, K., Bogers, T., & van den Bosch, A. (2010). On the Evaluation of Entity Profiles. Paper presented at Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010), Padua, Italy.

Vancouver

de Rijke M, Balog K, Bogers T, van den Bosch A. On the Evaluation of Entity Profiles. 2010. Paper presented at Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010), Padua, Italy.

Author

de Rijke, Maarten ; Balog, Krisztian ; Bogers, Toine ; van den Bosch, Antal. / On the Evaluation of Entity Profiles. Paper presented at Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010), Padua, Italy.6 p.

Bibtex

@conference{cd9f71f916a8435991023808fbad2744,
title = "On the Evaluation of Entity Profiles",
abstract = "Entity profiling is the task of identifying and ranking descriptions of a given entity. The task may be viewed as one where the descriptions being sought are terms that need to be selected from a knowledge source (such as an ontology or thesaurus). In this case, entity profiling systems can be assessed by means of precision and recall values of the descriptive terms produced. However, recent evidence suggests that more sophisticated metrics are needed that go beyond mere lexical matching of system-produced descriptors against a ground truth, allowing for graded relevance and rewarding diversity in the list of descriptors returned. In this note, we motivate and propose such a metric.",
keywords = "entity profiling, evaluation, entity retrieval, entity search",
author = "{de Rijke}, Maarten and Krisztian Balog and Toine Bogers and {van den Bosch}, Antal",
year = "2010",
language = "English",
note = "Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010) ; Conference date: 20-09-2010 Through 23-09-2010",

}

RIS

TY - CONF

T1 - On the Evaluation of Entity Profiles

AU - de Rijke, Maarten

AU - Balog, Krisztian

AU - Bogers, Toine

AU - van den Bosch, Antal

PY - 2010

Y1 - 2010

N2 - Entity profiling is the task of identifying and ranking descriptions of a given entity. The task may be viewed as one where the descriptions being sought are terms that need to be selected from a knowledge source (such as an ontology or thesaurus). In this case, entity profiling systems can be assessed by means of precision and recall values of the descriptive terms produced. However, recent evidence suggests that more sophisticated metrics are needed that go beyond mere lexical matching of system-produced descriptors against a ground truth, allowing for graded relevance and rewarding diversity in the list of descriptors returned. In this note, we motivate and propose such a metric.

AB - Entity profiling is the task of identifying and ranking descriptions of a given entity. The task may be viewed as one where the descriptions being sought are terms that need to be selected from a knowledge source (such as an ontology or thesaurus). In this case, entity profiling systems can be assessed by means of precision and recall values of the descriptive terms produced. However, recent evidence suggests that more sophisticated metrics are needed that go beyond mere lexical matching of system-produced descriptors against a ground truth, allowing for graded relevance and rewarding diversity in the list of descriptors returned. In this note, we motivate and propose such a metric.

KW - entity profiling

KW - evaluation

KW - entity retrieval

KW - entity search

M3 - Paper

T2 - Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010)

Y2 - 20 September 2010 through 23 September 2010

ER -

ID: 47027259