Fecha: 17 de Junio de 2013

Ponente: Eneko Agirre (Euskal Herriko Unibertsitatea/Universidad del País Vasco)

Lugar de celebración: Salón de Actos, Facultad de Psicología, UNED


Semantic Textual Similarity (STS) measures the degree of semantic equivalence between two texts, on a scale from 0 to 5. I will introduce the STS task as held in 2012 and 2013. In 2013, STS was chosen to be the *SEM conference shared task, and contained two subtasks. The core task similar to the 2012 task, based on pairs of sentences from news headlines, machine translation evaluation datasets and lexical resource glosses. The typed-similarity task is novel and involves pairs of cultural heritage items which are described with metadata like title, author or description. Several types of similarity have been defined, including similar author, similar time period or similar location. The annotation leveraged crowdsourcing, with relatively high inter-annotator correlation, ranging from 62% to 87%. In 2013 the core task attracted 34 participants corresponding to 89 runs, and the typed-similarity task attracted 6 teams corresponding to 14 runs.