Inter-Coder Agreement for Computational Linguistics
In: Computational linguistics - Association for Computational Linguistics (Print), Jg. 34 (2008), Heft 4, S. 555-596
Online
academicJournal
- print; 42; 4 p.1/2
Zugriff:
This article is a survey of methods for measuring agreement among corpus annotators. It exposes the mathematics and underlying assumptions of agreement coefficients, covering Krippendorff's alpha as well as Scott's pi and Cohen's kappa; discusses the use of coefficients in several annotation tasks; and argues that weighted, alpha-like coefficients, traditionally less used than kappa-like measures in computational linguistics, may be more appropriate for many corpus annotation tasks-but that their use makes the interpretation of the value of the coefficient even harder.
Titel: |
Inter-Coder Agreement for Computational Linguistics
|
---|---|
Autor/in / Beteiligte Person: | ARTSTEIN, Ron ; POESIO, Massimo |
Link: | |
Zeitschrift: | Computational linguistics - Association for Computational Linguistics (Print), Jg. 34 (2008), Heft 4, S. 555-596 |
Veröffentlichung: | Cambridge, MA: MIT Press, 2008 |
Medientyp: | academicJournal |
Umfang: | print; 42; 4 p.1/2 |
ISSN: | 0891-2017 (print) |
Schlagwort: |
|
Sonstiges: |
|