Publikationsdatenbank

Inter-observer agreement on a checklist to evaluate scientific publications in the field of animal reproduction (2012)

Art

Zeitschriftenartikel / wissenschaftlicher Beitrag

Autoren

Simoneit, Céline

Heuwieser, Wolfgang

Arlt, Sebastian P.

Quelle

Journal of veterinary medical education

Bandzählung: 39

Heftzählung: 2

Seiten: 119 – 127

ISSN: 0748-321x

Sprache

Englisch

Verweise

DOI: 10.3138/jvme.1111.113R

Pubmed: 22709736

Kontakt

Tierklinik für Fortpflanzung

Königsweg 65
Haus 27
14163 Berlin
+49 30 838 62618
fortpflanzungsklinik@vetmed.fu-berlin.de

Abstract / Zusammenfassung

This study's objective was to determine respondents' inter-observer agreement on a detailed checklist to evaluate three exemplars (one case report, one randomized controlled study without blinding, and one blinded, randomized controlled study) of the scientific literature in the field of bovine reproduction. Fourteen international scientists in the field of animal reproduction were provided with the three articles, three copies of the checklist, and a supplementary explanation. Overall, 13 responded to more than 90% of the items. Overall repeatability between respondents using Fleiss's κ was 0.35 (fair agreement). Combining the "strongly agree" and "agree" responses and the "strongly disagree" and "disagree" responses increased κ to 0.49 (moderate agreement). Evaluation of information given in the three articles on housing of the animals (35% identical answers) and preconditions or pretreatments (42%) varied widely. Even though the overall repeatability was fair, repeatability concerning the important categories was high (e.g., level of agreement=98%). Our data show that the checklist is a reasonable and practical supporting tool to assess the quality of publications. Therefore, it may be used in teaching and practicing evidence-based veterinary medicine. It can support training in systematic and critical appraisal of information and in clinical decision making.